Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Cases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Optimal mass evacuation planning for electric vehicles before natural disasters

The electric vehicle (EV) market has significantly expanded because EVs have lower operational costs while leaving less environmental footprint than internal combustion engine vehicles. However, EVs also come with drawbacks, including long charging time and short operational ranges. With these drawbacks and limited charging facilities, efficient long-distance EV evacuation management is challenging and has not been properly addressed. Without an efficient evacuation plan, serious congestion could happen at charging facilities, the evacuation process would be excessively long, and thus human lives may be put at risk. This study is motivated to investigate the optimal mass evacuation planning for EVs considering limited charging facilities. A three-stage method is proposed to efficiently approach this problem. A case study of Florida hurricane evacuation is conducted. Here, the method's effectiveness is verified by comparing it with a benchmark. Management insights and policy indications are drawn through sensitivity analysis of key parameters.

33 ADVANCED PROPULSION SYSTEMS↗

Assessing CLUBB PDF Closure Assumptions for a Continental Shallow-to-Deep Convective Transition Case Over Multiple Spatial Scales

Assumed-PDF (probability density function) higher-order turbulence closures (APHOCs) are now widely used for parameterizing boundary layer turbulence and shallow convection in Earth system models (ESMs). A better understanding of the resolution-dependent behavior of APHOCs is essential for improving the performance of next-generation ESMs with intended horizontal resolutions finer than 10 km. In this study, we evaluate the PDF family of Analytic double-Gaussian 1 implemented in Cloud Layers Unified By Binormals (CLUBB) over a range of spatial scales (Dx) from 2 to 100 km. A 120-km-wide large eddy simulation (LES) for a continental convection case during 2016 Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign serves as benchmark to evaluate the PDF closure using an off-line approach. We find during the shallow convection period, the CLUBB PDF closure tends to produce positive biases of cloud properties and liquid water flux near cloud base for all scales of analysis. It produces negative biases for these variables near cloud top that are more severe for Dx larger than 25 km. Results show that replacing the CLUBB-parameterized moisture and temperature skewnesses with LES-derived ones can fix most of the biases if clipping of input moments is allowed to prevent the occurrence of unrealizable solutions. Overall, the performance of the PDF closure is better for smaller Dx = 2–5 km than for larger Dx = 50–100 km; for a given grid spacing, it is better when the convective clouds become deeper in the late afternoon. Likely causes for the resolution dependence and implications for improving the PDF closure are discussed.

54 ENVIRONMENTAL SCIENCES↗

Scattering Calorimeter FY24 Deliverable Report

A simulation-based method has been developed to prototype new detector designs for nuclear data measurements utilizing neutron scattering. This method uses representative physics inputs for signal and background generation, full detector resolution smearing benchmarked by experimental data, and a neutron beam timing simulation to produce analyzable output like a physical measurement. A test case has been studied using a hybrid time-of-flight calorimeter detector for scattering cross-section measurements on 239 Pu with 1-5 MeV incident monoenergetic neutrons. Data analysis methods have been developed to perform event-level particle reconstruction and reaction channel discrimination. This analysis has been used to estimate the capability of the test detector to perform simultaneous scattering and fission cross section measurements, as well as its ability to provide neutron spectra and particle angular information.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Intercomparison of flood inundation models across land use types and hydrological flood stages

Flood Inundation Mapping (FIM) model selection is a key operational decision because accurate, rapid mapping underpins early warning and resource allocation. FIM performance is context-dependent and can vary with hydrograph phase, land-use/land-cover (LULC), and the evaluation benchmark. Intercomparison studies typically assess a single near-peak snapshot against one reference dataset. Here, we provide a context-stratified intercomparison across (i) multiple hydrograph phases, (ii) LULC classes, and (iii) benchmark types, for five FIM approaches spanning a wide range of physical complexity and operational cost (TRITON, LISFLOOD-FP, HEC-RAS 2D, ARC-Curve2Flood, and OWP HAND-FIM). We use the Hurricane Matthew flood (2016) in the Neuse River Basin, North Carolina, USA, as a case study. Using high-resolution remote sensing-derived flood inundation maps, hand-labeled points, and building footprints, we assess model skill across two rising and two falling hydrograph limbs and across major LULC types. Results show that model rankings shift systematically across contexts: LISFLOOD-FP ranks highest in three of four flood phases, while TRITON leads during one rising limb phase; LISFLOOD-FP performs best in vegetated areas, whereas HEC-RAS improves relative performance in agricultural and urban areas; and benchmark choice influences conclusions, with LISFLOOD-FP performing best for flooded-building detection in the late falling limb, while TRITON ranks highest against hand-labeled points. We also report representative wall-clock runtimes for each workflow to provide use-case context for operational feasibility. Together, these results offer transferable guidance for model selection and for designing large-scale, benchmark-aware FIM intercomparison studies.

Nikrou, Parvaneh [University of Alabama]↗

Rethinking agrivoltaic incentive programs: A science-based approach to encourage practical design solutions

Agrivoltaic systems are promising solutions to address global food and energy challenges by combining agriculture and solar photovoltaics. However, the lack of appropriate regulations to define and guide their implementation constrains the growth of agrivoltaic systems in the U.S. This study uses a shading and radiation tool to evaluate an existing agrivoltaic incentive program that defines agrivoltaic designs based on shading reduction limits and panel height requirements. Our analysis indicates that structuring policy requirements around shading, and not light availability, may lead to an underestimation of crop suitability by neglecting diffuse radiation. Furthermore, we show that agrivoltaic systems can avoid increasing panel height if policy acknowledges use-case scenarios where farming only occurs between rows. In light of these insights, this study proposes two key policy recommendations: (1) benchmark crop suitability based on daily light integral (DLI) requirements for a shade-intolerant crop selected to represent a prevalent crop in the region, and (2) include an incentive scenario where agriculture is only required between rows. Furthermore, these two recommendations can potentially incentivize designs that are practical and closer in cost to conventional solar farms, thereby accelerating the adoption of cost-effective agrivoltaic systems.

14 SOLAR ENERGY↗

Massively parallel axisymmetric fluid model for streamer discharges

A highly parallelizable fluid plasma simulation tool based upon the first-order drift-diffusion equations is discussed. Atmospheric pressure plasmas have densities and gradients that require small element sizes in order to accurately simulate the plasm resulting in computational meshes on the order of millions to tens of millions of elements for realistic size plasma reactors. To enable simulations of this nature, parallel computing is required and must be optimized for the particular problem. Here, a finite-volume, electrostatic drift-diffusion implementation for low-temperature plasma is discussed. The implementation is built upon the Message Passing Interface (MPI) library in C++ using Object Oriented Programming. The underlying numerical method is outlined in detail and benchmarked against simple streamer formation from other streamer codes. Electron densities, electric field, and propagation speeds are compared with the reference case and show good agreement. Convergence studies are also performed showing a minimal space step of approximately 4 μm required to reduce relative error to below 1% during early streamer simulation times and even finer space steps are required for longer times. Additionally, strong and weak scaling of the implementation are studied and demonstrate the excellent performance behavior of the implementation up to 100 million elements on 1024 processors. Lastly, different advection schemes are compared for the simple streamer problem to analyze the influence of numerical diffusion on the resulting quantities of interest.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Forecasting Multi-Step-Ahead Street-Scale Nuisance Flooding using a seq2seq LSTM Surrogate Model for Real-Time Application in a Coastal-Urban City

In coastal-urban cities facing an elevated risk of nuisance flooding (by rain and tide) due to increased heavy rainfall, sea level rise, urbanization, and aging drainage systems, real-time flood forecasting at the street-scale can provide useful information to transportation decision-makers. Physics-Based Models (PBMs) that offer high accuracy come with high computational runtimes and costs that limit their application for real-time flood forecasting. To address this challenge, Machine Learning (ML) surrogate models trained from PBMs have been proposed to provide street-scale flood forecasts. Previous related studies have focused on using Long Short-Term Memory (LSTM) architectures to model hourly flood depth on streets. While LSTM models can capture input sequences effectively, they fall short in accurately preserving output sequences, limiting their suitability for multi-step-ahead forecasts. The seq2seq LSTM architecture offers a key advantage here by capturing the full sequence of input–output, making it potentially more suitable for multi-step-ahead flood forecasts compared to traditional LSTM models. However, seq2seq LSTM has not been tested for street-scale flood forecasting, particularly for rapidly fluctuating nuisance flooding events which require special attention to its temporal sequences. Hence, in this study, we applied the seq2seq LSTM model to explore multi-step-ahead street-scale nuisance flooding and compared its results to the traditional LSTM model as a benchmark model. LSTM and seq2seq LSTM surrogate models were applied to 22 flood-prone streets in Norfolk, Virginia, as a case study with a 4-hr (short-term) and 8-hr (long-term) lead time. The models were trained with environmental (rainfall and tide) and topographic (elevation, Topographic Wetness Index, and Depth-To-Water) features along with PBM-derived water depths for different storm events. The results demonstrated satisfactory performance of both LSTM and seq2seq LSTM surrogate models throughout the forecast period compared to the PBM. However, the seq2seq LSTM showed lower Mean Absolute Error (MAE)/ Root Mean Square Error (RMSE) and higher Nash–Sutcliffe Efficiency (NSE)/ correlation than the LSTM across most lead times, particularly for long-term forecasting due to its supremacy in handling both input–output sequences together, which is missing in the traditional LSTM. For example, in the long-term, the average RMSE ranges were 0.0268–0.0373 m for LSTM and 0.0226–0.0319 m for seq2seq LSTM, while in the short-term, they were 0.0263–0.0293 m and 0.0261–0.0283 m, respectively. Additionally, while both models exhibited similar performance in distinguishing flooded and non-flooded streets for flood depth ≥ 0.1 m, the seq2seq LSTM model demonstrated superior performance for higher flood depths (such as ≥ 0.2 m and ≥ 0.3 m). Once trained, inference took only 0.09 to 0.11 s (short-term) and 0.30 to 0.35 s (long-term) per storm event for the 22 streets, making the application highly suitable for real-time decision-making during nuisance flood events.

54 ENVIRONMENTAL SCIENCES↗

A circuit-generated quantum subspace algorithm for the variational quantum eigensolver

Recent research has shown that wavefunction evolution in real and imaginary time can generate quantum subspaces with significant utility for obtaining accurate ground state energies. Inspired by these methods, we propose combining quantum subspace techniques with the variational quantum eigensolver (VQE). In our approach, the parameterized quantum circuit is divided into a series of smaller subcircuits. The sequential application of these subcircuits to an initial state generates a set of wavefunctions that we use as a quantum subspace to obtain high-accuracy groundstate energies. We call this technique the circuit subspace variational quantum eigensolver (CSVQE) algorithm. By benchmarking CSVQE on a range of quantum chemistry problems, we show that it can achieve significant error reduction in the best case compared to conventional VQE, particularly for poorly optimized circuits, greatly improving convergence rates. Furthermore, we demonstrate that when applied to circuits trapped at local minima, CSVQE can produce energies close to the global minimum of the energy landscape, making it a potentially powerful tool for diagnosing local minima.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Toward scalable bound-to-resonance extrapolations for few- and many-body systems

In open quantum many-body systems, the theoretical description of resonant states of many particles strongly coupled to the continuum can be challenging. Such states are commonplace in, for example, exotic nuclei and hadrons, and can reveal important information about the underlying forces at play in these systems. In this work, we demonstrate that the complex-augmented eigenvector continuation (CA-EC) method, originally formulated for the two-body problem with uniform complex scaling, can reliably perform bound-to-resonance extrapolations for genuine three-body resonances having no bound subsystems. Here, we first establish that three-body bound-to-resonance extrapolations are possible by benchmarking different few-body approaches, and we provide arguments to explain how the extrapolation works in the many-body case. We furthermore pave the way towards scalable resonance extrapolations in many-body systems by showing that the CA-EC method also works in the Berggren basis, studying a realistic application using the Gamow shell model.

Ab initio calculations↗

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

A Regime-Switching Spatio-Temporal GARCH Method for Short-Term Wind Forecasting

The growth of wind energy poses challenges to the integration of wind energy into the power grid. Within a wind farm, the conditions of local wind exhibit sizeable variations in very short term period and temporal wind speed patterns vary from turbine to turbine. Hence, short-term wind forecasting has been adopted to assist power system operations. In this work, we propose a wind plant-level short term wind speed and power forecasting methodology considering turbine contributions. The proposed model utilizes spatio-temporal dependencies and nonstationarity to accommodate the characteristics of wind farm data by using a novel regime-switching spatiotemporal generalized autoregressive conditional heteroscedasticity (RS-stGARCH) model. Case studies based on 2 years of data from a wind farm shows that the proposed RS-stGARCH method outperforms benchmark models by up to 21.10% for wind speed forecasting and up to 58.62% for the wind power forecasting.

ENERGY PLANNING, POLICY, AND ECONOMY↗

Generalized Analytical Estimation of Sensitivity Matrices in Unbalanced Distribution Networks

Fast and accurate estimation of sensitivity matrices is significant for the enhancement of distribution system modeling and automation. Analytical estimations have mainly focused on voltage magnitude sensitivity to active/reactive power injections for unbalanced networks with Wye-connected loads and neglecting DERs' smart inverter functionality. Hence, this paper enhances the scope of analytical estimation of sensitivity matrices for unbalanced networks with 1- Φ, 2- Φ, and 3- Φ Delta/Wye-connected loads, DERs with smart inverter functionality, and substation/line step-voltage regulators (SVR). A composite bus model comprising of DER, Delta- and Wye-connected load is proposed to represent a generic distribution bus, which can be simplified to load, PV, or voltage-controlled bus as required. Furthermore, the proposed matrix-based analytical method consolidates voltage magnitude and angle sensitivity to active/reactive power injection and tap-position of all SVRs into a single algorithm. Extensive case studies on IEEE and EPRI networks show the accuracy and wide scope of the proposed algorithm compared to the existing benchmark method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Summary Report Of The FY25 Reactor Physics Verification And Validation Exercises In The Advanced Reactor Technologies - Gas-cooled Reactor Program

Valdiation and verification of numerical tools is critical for ensuring reasonable predictions for design scoping, licensing, and safety analsyis. In this report, two reactor physics verification and validation exercises are presented. The first of these exercises focuses on burnup analysis with data from the Advanced Gas Reactor (AGR) program. Simulations are performed with Monte Carlo N-Particle (MCNP) and are compared with the experimental measurements for the AGR 1 and 2 experiments that utilize both UCO and UO2 fuel. The second exercises utilizes data from the HTR-Proteus experiments to perform reactor physics validation. Specifications of the experimental facility are provdied, along with a demonstration of initial modeling efforts in Serpent for one of the determistic packing experiments. Both cases are part of the Generation-IV international forum (GIF) Very High-Temperature Reactor (VHTR) Computational Methods, Validation, and Benchmarking (CMVB) program, an international collaborative organization dedicated to the verification and validation of High-Temperature Gas-Cooled Reactor (HTGR) analysis. Participation in the CMVB allows the US Department of Energy (DOE) to leverage these existing validation activities to provide extra value through benchmarking activities with other CMVB members.

and Benchmarking (CMVB) program↗

Benchmark study of a new simplified DFN model for shearing of intersecting fractures and faults

It is challenging to quantitatively predict shearing of intersecting fractures/faults because of dynamic frictional contacts accompanied by possible nonlinear rock deformation. To address such challenges, a new conceptual model—the simplified DFN model—was proposed and validated by Hu et al. 46 to use major paths (MPs) to represent complicated DFNs for calculation of shearing. In this work, we conducted a benchmark study for three examples that involve different levels of complexity of intersecting fractures, and correspondingly different numbers of MPs. The codes and software that were used in the benchmark cover a range of continuum, discontinuum and hybrid numerical methods: NMM (LBNL), FLAC3D (LBNL), GBDEM (KIGAM), FRACOD (DynaFrax), and CASRock (CAS). The general consistency between DFN and MP cases as predicted by all the codes/software demonstrates that major paths can be used to simplify the geometry of DFNs in a wide range of software. Disagreement in results made by some software and potential future improvements are discussed. We show that (1) shearing of one or multiple major fractures can be reduced if there are multiple smaller intersecting fractures in that area, which is a useful basis for understanding and controlling induced seismicity and merits further analysis, and (2) the agreement achieved in the benchmark examples provide confidence that the simplified DFN model is a promising conceptual model that can be used for different types of numerical approaches and software for simplifying the analysis of the shearing of intersecting fractures and faults.

58 GEOSCIENCES↗

3D printed optimized electrodes for electrochemical flow reactors

Recent advances in 3D printing have enabled the manufacture of porous electrodes which cannot be machined using traditional methods. With micron-scale precision, the pore structure of an electrode can now be designed for optimal energy efficiency, and a 3D printed electrode is not limited to a single uniform porosity. As these electrodes scale in size, however, the total number of possible pore designs can be intractable; choosing an appropriate pore distribution manually can be a complex task. To address this challenge, we adopt an inverse design approach. Using physics-based models, the electrode structure is optimized to minimize power losses in a flow reactor. The computer-generated structure is then printed and benchmarked against homogeneous porosity electrodes. We show how an optimized electrode decreases the power requirements by 16% compared to the best-case homogeneous porosity. Future work could apply this approach to flow batteries, electrolyzers, and fuel cells to accelerate their design and implementation.

25 ENERGY STORAGE↗

Simulations of three-layer Richtmyer–Meshkov mixing in a shock tube

Here, the Richtmyer–Meshkov instability causes perturbations to grow after a shock traverses a fluid density interface. This increases the mixing rate between fluid from either side of the interface. We use the Flash Eulerian hydrodynamic code to investigate alterations when a thin third layer of intermediate density is placed along the interface, effectively creating two adjacent unstable interfaces. This is a common occurrence in engineering applications where a thin barrier initially separates two materials. We find that the width of the mixing layer is similar or slightly reduced; however, the total mass of mixed material can actually increase. The mixing layer becomes more compact and efficient. However, the normalized mixed mass decreases, meaning that finger entrainment becomes more important than in the simple two-layer case. The effect of adding the central layer appears to decrease when the Atwood number is decreased. The Flash results are also benchmarked against two-layer experimental data from a shock tube at the University of Arizona.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Time-dependent variational principle for mixed matrix product states in the thermodynamic limit

Here, we describe a time evolution algorithm for quantum spin chains whose Hamiltonians are composed of an infinite uniform left and right bulk part, and an arbitrary finite region in between. The left and right bulk parts are allowed to be different from each other. The algorithm is based on the time-dependent variational principle (TDVP) of matrix product states. It is inversion-free and very simple to adapt from an existing TDVP code for finite systems. The importance of working in the projective Hilbert space is highlighted. We study the quantum Ising model as a benchmark and an illustrative example. The spread of information after a local quench is studied in both the ballistic and the diffusive case. We also offer a derivation of TDVP directly from symplectic geometry.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Accelerating self-consistent field iterations in Kohn-Sham density functional theory using a low-rank approximation of the dielectric matrix

We present an efficient preconditioning technique for accelerating the fixed-point iteration in real-space Kohn-Sham density functional theory (DFT) calculations. The preconditioner uses a low-rank approximation of the dielectric matrix (LRDM) based on Gâteaux derivatives of the residual of fixed-point iteration along appropriately chosen direction functions. We develop a computationally efficient method to evaluate these Gâteaux derivatives in conjunction with the Chebyshev filtered subspace iteration procedure, an approach widely used in large-scale Kohn-Sham DFT calculations. Further, we propose a variant of LRDM preconditioner based on adaptive accumulation of low-rank approximations from previous self-consistent field iterations, and also extend the LRDM preconditioner to spin-polarized Kohn-Sham DFT calculations. We demonstrate the robustness and efficiency of the LRDM preconditioner against other widely used preconditioners on a range of benchmark systems with sizes ranging from ~100 to 1100 atoms (~500–20,000 electrons). The benchmark systems include various combinations of metal-insulating-semiconducting heterogeneous material systems, nanoparticles with localized d orbitals near the Fermi energy, nanofilm with metal dopants, and magnetic systems. In all benchmark systems, the LRDM preconditioner converges robustly within 20–30 iterations. In contrast, other widely used preconditioners show slow convergence in many cases, as well as divergence of the fixed-point iteration in some cases. Lastly, we demonstrate the computational efficiency afforded by the LRDM method, with up to 3.4-fold reduction in computational cost for the total ground-state calculation compared to other preconditioners.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗