Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Evaluating three evapotranspiration estimates from model of different complexity over China using the ILAMB benchmarking system

The land surface models range in complexity of terrestrial evapotranspiration, yet it is unknown how model complexity translates to accuracy of modeled evapotranspiration estimates. Here, we use the International Land Model Benchmarking system to assess ET estimates from three models of varying complexity driven by the same forcing datasets: an earth system model, a terrestrial biosphere model, and a stand-alone ET model. The performance assessment includes both temporal and spatial evaluation, and different plant functional types across China. Our results indicate that the most complex model, an earth system model, performed best against the benchmarking datasets and metrics. Terrestrial biosphere model performed best in simulating inter-annual variability of ET, while earth system model performed best in simulating the seasonal cycle. The more complex models (earth system model and terrestrial biosphere model) perform better in forest, shrub and crop ecosystems, while the simpler model (stand-alone ET model) perform better in grass ecosystems. Our study demonstrates the impact of model complexity on ET estimates and highlights directions for future ET model improvements.

54 ENVIRONMENTAL SCIENCES↗

3D CFD Model Validation Using Benchmark Data of 1/16th Scaled VHTR Upper Plenum and Development of Wall Heat-Transfer Correlation For Laminar Flow

With support from the U.S. Department of Energy-Office of Nuclear Energy’s (DOE-NE’s) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, an effort has been pursued to support high-temperature gas-cooled reactor (HTGR) technology development and its modeling and simulation needs. There is a particular need for advanced modeling and simulation tools to predict thermal-fluid behavior in the nuclear reactor primary system, especially in the core and the lower and upper plena, during safety-related transients. In this report, two main such activities are presented relevant to the HTGRs: (1) three-dimensional (3D) computational fluid dynamics (CFD) validation using benchmark data from the upper plenum of Texas A&M University’s 1/16th scaled very-high-temperature gas-cooled reactor (VHTR), and (2) development of wall heat-transfer correlation for laminar flow in a wall-heated pipe. The CFD tool validation exercises can be helpful to choose the models and CFD tools to simulate and design specific components of the HTRGs such as upper plenum where jet mixing is a complex phenomenon. In a loss of forced circulation event, the laminar flow can be observed during the development of natural circulation flow. This work includes the development and validation of heat transfer correlations for laminar flow using the Nek5000 CFD code due to limited available experimental data for laminar flow conditions to guide low-order models (1D). In this report, the flow characteristics of a single isothermal jet discharging into the upper plenum was investigated using the Nek5000 Large-Eddy Simulation (LES) CFD tool. Several numerical simulations were performed for various jet-discharged Reynolds numbers ranging from 3,413 to 12,819. A grid-independent study was performed. The numerical results of mean velocity, root-mean-square fluctuating velocity, and Reynolds stress were compared against the benchmark data. Good agreement was obtained between simulated and measured data for axial mean velocities, except near the upper plenum hemisphere. The maximum predicted errors for axial mean velocities at various normalized coolant channel diameter heights of 1, 5, and 10 are 1.56%, 1.88%, and 3.82%, respectively. In addition, the predicted root-mean-square fluctuating velocity and Reynolds stress are qualitatively in agreement with the experimental data. The Nek5000 code was used to develop wall-heat transfer correlation for laminar flow in a cylindrical tube. Several simulations were performed for various Reynolds flow and wall-heat fluxes. A new heat transfer correlation was developed using data from Nek5000 simulation results and regression functions in Matlab. The developed heat transfer correlation is valid for various Reynolds flows from 200 to 2000. The predicted R² value for model fit was 0.875, which ensures that 87.5% of the model data lies on the Nek5000 data. Moreover, a machine learning (ML) tool was used to train and test the Nek5000 data. A good fit of the ML-based model was observed with the test data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmarking the exponential ansatz for the Holstein model

Polarons are quasiparticles formed as a result of lattice distortions induced by charge carriers. The single-electron Holstein model captures the fundamentals of single polaron physics. We examine the power of the exponential ansatz for the polaron ground-state wavefunction in its coupled cluster, canonical transformation, and (canonically transformed) perturbative variants across the parameter space of the Holstein model. Our benchmark serves to guide future developments of polaron wavefunctions beyond the single-electron Holstein model.

Chemistry↗

The spectroscopic quadrupole moment of the 2 1 + state of 12 C: A benchmark of theoretical models

The spectroscopic quadrupole moment of the first 2 + state of 12 C has been measured employing the Coulomb-excitation re-orientation technique. Our result of $Q_{s} (2^{+}_{1}) = +9.3^{+3.5}_{-3.8}$ efm 2 suggests a larger oblate deformation than previously reported. Combining this with the consistently re-analyzed adopted value, we present the most precise value to date of $Q_{s} (2^{+}_{1})$ = +9.5(18) efm 2 , which is consistent with a geometrical rotor description. This simple outcome is compared to state-of-the-art shell-model, mean-field, ab initio calculations, cluster-based and geometrical-like theories, which show varying degrees of emergent quadrupole collectivity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Foams in Hohlraums

Foam materials are starting to find application in laser-heated hohlraums used to drive inertial confinement fusion (ICF) implosions. The disparate scales of the solid foam elements (nm) compared to the typical problem scale (mm) make it expensive to resolve the individual foam elements in hydrodynamic calculations. In this project we developed two new models for treating foam materials – a 3D hydrodynamic model that treats the foam as bits of pre-expanded solid material separated by voids, and a subgrid model that captures the essential physics of laser-heated foams without requiring resolution of the individual solid elements. We also explored the microphysics of the transition from interpenetrating kinetic behavior to fully-collisional fluid-like behavior during the early time heating and expansion of foam elements through a combination of single-fluid and multi-fluid hydrodynamics calculations and particle-in-cell calculations. The model was benchmarked against these calculations and against experimental data on laser-heated chemical and additive-manufactured (AM) foams. Since there was no existing data on laser-heated AM foams, we performed the first experiments on such foams at the Jupiter Laser Facility. Samples of three different types of printed AM foams were heated using a single 0.5 micron laser. The foam densities ranged from 10 to 100 mg/cc (supercritical for 0.5 micron light). We measured the backscattered light (power and spectrum), the transmitted light, and the time-integrated temperature of the foam samples. This benchmarked subgrid foam model is a new capability that should allow routine calculation of ICF designs using foam elements, potentially opening up a new design space.

36 MATERIALS SCIENCE↗

CFD Simulations to Support Pronghorn Modeling of a Molten Salt Fast Reactor

To assist with the deployment of next generation molten salt reactors (MSRs), the DOE NEAMS program is developing advanced simulation capabilities. As part of this work, the high-fidelity CFD tool, Nek5000 was used to inform model development for the engineering scale tool, Pronghorn. The particular case chosen was the EVOL molten salt fast reactor concept. This concept uses an open core design, which is well known to be sensitive to the particular geometry and can have complex flow behavior that varies across a range of conditions. This makes it an idea candidate for demonstration of the Hi2Lo concept of using higher fidelity models to benchmark lower fidelity models. Simulations of the EVOL design were performed using both LES (high-fidelity) and RANS (moderate-fidelity) in Nek5000. The LES results indicated discrepancies in 2-D axisymmetric RANS, indicating that the core is better modeled in RANS with a 3-D wedge representation of a portion of the core, which can accurately account for the effect of the inlet channels. Finally, results from the 3-D RANS were used to modify an existing turbulence model in Pronghorn. Improvement in the calibrated Pronghorn model was demonstrated. Future work is suggested to focus on expanding the LES calculation to provide a more direct point of comparison for both the RANS and Pronghorn models as well as incorporating more of the relevant MSR physics (such as delayed neutron precursor tracking) into the model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmarking a Pronghorn Model of the Natural Convection Shutdown Heat Removal Test Facility Against STAR-CCM+ (Poster)

Summary Verification of Pronghorn’s Net Radiation Transfer via Code-to-Code comparison with STAR-CCM+. Comparison based on Natural Convection Shutdown Heat-Removal Test Facility (NSTF). Near-perfect agreement if conjugate heat transfer inside the riser channels is replaced by fixed temperature. Difference of up to 5K if conjugate heat transfer is modeled (correlation vs. full CFD).

97 MATHEMATICS AND COMPUTING↗

Benchmark High-Fidelity EMT Models for Power Grid with PV Plants

In recent times electromagnetic transient (EMT) modeling tools have been identified as one of the most important requirements in replicating, analyzing, and investigating the dynamics of the power grid with photovoltaic (PV) plants. However, there are no benchmark models for power grid with PVs to investigate emerging challenges with higher penetration of PVs (like trips and momentary cessations during faults from a region far away). To this end, in this paper, synthetic benchmark high-fidelity EMT dynamic models of power grid with large-scale PV plants are presented. The models are developed in PSCAD and PSCAD/Fortran. Simulation results for different use cases (events) and scenarios are presented.

Marthi, Phani Ratna Vanamali↗

Temporal Forecasting of Distributed Temperature Sensing in a Thermal Hydraulic System With Machine Learning and Statistical Models

We benchmark performance of long-short term memory (LSTM) network machine learning model and autoregressive integrated moving average (ARIMA) statistical model in temporal forecasting of distributed temperature sensing (DTS). Data in this study consists of fluid temperature transient measured with two co-located Rayleigh scattering fiber optic sensors (FOS) in a forced convection mixing zone of a thermal tee. We treat each gauge of a FOS as an independent temperature sensor. We first study prediction of DTS time series using Vanilla LSTM and ARIMA models trained on prior history of the same FOS that is used for testing. The results yield maximum absolute percentage error (MaxAPE) and root mean squared percentage error (RMSPE) of 1.58% and 0.06% for ARIMA, and 3.14% and 0.44% for LSTM, respectively. Next, we investigate zero-shot forecasting (ZSF) with LSTM and ARIMA trained on history of the co-located FOS only, which is advantageous when limited training data is available. The ZSF MaxAPE and RMSPE values for ARIMA are comparable to those of the Vanilla use case, while the error values for LSTM increase. We show that in ZSF, performance of LSTM network can be improved by training on most correlated gauges between the two FOS, which are identified by calculating the Pearson correlation coefficient. The improved ZSF MaxAPE and RMSPE for LSTM are 4.4% and 0.33%, respectively. Performance of ZSF LSTM can be further enhanced through transfer learning (TL), where LSTM is re-trained on a subset of the FOS that is the target of forecasting. We show that LSTM pre-trained on correlated dataset and re-trained on 30% of testing target dataset achieves MaxAPE and RMSPE values of 2.32% and 0.28%, respectively.

ARIMA↗

Open‐Source Anaerobic Digestion Modeling Platform, Anaerobic Digestion Model No. 1 Fast (ADM1F)

An open‐source modeling platform, called Anaerobic Digestion Model No. 1 Fast (ADM1F), is introduced to achieve fast and numerically stable simulations of anaerobic digestion processes. ADM1F is compatible with an iPython interface to facilitate model configuration, simulation, data analysis, and visualization. Faster simulations and more stable results are accomplished by implementing an advanced open‐source library of numerical methods called Portable Extensive Toolkit for Scientific Computation (PETSc) to solve the ADM1 system of equations. Leveraging PETSc, ADM1F can consistently complete a steady‐state simulation under 0.2 s, over 99% faster than a benchmark ADM1 model implemented with MATLAB while achieving agreement of model outputs within 1% of those obtained with the benchmark model. For dynamic simulations, however, ADM1F has a computational speed advantage only when the influent characteristics update more frequently than every 4 h. The ability of ADM1F to be useful as a tool to study anaerobic digestion systems is demonstrated through two example implementations of ADM1F: (1) a two‐phase co‐digestion scenario evaluating the impact of the organic loading rate and the substrate composition on reactor performance and stability, and (2) a conventional digester scenario assessing the effectiveness of recovery strategies after disruptions that led to instability. These examples demonstrate how the high simulation speed and the convenience of the iPython interface allow ADM1F to complete complex analyses within minutes, much faster than computational strategies currently reported in the literature.

anaerobic co-digestion↗

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges, requiring efficient hardware acceleration. Benchmarking the performance of LLMs across diverse hardware platforms is crucial to understanding their scalability and throughput characteristics. We introduce LLM-Inference-Bench, a comprehensive benchmarking suite to evaluate the hardware inference performance of LLMs. We thoroughly analyze diverse hardware platforms, including GPUs from Nvidia and AMD and specialized AI accelerators, Intel Habana and SambaNova. Our evaluation includes several LLM inference frameworks and models from LLaMA, Mistral, and Qwen families with 7B and 70B parameters. Our benchmarking results reveal the strengths and limitations of various models, hardware platforms, and inference frameworks. We provide an interactive dashboard to help identify configurations for optimal performance for a given hardware platform.

Chitty-Venkata, Krishna Teja↗