Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark Tests”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗
DOE OSTI2020

Evaluation of simulated soil carbon dynamics in Arctic-Boreal ecosystems

Given the magnitude of soil carbon stocks in northern ecosystems, and the vulnerability of these stocks to climate warming, land surface models must accurately represent soil carbon dynamics in these regions. We evaluate soil carbon stocks and turnover rates, and the relationship between soil carbon loss with soil temperature and moisture, from an ensemble of eleven global land surface models. We focus on the region of NASA's Arctic-Boreal vulnerability experiment (ABoVE) in North America to inform data collection and model development efforts. Models exhibit an order of magnitude difference in estimates of current total soil carbon stocks, generally under- or overestimating the size of current soil carbon stocks by greater than 50 PgC. We find that a model's soil carbon stock at steady-state in 1901 is the prime driver of its soil carbon stock a hundred years later—overwhelming the effect of environmental forcing factors like climate. The greatest divergence between modeled and observed soil carbon stocks is in regions dominated by peat and permafrost soils, suggesting that models are failing to capture the frozen soil carbon dynamics of permafrost regions. Using a set of functional benchmarks to test the simulated relationship of soil respiration to both soil temperature and moisture, we find that although models capture the observed shape of the soil moisture response of respiration, almost half of the models examined show temperature sensitivities, or Q10 values, that are half of observed. Significantly, models that perform better against observational constraints of respiration or carbon stock size do not necessarily perform well in terms of their functional response to key climatic factors like changing temperature. This suggests that models may be arriving at the right result, but for the wrong reason. The results of this work can help to bridge the gap between data and models by both pointing to the need to constrain initial carbon pool sizes, as well as highlighting the importance of incorporating functional benchmarks into ongoing, mechanistic modeling activities such as those included in ABoVE.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Progress on the reevaluation and validation of the n+233U neutron cross sections

The set of 233 U resonance parameters of the ENDF/B-VIII.0 nuclear data library was adopted from the previous ENDF/B-VII.1 evaluation using the external levels to update the thermal values. Adoption of IAEA 2017 thermal standards ( σ f = 533.0 ± 2.2 b, σ c = 44.9 ± 0.9 b, and ν ‾ tot = 2.487 ± 0.011 ) and of the IAEA-recommended thermal-neutron induced prompt fission neutron spectrum (PFNS) with average PFNS energy of 2.030 ± 0.013 MeV requires a re-evaluation of 233 U neutron cross sections in the resolved resonance region. A newly produced evaluation is being tested on benchmarks carefully selected from the Handbook of International Criticality Safety Benchmark Experiments (ICSBEP) which are highly sensitive to 233 U data. An important goal of this work was to eliminate the strong negative gradient of the calculated effective multiplication factors with respect to the epithermal fission fraction observed in the validation of the ENDF/B-VIII.0 library for those assemblies. A significant improvement in integral performance of critical 233 U solutions is observed for the newly proposed evaluation. Further work addressing the fast neutron region is needed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

HTR solver: An open-source exascale-oriented task-based multi-GPU high-order code for hypersonic aerothermodynamics

In this study, the open-source Hypersonics Task-based Research (HTR) solver for hypersonic aerothermodynamics is described. The physical formulation of the code includes thermochemical effects induced by high temperatures (vibrational excitation and chemical dissociation). The HTR solver uses high-order TENO-based spatial discretization on structured grids and efficient time integrators for stiff systems, is highly scalable in GPU-based supercomputers as a result of its implementation in the Regent/Legion stack, and is designed for direct numerical simulations of canonical hypersonic flows at high Reynolds numbers. Additionally, the performance of the HTR solver is tested with benchmark cases including inviscid vortex advection, low- and high-speed laminar boundary layers, inviscid one-dimensional compressible flows in shock tubes, supersonic turbulent channel flows, and hypersonic transitional boundary layers of both calorically perfect gases and dissociating air.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

QTRAJ 1.0: A Lindblad equation solver for heavy-quarkonium dynamics

Here we introduce an open-source package called QTraj that solves the Lindblad equation for heavy-quarkonium dynamics using the quantum trajectories algorithm. The package allows users to simulate the suppression of heavy-quarkonium states using externally-supplied input from 3+1D hydrodynamics simulations. The code uses a split-step pseudo-spectral method for updating the wave-function between jumps, which is implemented using the open-source multi-threaded FFTW3 package. This allows one to have manifestly unitary evolution when using real-valued potentials. In this paper, we provide detailed documentation of QTraj 1.0, installation instructions, and present various tests and benchmarks of the code.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Three-dimensional Skyrme Hartree-Fock-Bogoliubov solver in coordinate-space representation

The coordinate-space representation of the Hartree-Fock-Bogoliubov theory is the method of choice to study weakly bound nuclei whose properties are affected by the quasiparticle continuum space. To describe such systems, we developed a three-dimensional Skyrme-Hartree-Fock-Bogoliubov solver HFBFFT based on the existing, highly optimized and parallelized Skyrme-Hartree-Fock code Sky3D. The code does not impose any self-consistent spatial symmetries such as mirror inversions or parity. The underlying equations are solved in HFBFFT directly in the canonical basis using the fast Fourier transform. To remedy the problems with pairing collapse, we implemented the soft energy cutoff and pairing annealing. The convergence of HFB solutions was improved by a sub-iteration method. The Hermiticity violation of differential operators brought by Fourier-transform-based differentiation has also been solved. Furthermore, the accuracy and performance of HFBFFT were tested by benchmarking it against other HFB codes, both spherical and deformed, for a set of nuclei, both well-bound and weakly-bound.

3D coordinate-space representation↗
DOE OSTI2025

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗
DOE OSTI2020

Density Functionals for Hydrogen Storage: Defining the H2Bind275 Test Set with Ab Initio Benchmarks and Assessment of 55 Functionals

Efficient and high-capacity storage materials are indispensable for a hydrogen-based economy. In silico tools can accelerate the process of discovery of new adsorbent materials with optimal hydrogen adsorption enthalpies. Density functional theory is well-poised to become a very useful tool for enabling high-throughput screening of potential materials. In this work, we have identified density functional approximations that provide good performance for hydrogen binding applications following a two-pronged approach. First, we have compiled a data set (H2Bind275) that comprehensively represents the hydrogen binding problem capturing the chemical and mechanistic diversity in the binding sites encountered in hydrogen storage materials. We have also computed reference interaction energies for this data set using coupled-cluster theory. Second, we have assessed the performance of 55 density functional approximations for predicting H 2 interaction energies and have identified two hybrid density functionals (ωB97X-V and ωB97M-V), two double hybrid density functionals (DSD-PBEPBE-D3(BJ) and PBE0-DH), and one semilocal density functional (B97M-V) as the best performing ones. We have recommended the addition of empirical dispersion corrections to systematically underbinding density functionals such as revPBE, BLYP, and B3LYP for improvements in performance at negligible additional cost. We have also recommended the usage of the def2-TZVPP basis set as it represents a good compromise between accuracy and cost, limiting the finite basis set errors to less than 1 kJ/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Solar Thermochemical Redox Cycling Using Ga- and Al-Doped LSM Perovskites for Renewable Hydrogen Production

Solar thermochemical hydrogen production using redox-active metal oxides is a promising pathway for the production of green hydrogen and synthetic fuel precursors. Herein, the perovskite material (La 0.6 Sr 0.4 ) 0.95 Mn 0.8 Ga 0.2 O 3–δ (LSMG6482) is identified as a promising metal oxide for thermochemical water splitting. LSMG6482, along with more-established water splitters ceria and (La 0.6 Sr 0.4 ) 0.95 Mn x Al 1–x O 3–δ (LSMA) perovskites, is experimentally characterized via thermogravimetric (TGA) analysis and high-temperature water splitting in a reactor simulating solar concentrating conditions. TGA analysis demonstrated that LSMG6482 has high and stable oxygen exchange capacity under controlled pO 2 redox cycling, demonstrated by large changes in oxygen nonstoichiometry (δ) relative to ceria. Water splitting experiments using laser heating (T red = 1400 °C, T ox = 1200 °C) resulted in H 2 yields of 165.1 μmol g –1 for the candidate LSMG6482 composition, exceeding that of all benchmark materials tested. Under high conversion oxidation conditions, where H 2 is cointroduced with H 2 O (150 ≤ nH 2 O/nH 2 ≤ 500), H 2 yields were greatest for LSMG6482 and LSMA6482, up to four times that of ceria at the highest nH 2 O/nH 2 conditions. Crystallographic analysis showed that over the course of experimentation, there is some secondary phase growth for all perovskite compositions, except for LSMA6482, but there was no observable degradation in H 2 yields.

08 HYDROGEN↗
DOE OSTI2023

Barrier Heights for Diels–Alder Transition States Leading to Pentacyclic Adducts: A Benchmark Study of Crowded, Strained Transition States of Large Molecules

Theoretical characterization of reactions of complex molecules depends on providing consistent accuracy for the relative energies of intermediates and transition states. Here we employ the DLPNO-CCSD(T) method with core–valence correlation, large basis sets, and extrapolation to the CBS limit to provide benchmark values for Diels–Alder transition states leading to competitive strained pentacyclic adducts. We then used those benchmarks to test a diverse set of wave function and density functional methods for the absolute and relative barrier heights of these transition states. Our results show that only a few of the tested density functionals can predict the absolute barrier heights satisfactorily, although relative barrier heights are more accurate. The most accurate functionals tested are ωB97M-V, M11plus, ωB97X-V, PBE-D3(0), M11, and MN15 with MUDs from best estimates less than 3.0 kcal. Furthermore, these findings can guide selection of density functionals for future studies of crowded, strained transition states of large molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Resolution of Selectivity Steps of CO Reduction Reaction on Copper by Quantum Monte Carlo

Electrochemical reduction of carbon monoxide to valuable fuels and chemicals on copper surfaces remains a challenging area in catalysis due to a limited understanding of adsorption mechanisms and reaction pathways. Although density functional theory (DFT)-based studies have investigated these processes, their accuracy varies across different functionals. Here, in this study, we present the application of fixed-node diffusion Monte Carlo (FNDMC) to benchmark the adsorption energies of CO*, H*, and key CO reduction reaction (CORR) intermediates, COH* and CHO* on the Cu(111) surface. Our results for CO* and H* adsorption energies closely align with experimentally measured chemisorption reactions, highlighting the limitations of DFT and providing site-specific energy comparisons that are often not available experimentally. Additionally, we explore the effect of explicit solvation, demonstrating how water stabilizes the COH* over CHO*, thus suggesting a critical role of COH* in CORR. Finally, we release our high-accuracy FNDMC benchmarks for testing and developing new DFT functionals for electrocatalysis. Overall, this study underscores the potential of FNDMC for detailed surface chemistry studies and offers new insights into catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Design Principles for the Synthesis of Self-Pillared ZSM-5 Zeolite Nanosheets

The design of next-generation materials for emerging energy and environmental applications heavily relies on empirical approaches to direct nonclassical nucleation and crystal growth pathways, polymorphism, intercrystalline transformations, and seed-assisted growth processes. A long-standing obstacle to nanoporous materials design is the complexity of their crystallization, which hinders the development of predictive models and/or physical descriptors that can guide their synthesis. In this study, we use a combination of state-of-the-art synthesis, characterization, and computational design to prepare hierarchical MFI-type zeolites, which we couple with benchmark catalytic testing to assess structure-property-performance relationships. These hierarchical materials are intergrowths of two commercially relevant zeolite frameworks, MFI and MEL, prepared as self-pillared pentasil (SPP) zeolites through seed-assisted, organic-free syntheses for which little theoretical guidance existed. Here, by comparing a large library of zeolite seeds with different pore sizes, dimensions, and structural composite building units, we determined the relative impact of seed and silica source selection, among other synthesis variables. Combined experimental and computational studies are used to test several hypotheses in literature to rationalize the choice of seed structure and establish a more robust selection criteria for seed-assisted synthesis of zeolites. Specifically, we show that a data-driven approach to develop structural descriptors correlates to new, facile routes to rationally design SPP zeolites, addressing knowledge gaps in the fundamental understanding of (non)classical crystal growth mechanisms that are characteristic of nanoporous aluminosilicates.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Comparing Liquid Vortex Capture & the Rapid Droplet Sampling Interface for Single Cell Mass Spectrometry

High-throughput single-cell mass spectrometry is a rapidly evolving field that requires innovative sampling and ionization techniques to balance speed, sensitivity, and reliability for metabolomic and lipidomic analyses. This study provides a comparative analysis of two cutting-edge ionization platforms for single-cell analysis: Liquid Vortex Capture (LVC) and Rapid Droplet Sampling Interface (RDSI). The performance was benchmarked by testing pharmaceuticals, EquiSPLASH, and single-cell experiments. RDSI demonstrated up to 100-fold improvements in sensitivity for drugs and lipids such as propranolol, amiodarone, atorvastatin, and phosphocholines in water and phosphate-buffered solutions. This was attributed to its low-flow rate operation (3 μL/min) and reduced dilution. Conversely, LVC excelled in handling higher liquid volumes with greater reproducibility due to its higher solvent flow rate (200 μL/min), enabling increased dilution, solubility, and cleaning. Single-cell uptake of atorvastatin incubated for 10 min, or amiodarone incubated for 24 h in HepG2 cells, similarly revealed up to 85-fold enhancement in sensitivity by RDSI for drugs and lipids. These findings highlight the potential of RDSI for enhancing sensitivity in single-cell drug monitoring and lipidomics.

Cahill, John [ORNL] (ORCID:0000000298664010)↗
DOE OSTI2026

Overview of the Nephele Perturbed Parameter Ensemble for Aerosol‐Cloud Interactions in E3SMv3

Aerosol-cloud interactions (aci) are the leading source of uncertainty in inferring climate sensitivity from the historical record. Earth system models (ESMs) struggle to represent aci because the processes responsible for these phenomena occur at much finer time and space scales than can be resolved by any ESM. Observational constraints provide key benchmarks to test ESMs, but cannot be used alone to fully understand aci processes except in very specific cases where causality is controlled; some degree of modeling is required to infer aci and estimate radiative forcing. Here, we generate and characterize a perturbed parameter ensemble (PPE) in version 3 of the Energy Exascale ESM (E3SMv3). We perturb 25 parameters that govern aci processes over 250 members and integrate the model over present-day and preindustrial aerosol emissions. We find that the process representation in E3SMv3 is flexible and can generate global-mean effective radiative forcings due to aci (ERFaci) ranging from −3.0 to +0.9 W m −2 . The positive ERFaci values simulated by a portion of the PPE are implausible and result from parameter combinations that produce unrealistic top-of-atmosphere energy fluxes. While global-mean cloud droplet number concentration always increases in response to anthropogenic aerosol, cloud liquid water path can both increase and decrease, suggesting that precipitation suppression is not the only aerosol-cloud adjustment represented by E3SMv3. Analysis of which processes control liquid cloud adjustment in the PPE points toward stratiform precipitation processes and aerosol activation, which is consistent with many previous ESMs, as well as the new two-moment convective cloud microphysics in E3SMv3.

Nugent, Jacqueline M. [Univ. of Wyoming, Laramie, ↗
DOE OSTI2020

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Application of research reactor environments for validation of the IRDFF-II dosimetry cross section library

Activation data from seven different reactor-based reference neutron fields are examined to provide enhanced validation evidence for the newly released IRDFF-II library. A least-squares based spectrum adjustment methodology is used and rigorous statistical metrics demonstrate the consistency of the set of IRDFF-II dosimetry cross sections. The use of these reactor-based neutron fields provides validation evidence for nine more reactions than have been addressed in the 252 Cf(sf) and 235 U(th) benchmark validation testing. The use of covers to shift their energy response increases the power of the response validation but makes it challenging to properly capture response correlations.

Griffin, Patrick↗
DOE OSTI2024

Bond length alternation of π -conjugated polymers predicted by the Fermi–Löwdin orbital self-interaction correction method

π-conjugated polymers have been used in a wide range of practical applications, partly due to their unique properties that originate in the delocalization of electrons through the polymer backbone. The level of delocalization can be characterized by the induced bond length alternation (BLA), with shorter BLA connected with strong delocalization and vice versa. The accurate description of this structural parameter can be considered a benchmark for testing the capability of different electronic structure methods for self-interaction error (SIE) removal and electron correlation inclusion. Density functional theory (DFT), in its local or semi-local flavors, suffers from SIE and, thus, underestimates the BLA compared to self-interaction-free methods. In this work, we utilize the Fermi–Löwdin orbital self-interaction correction (FLOSIC) method for one-electron self-interaction removal to characterize the BLA of five oligomers with increasing length extrapolated to the polymeric limit. We compare the self-interaction-free BLA to several DFT approximations, Møller–Plesset second-order perturbation theory (MP2), and the BLA obtained with the domain based local pair natural orbital CCSD(T) [DLPNO-CCSD(T)] approximation. Our findings show that FLOSIC corrects for the small BLA given by (semi-)local DFT approximations, but it tends to overcorrect with respect to CAM-B3LYP, MP2, and DLPNO-CCSD(T).

Chemistry↗
DOE OSTI2025

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗