Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

An Introduction to the Benchmarking and Publications for Non-Targeted Analysis Working Group

Non-targeted analysis (NTA) encompasses a rapidly evolving set of mass spectrometry techniques aimed at characterizing the chemical composition of complex samples, identifying unknown compounds, and/or classifying samples, without prior knowledge regarding the chemical content of the samples. Recent advances in NTA are the result of improved and more accessible instrumentation for data generation, and analysis tools for data evaluation and interpretation. As researchers continue to develop NTA approaches in various scientific fields, there is a growing need to identify, disseminate, and adopt community-wide method reporting guidelines. In 2018, NTA researchers formed the Benchmarking and Publications for Non-Targeted Analysis Working Group (BP4NTA) to address this need. Consisting of participants from around the world and representing fields ranging from environmental science and food chemistry to ‘omics and toxicology, BP4NTA provides resources addressing a variety of challenges associated with NTA. Furthermore, thus far, BP4NTA group members have aimed to establish consensus on NTA-related terms and concepts, and to create consistency in reporting practices by providing resources on a public website, including consensus definitions, reference content, and lists of available tools. Moving forward, BP4NTA will provide a setting for NTA researchers to continue discussing emerging challenges and contribute to additional harmonization efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Benchmarking Soft Sensors for Remote Monitoring of On-Site Wastewater Treatment Plants

On-site wastewater treatment plants (OSTs) are usually unattended, so failures often remain undetected and lead to prolonged periods of reduced performance. To stabilize the performance of unattended plants, soft sensors could expose faults and failures to the operator. In a previous study, we developed soft sensors and showed that soft sensors with data from unmaintained physical sensors can be as accurate as soft sensors with data from maintained ones. The monitored variables were pH and dissolved oxygen (DO), and soft sensors were used to predict nitrification performance. In the present study, we use synthetic data and monitor three plants to test these soft sensors. We find that a long solids retention time and a moderate aeration rate improve the pH soft-sensor accuracy and that the aeration regime is the main operational parameter affecting the accuracy of the DO soft sensor. We demonstrate that integrated design of monitoring and control is necessary to achieve robustness when extrapolating from one OST to another in the absence of plant-specific fine-tuning. Additionally, we provide a unique labeled dataset for further feature and data-driven soft-sensor development. Our benchmarking results indicate that it is feasible to monitor OSTs with unmaintained sensors and without plant-specific tuning of the developed soft sensors. This is expected to drastically reduce monitoring costs for OST-based sanitation systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Benchmarking an Embedded Adaptive Sampling Configuration Interaction Method for Surface Reactions: H 2 Desorption from and CH 4 Dissociation on Cu(111)

Embedded (emb-) correlated wavefunction (CW) theory enables accurate assessments of both ground- and excited-state reaction mechanisms involved in heterogeneous catalysis. Embedded multireference second-order perturbation theory (emb-MRPT2) based on reference wavefunctions generated via embedded complete active space self-consistent field (emb-CASSCF) theory is currently state-of-the-art. However, the factorial scaling of CASSCF limits the size of active space and the complexity of systems that can be studied. In this work, we assess the efficacy of an alternative CW method, adaptive sampling configuration interaction (ASCI)–which enables large active spaces to be used–for studying surface reactions. We couple ASCI with density functional embedding theory (DFET) and benchmark its performance for two reactions: H 2 desorption from and CH 4 dissociation on the Cu(111) surface. Unlike embedded complete active space second-order perturbation theory (emb-CASPT2) that accurately reproduces a measured H 2 desorption barrier, embedded ASCI, using a very large active space (though one that still comprises a small portion of the full set of orbitals) fails to do so. Adding an extra correlation term from embedded Møller–Plesset second-order perturbation theory (emb-MP2) improves the desorption barrier and endothermicity predictions. Thus, the inaccuracy of embedded ASCI comes from the missing dynamic correlation from the many other electrons and orbitals not included in the active space. For CH 4 dissociation, again embedded ASCI overestimates the dissociation barrier compared to emb-CASPT2 predictions. Adding dynamic correlation from emb-MP2 helps correct the barrier. However, this composite approach suffers from double counting of correlation within embedded ASCI followed by emb-MP2 calculations. We therefore conclude that the state-of-the-art emb-MRPT2 based on reference wavefunctions generated via emb-CASSCF remains the method of choice for studying surface reactions. emb-ASCI is useful when large active spaces beyond the limit of emb-CASSCF are essential, such as to study complex surface reactions with significant multiconfigurational character (static correlation) but weak dynamic correlation.

08 HYDROGEN↗
DOE OSTI2022

Quadratic Unitary Coupled-Cluster Singles and Doubles Scheme: Efficient Implementation, Benchmark Study, and Formulation of an Extended Version

An efficient implementation of the quadratic unitary coupled-cluster singles and doubles (qUCCSD) scheme for calculations of electronic ground and excited states using an unrestricted molecular spin–orbital formulation and an efficient tensor contraction library is reported. The accuracy of the qUCCSD scheme and the efficiency of the present implementation are demonstrated using extensive benchmark calculations of excitation energies and an application to S o → S 1 vertical excitation energies for cis- and trans-4a,4b-dihydrotriphenylene. The qUCCSD scheme has been shown to provide improved excitation energies compared with the UCC3 scheme formulated based on perturbation theory. Here, a UCC truncation scheme that can provide excitation energies correct through the fourth order is also presented to further improve the accuracy of the qUCCSD scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Importance of Electron Correlation on the Geometry and Electronic Structure of [2Fe–2S] Systems: A Benchmark Study of the [Fe 2 S 2 (SCH 3 ) 4 ] 2–,3–,4– , [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S- p -tol) 4 ] 2– , and [Fe 2 S 2 (S- o -xyl) 4 ] 2– Complexes

Iron–sulfur clusters are crucial for biological electron transport and catalysis. Obtaining accurate geometries, energetics, manifolds of their excited electronic states, and reduction energies is important to understand their role in these processes. Here, using a [2Fe–2S] model complex with Fe II and Fe III oxidation states, which leads to different charges, i.e., [Fe 2 S 2 (SMe) 4 ] 2–,3–,4– , we benchmarked a variety of computational methodologies ranging from density functional theory (DFT) to post-Hartree–Fock methods, including complete active space self-consistent field (CASSCF), multireference configuration interaction, the second-order N-electron valence state perturbation theory (NEVPT2), and the linearized integrand approximation of adiabatic connection (AC0) approaches. Additionally, we studied three experimentally well-characterized complexes, [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S-o-tol) 4 ] 2– , and [Fe 2 S 2 (S-o-xyl) 4 ] 2– , via DFT methods. We conclude that the dynamic electron correlation is important for accurately predicting the geometry of these complexes. Broken symmetry (BS) DFT correctly predicts experimental geometries of low-spin multiplicity, while CASSCF does not. However, BS-DFT significantly overestimates the difference between the low- and high-spin electronic states for a given oxidation state. At the same time, CASSCF underestimates it but provides relative energies closer to the reference NEVPT2 results. Finally, AC0 provides energetics of NEVPT2 quality with the additional advantage of being able to use large CASSCF sizes. NEVPT2 gives the best estimates of the Fe III /Fe III → Fe II /Fe III (4.27 eV) and Fe II /F III → Fe II /F II (7.72 eV) reduction energies. The results provide insight into the electronic structure of these complexes and assist in the understanding of their physical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

Benchmark Calculations of Energetic Properties of Groups 4 and 6 Transition Metal Oxide Nanoclusters Including Comparison to Density Functional Theory

The heats of formation and the normalized clustering energies (NCEs) for the group 4 and group 6 transition metal oxide (TMO) trimers and tetramers have been calculated by the Feller-Peterson-Dixon (FPD) method. The heats of formation predicted by the FPD method do not differ much from those previously derived from the NCEs at the CCSD(T)/aT level except for the CrO3 nanoclusters. New and improved heats of formation for Cr3O9 and Cr4O12 were obtained using PW91 orbitals instead of Hartree-Fock (HF) orbitals. Diffuse functions are necessary to predict accurate heats of formation. The fluoride affinities (FAs) are calculated with the CCSD(T) method. The relative energies (REs) of different isomers, NCEs, electron affinities (EAs), and FAs of (MO2)n ( M = Ti, Zr, Hf, n = 1 – 4 ) and (MO3)n ( M = Cr, Mo, W, n = 1 – 3) clusters have been benchmarked with 55 exchange-correlation DFT functionals including both pure and hybrid types. The absolute errors of the DFT results are mostly less than ±10 kcal/mol for the NCEs and the EAs, and less than ±15 kcal/mol for the FAs. Hybrid functionals usually perform better than the pure functionals for the REs and NCEs. The performance of the two types of functionals in predicting EAs and FAs is comparable. The B1B95 and PBE1PBE functionals provide reliable energetic properties for most isomers. Long range corrected pure functionals usually give poor FAs. The standard deviation of the absolute error is always close to the mean errors and the probability distributions of the DFT errors are often not Gaussian (normal). The breadth of the distribution of errors and the maximum probability are dependent on the energy property and the isomer.

Environmental Molecular Sciences Laboratory↗
DOE OSTI2017

Bond Dissociation Energies for Diatomic Molecules Containing 3d Transition Metals: Benchmark Scalar-Relativistic Coupled-Cluster Calculations for 20 Molecules

Benchmark scalar-relativistic coupled-cluster calculations for dissociation energies of the 20 diatomic molecules containing 3d transition metals in the 3dMLBE20 database ( J. Chem. Theory Comput. 2015, 11, 2036) are reported in this paper. Electron correlation and basis set effects are systematically studied. The agreement between theory and experiment is in general satisfactory. For a subset of 16 molecules, the standard deviation between computational and experimental values is 9 kJ/mol with the maximum deviation being 15 kJ/mol. The discrepancies between theory and experiment remain substantial (more than 20 kJ/mol) for VH, CrH, CoH, and FeH. To explore the source of the latter discrepancies, the analysis used to determine the experimental dissociation energies for VH and CrH is revisited. It is shown that, if improved values are used for the heterolytic C–H dissociation energies of di- and trimethylamine involved in the experimental determination, the experimental values for the dissociation energies of VH and CrH are increased by 18 kJ/mol, such that D 0 (VH) = 223 ± 7 kJ/mol and D 0 (CrH) = 204 ± 7 kJ/mol (or D e (VH) = 233 ± 7 kJ/mol and D e (CrH) = 214 ± 7 kJ/mol). Finally, the new experimental values agree quite well with the calculated values, showing the consistency of the computation and the measured reaction thresholds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Parametrization and Benchmark of Long-Range Corrected DFTB2 for Organic Molecules

In this paper, we present the parametrization and benchmark of long-range corrected second-order density functional tight binding (DFTB), LC-DFTB2, for organic and biological molecules. The LC-DFTB2 model not only improves fundamental orbital energy gaps but also ameliorates the DFT self-interaction error and overpolarization problem, and further improves charge-transfer excited states significantly. Electronic parameters for the construction of the DFTB2 Hamiltonian as well as repulsive potentials were optimized for molecules containing C, H, N, and O chemical elements. We use a semiautomatic parametrization scheme based on a genetic algorithm. With the new parameters, LC-DFTB2 describes geometries and vibrational frequencies of organic molecules similarly well as third-order DFTB3/3OB, the de facto standard parametrization based on a GGA functional. Finally, LC-DFTB2 performs well also for atomization and reaction energies, however, slightly less satisfactorily than DFTB3/3OB.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Spin–Orbit Coupling via Four-Component Multireference Methods: Benchmarking on p-Block Elements and Tentative Recommendations

Within current electronic structure theory methods, fully relativistic four-component (4c) approaches based on the Dirac Hamiltonian treat spin–orbit coupling with the most rigor. The spin treatment arises naturally from the formulation and does not need to be included ad hoc. Spin–orbit splittings can provide insightful benchmark criteria for the assessment of 4c methods; however, there have not been extensive studies in this respect. Spin–orbit splittings of the p-block elements B–I were computed using the 4c-CASSCF, 4c-CASPT2, and 4c-MR-CISD+Q methods, as recently implemented in BAGEL, with uncontracted Dunning basis sets. Comparison with experiment reveals that the four-component methods yield good results, with most of the computed splittings falling within 15% of the experimental values. A large basis set is needed to obtain accurate splittings of the light elements B–F, while splittings of heavier elements show little basis dependence. The 4c-MR-CISD+Q method gave the best splittings for light elements, while 4c-CASSCF showed the best splittings for elements beyond fluorine. In conclusion, the 4c-CASPT2 method gave the best splittings for group 13 atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Benchmarks and Reliable DFT Results for Spin Gaps of Small Ligand Fe(II) Complexes

Here, all-electron fixed-node diffusion Monte Carlo provides benchmark spin gaps for four Fe(II) octahedral complexes. Standard quantum chemical methods (semilocal DFT and CCSD(T)) fail badly for the energy difference between their high- and low-spin states. Density-corrected DFT is both significantly more accurate and reliable and yields a consistent prediction for the Fe-Porphyrin complex

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

How Accurate Is Density Functional Theory at Predicting Dipole Moments? An Assessment Using a New Database of 200 Benchmark Values

We present that dipole moments are a simple, global measure of the accuracy of the electron density of a polar molecule. Dipole moments also affect the interactions of a molecule with other molecules as well as electric fields. To directly assess the accuracy of modern density functionals for calculating dipole moments, we have developed a database of 200 benchmark dipole moments, using coupled cluster theory through triple excitations, extrapolated to the complete basis set limit. This new database is used to assess the performance of 88 popular or recently developed density functionals. The results suggest that double hybrid functionals perform the best, yielding dipole moments within about 3.6-4.5% regularized RMS error versus the reference values - which is not very different from the 4% regularized RMS error produced by coupled cluster singles and doubles. Many hybrid functionals also perform quite well, generating regularized RMS errors in the 5-6% range. Lastly, some functionals, however, exhibit large outliers, and local functionals in general perform less well than hybrids or double hybrids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Atomic Orbital Implementation of Extended Symmetry-Adapted Perturbation Theory (XSAPT) and Benchmark Calculations for Large Supramolecular Complexes

We report an implementation of extended symmetry-adapted perturbation theory (XSAPT) in the atomic orbital basis, extending this method to systems where the monomers are large. In our “XSAPT(KS)” approach, monomers are described using range-separated Kohn–Sham (KS) density functional theory (DFT), with correct asymptotic behavior set by tuning the range-separation parameter ω in a monomer-specific way. This is accomplished either by conventional ionization potential (IP)-based tuning, in which ω is adjusted to satisfy the condition ε HOMO (ω) = -IP(ω), or else using a “global density-dependent” (GDD) condition, in which ω is fixed based on the size of the exchange hole. The latter procedure affords better results for both total interaction energies and energy components, when used in conjunction with our third-generation pairwise atom–atom dispersion potential (+aiD 3 ). Three-body (triatomic) dispersion terms are found to be important when the monomers are large, and we incorporate these by means of an Axilrod–Teller–Muto term, E disp,3B ATM , which reduces errors in supramolecular interaction energies by about a factor of 2. The XSAPT(KS) + aiD 3 + E disp,3B ATM (ωGDD) approach affords mean absolute errors as low as 1.2 and 4.2 kcal/mol, respectively, for the L7 and S12L benchmark test sets of large dimers. Such errors are comparable to those afforded by far more expensive methods, such as DFT-SAPT, and the closely related second-order perturbation theory with coupled dispersion (MP2C). We also survey the performance of various other quantum-chemical methods for these data sets and identify several semiempirical and DFT-based approaches whose accuracy approaches that of MP2C, at dramatically reduced cost.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Benchmarking the Performance of the ReaxFF Reactive Force Field on Hydrogen Combustion Systems

A thorough understanding of the kinetics and dynamics of combusting mixtures is of considerable interest, especially in regimes beyond the reach of current experimental validation. The ReaxFF reactive force field method has provided a way to simulate large-scale systems of hydrogen combustion via a parametrized potential that can simulate bond breaking. This modeling approach has been applied to hydrogen combustion, as well as myriad other reactive chemical systems. In this work, we benchmark the performance of several common parametrizations of this potential against higher-level quantum mechanical (QM) approaches. We demonstrate instances where these parametrizations of the ReaxFF potential fail both quantitatively and qualitatively to describe reactive events relevant for hydrogen combustion systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Quantum Simulation of Molecular Dynamics Processes─A Benchmark Study Using a Classical Simulator and Present-Day Quantum Hardware

Here, we explore how the fundamental problems in quantum molecular dynamics can be modeled using classical simulators (emulators) of quantum computers and the actual quantum hardware available to us today. The list of problems we tackle includes propagation of a free wave packet, vibration of a harmonic oscillator, and tunneling through a barrier. Each of these problems starts with the initial wave packet setup. Although Qiskit provides a general method for initializing wave functions, in most cases it generates deep quantum circuits. While these circuits perform well on noiseless simulators, they suffer from excessive noise on quantum hardware. To overcome this issue, we designed a shallower quantum circuit for preparing a Gaussian-like initial wave packet, which improves the performance of real hardware. Next, quantum circuits are implemented to apply the kinetic and potential energy operators for the evolution of a wave function over time. The results of our modeling on classical emulators of quantum hardware agree perfectly with the results obtained using the traditional (classical) methods. This serves as a benchmark and demonstrates that the quantum algorithms and Qiskit codes we developed are accurate. However, the results obtained on the actual quantum hardware available today, such as IBM’s superconducting qubits and IonQ’s trapped ions, indicate large discrepancies due to hardware limitations. This work highlights both the potential and challenges of using quantum computers to solve fundamental quantum molecular dynamics problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Benchmarking DFT Accuracy in Predicting O 1s Binding Energies on Metals

X-ray photoelectron spectroscopy (XPS) is a powerful tool for probing the electronic structure and composition of materials, particularly metals and metal oxides of relevance to solar cells and catalysis. Density functional theory (DFT) is often used to support XPS peak assignments, but its reliability for predicting oxygen species is not well established. Here, we compile a large data set of experimental oxygen binding energies and evaluate corresponding DFT predictions. We find that as the binding energies of metal-bound atomic oxygen species increase, especially above ≈530 eV, there is a general decrease in the accuracy of DFTpredicted values. Thus, high-binding-energy atomic oxygen species, such as those proposed as active for selective Ag-catalyzed epoxidation, are less well represented. The chemical nature of the oxygen species also influences accuracy, with molecularly bound species more reliably captured across the entire range of energies. These findings illustrate the limitations of DFT for interpreting XPS spectra and provide a benchmark for improving computational methods.

Adsorption↗
DOE OSTI2025

Quantum Monte Carlo Benchmarking of Molecular Adsorption on Graphene-Supported Single Pt Atom

The precise understanding of adsorption energetics and molecular geometry at catalytic sites is fundamental for advancing catalysis, particularly under the constraints of resource efficiency and environmental sustainability. Here, this study benchmarks the performance of density functional theory (DFT) calculations against diffusion Monte Carlo (DMC) calculations for adsorption properties of small gas molecules relevant to CO oxidation—namely O 2 , CO, CO 2 , and atomic oxygen—on a single Pt atom supported by pristine graphene. Our findings reveal that DMC calculations provide a significantly different landscape of adsorption energetics compared to DFT results. Notably, DFT predicts different lowest-energy configurations and spin states, particularly for O 2 , which suggests potential discrepancies in predicting the catalytic behavior. Furthermore, this study identifies the critical issue of CO poisoning, highlighted by the large disparity between the DMC adsorption energies of O 2 (−1.23(2) eV) and CO (−3.37(1) eV), which can inhibit the catalytic process. These results emphasize the necessity for more sophisticated computational approaches in catalysis research, aiming to refine the prediction accuracy of reaction mechanisms and to enhance the design of more effective catalysts.

Ahn, Jeonghwan [University of Illinois at Urbana-C↗
DOE OSTI2025

Benchmarking Density Functional Theory Methods for Efficient Calculations of a Strongly Correlated Li 1– x Ni 1– y O 2−δ System

Transition metal oxides (TMOs), such as LiNiO 2 , are promising candidates for energy storage and electronic devices due to their unique electronic properties, exceptional physical and chemical characteristics, and ability to adopt multiple oxidation states. However, accurately predicting their properties using mean-field density functional theory (DFT) is challenging due to the presence of strongly correlated d-electrons and the complex interplay between their structural, electronic, and magnetic responses. These challenges are further exacerbated by the need to model defects, surfaces, and interfaces, which require computationally efficient, large-scale simulations. To address these issues, we carry out a benchmark study on the Li 1–x NiO 2 system, evaluating the performance of several popular functionals. Our findings demonstrate that combining SCAN functional relaxation with single-step HSE calculations provides a practical and scalable computational strategy. This approach balances accuracy and efficiency, enabling high-throughput simulations of strongly correlated TMOs and improved predictive modeling capability of TMOs for practical applications.

25 ENERGY STORAGE↗
DOE OSTI2019

Beyond Static Benchmarking: Using Experimental Manipulations to Evaluate Land Model Assumptions

Land models are often used to simulate terrestrial responses to future environmental changes, but these models are not commonly evaluated with data from experimental manipulations. Results from experimental manipulations can identify and evaluate model assumptions that are consistent with appropriate ecosystem responses to future environmental change. We conducted simulations using three coupled carbon-nitrogen versions of the Community Land Model (CLM, versions 4, 4.5, and—the newly developed—5), and compared the simulated response to nitrogen (N) and atmospheric carbon dioxide (CO 2 ) enrichment with meta-analyses of observations from similar experimental manipulations. In control simulations, successive versions of CLM showed a poleward increase in gross primary productivity and an overall bias reduction, compared to FLUXNET-MTE observations. Simulations with N and CO 2 enrichment demonstrate that CLM transitioned from a model that exhibited strong nitrogen limitation of the terrestrial carbon cycle (CLM4) to a model that showed greater responsiveness to elevated concentrations of CO 2 in the atmosphere (CLM5). Overall, CLM5 simulations showed better agreement with observed ecosystem responses to experimental N and CO 2 enrichment than previous versions of the model. These simulations also exposed shortcomings in structural assumptions and parameterizations. Specifically, no version of CLM captures changes in plant physiology, allocation, and nutrient uptake that are likely important aspects of terrestrial ecosystems' responses to environmental change. These highlight priority areas that should be addressed in future model developments. Moving forward, incorporating results from experimental manipulations into model benchmarking tools that are used to evaluate model performance will help increase confidence in terrestrial carbon cycle projections.

54 ENVIRONMENTAL SCIENCES↗