Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

A wind energy benchmark for ABL modelling of a diurnal cycle with a nocturnal low-level jet: GABLS3 revisited

The third GEWEX Atmospheric Boundary Layer Studies (GABLS3) model intercomparison study, around the Cabauw met tower in the Netherlands, is revisited as a benchmark for wind energy atmospheric boundary layer (ABL) models. The case was originally developed by the boundary layer meteorology community, interested in analysing the performance of single-column and large-eddy simulation atmospheric models dealing with a diurnal cycle leading to the development of a nocturnal low-level jet. The case addresses fundamental questions related to the definition of the large-scale forcing, the interaction of the ABL with the surface and the evaluation of model results with observations. The characterization of mesoscale forcing for asynchronous microscale modelling of the ABL is discussed based on momentum budget analysis of WRF simulations. Then a single-column model is used to demonstrate the added value of incorporating different forcing mechanisms in microscale models. The simulations are evaluated in terms of wind energy quantities of interest.

17 WIND ENERGY↗
DOE OSTI2024

Benchmarking machine learning interatomic potentials via phonon anharmonicity

Abstract Machine learning approaches have recently emerged as powerful tools to probe structure-property relationships in crystals and molecules. Specifically, machine learning interatomic potentials (MLIPs) can accurately reproduce first-principles data at a cost similar to that of conventional interatomic potential approaches. While MLIPs have been extensively tested across various classes of materials and molecules, a clear characterization of the anharmonic terms encoded in the MLIPs is lacking. Here, we benchmark popular MLIPs using the anharmonic vibrational Hamiltonian of ThO 2 in the fluorite crystal structure, which was constructed from density functional theory (DFT) using our highly accurate and efficient irreducible derivative methods. The anharmonic Hamiltonian was used to generate molecular dynamics (MD) trajectories, which were used to train three classes of MLIPs: Gaussian approximation potentials, artificial neural networks (ANN), and graph neural networks (GNN). The results were assessed by directly comparing phonons and their interactions, as well as phonon linewidths, phonon lineshifts, and thermal conductivity. The models were also trained on a DFT MD dataset, demonstrating good agreement up to fifth-order for the ANN and GNN. Our analysis demonstrates that MLIPs have great potential for accurately characterizing anharmonicity in materials systems at a fraction of the cost of conventional first principles-based approaches.

interatomic potentials↗
DOE OSTI2025

Benchmarking universal machine learning interatomic potentials for rapid analysis of inelastic neutron scattering data

The accurate calculation of phonons and vibrational spectra remains a significant challenge, requiring highly precise evaluations of interatomic forces. Traditional methods based on the quantum description of the electronic structure, while widely used, are computationally expensive and demand substantial expertise. Emerging universal machine learning interatomic potentials (uMLIPs) offer a transformative alternative by employing pre-trained neural network surrogates to predict interatomic forces directly from atomic coordinates. This approach dramatically reduces computation time and minimizes the need for technical knowledge. In this paper, we produce a phonon database comprising nearly 5000 inorganic crystals to benchmark the performance of several leading uMLIPs. We further assess these models in real-world applications by using them to analyze experimental inelastic neutron scattering data collected on a variety of materials. Through detailed comparisons, we identify the strengths and limitations of these uMLIPs, providing insights into their accuracy and suitability for fast calculations of phonons and related properties, as well as the potential for real-time interpretation of neutron scattering spectra. Our findings highlight how the rapid advancement of AI in science is revolutionizing experimental research and data analysis.

inelastic neutron scattering↗
DOE OSTI2026

EC-Bench: A Benchmark for Enzyme Commission Number Prediction

Enzymes are proteins that catalyze specific biochemical reactions in cells. Enzyme Commission (EC) numbers are used to annotate enzymes in a four-level hierarchy that classifies enzymes based on the specific chemical reactions they catalyze. Accurate EC number prediction is essential for understanding enzyme functions. Despite the availability of numerous methods for predicting EC numbers from protein sequences, there is no unified framework for evaluating and studying such methods systematically. This gap limits the ability of the community to identify the most effective approaches for enzyme annotation. We introduce EC-Bench, a benchmark for EC number prediction, consisting of 1) an initial representative set of existing methods (including homology-based, deep learning, contrastive learning, and language model methods), 2) existing and novel accuracy and efficiency performance metrics, and 3) selected datasets to allow for comprehensive comparative study. EC-Bench is open-source and provides a framework for researchers to not only compare among existing methods objectively under uniform conditions, but also to introduce and effectively evaluate performance of new methods in a comparative framework. To demonstrate the utility of EC-Bench, we perform extensive experimentation to compare the existing EC number prediction methods and establish their advantages and disadvantages in a variety of prediction tasks, namely “exact EC number prediction”, “EC number completion” and (partial or additional) “EC number recommendation”. We find wide variation in the performance of different methods, but also subtle but potentially useful differences in the performance of different methods across tasks and for different parts of the EC hierarchy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

First discovery of an ultra-cool white dwarf benchmark in common proper motion with an M dwarf

Ultra-cool white dwarfs are among the oldest stellar remnants in the Universe. Their efficient gravitational settling and low effective temperatures are responsible for the smooth spectra they exhibit. For that reason, it is not possible to derive their radial velocities or to find the chemistry of the progenitors. The best that can be done is to infer such properties from associated sources, which are coeval. The simplest form of such a system is a common proper motion pair where one star is an evolved degenerate and the other a main-sequence star. Herein, we present the discovery of the first of such a system, the M dwarf LHS 6328 and the ultra-cool white dwarf PSO J1801+625, from the Pan-STARRS 1 3π survey and the Gaia Data Release 2. Follow-up spectra were collected covering a usable wavelength range of 3750–24 500 Å. Their spectra show that the white dwarf has an effective temperature of 3550 K and surface gravity of log $g$ = 7.45 ± 0.13 or log $g$ = 7.49 ± 0.13 for a CO or He core, respectively, when compared against synthetic spectra of ultra-cool white dwarf atmosphere models. The system has slightly subsolar metallicity with -0.25 < [Fe/H] < 0.0, and a spatial velocity of (U, V, W) = (-114.26 ± 0.24, 222.94 ± 0.60, 10.25 ± 0.34) km s -1 , the first radial velocity and metallicity measurements of an ultra-cool white dwarf. This makes it the first and only benchmark of its kind to date.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Primeval very low-mass stars and brown dwarfs – VIII. The first age benchmark L subdwarf, a wide companion to a halo white dwarf

ABSTRACT We report the discovery of five white dwarf + ultracool dwarf systems identified as common proper motion wide binaries in the Gaia Catalogue of Nearby Stars. The discoveries include a white dwarf + L subdwarf binary, VVV 1256−62AB, a gravitationally bound system located 75.6$^{+1.9}_{-1.8}$ pc away with a projected separation of 1375$^{+35}_{-33}$ au. The primary is a cool DC white dwarf with a hydrogen dominated atmosphere, and has a total age of $10.5^{+3.3}_{-2.1}$ Gyr, based on white dwarf model fitting. The secondary is an L subdwarf with a metallicity of [M/H] = $-0.72^{+0.08}_{-0.10}$ (i.e. [Fe/H] = $-0.81\pm 0.10$) and $T_{\rm eff}$ = 2298$^{+45}_{-43}$ K based on atmospheric model fitting of its optical to near infrared spectrum, and likely has a mass just above the stellar/substellar boundary. The subsolar metallicity of the L subdwarf and the system’s total space velocity of 406 km s−1 indicates membership in the Galactic halo, and it has a flat eccentric Galactic orbit passing within 1 kpc of the centre of the Milky Way every $\sim$0.4 Gyr and extending to 15–31 kpc at apogal. VVV 1256−62B is the first L subdwarf to have a well-constrained age, making it an ideal benchmark of metal-poor ultracool dwarf atmospheres and evolution.

Zhang, Z. H. (ORCID:000000033047607X)↗
DOE OSTI2025

Benchmark of the Fe xvv 𝓡 ratio in photoionized plasma during eclipse of Centaurus X-3 with XRISM/Resolve

The $\mathcal {R}$ ratio is a useful diagnostic of the X-ray emitting astrophysical plasmas and is defined as the intensity ratio of the forbidden over the inter-combination lines in the K$\alpha$ line complex of He-like ions. The value is altered by excitation processes (electron impact or UV photoexcitation) from the metastable upper level of the forbidden line, thereby constraining the electron density or UV field intensity. The diagnostic has been applied mostly in electron density constraints in collisionally ionized plasmas using low-Z elements, as was originally proposed for the Sun (Gabriel & Jordan, 1969a, MNRAS, 145, 241), but it can also be used in photoionized plasmas. To make use of this diagnostic, we need to know its value in the limit of no excitation of metastables ($\mathcal {R}_{0}$), which depends on the element, how the plasmas are formed, how the lines are propagated, and the spectral resolution affecting line blending principally with satellite lines from Li-like ions. We benchmark $\mathcal {R}_0$ for photoionized plasmas by comparing calculations using radiative transfer codes and observation data taken with the Resolve X-ray microcalorimeter onboard XRISM. We use the Fe xxv He$\alpha$ line complex of the photo-ionized plasma in Centaurus X-3 observed during eclipse, in which the plasma is expected to be in the limit of no metastable excitation. The measured $\mathcal {R} = 0.65 \pm 0.08$ is consistent with the value calculated using xstar for the plasma parameters derived from other line ratios of the spectrum. We conclude that the $\mathcal {R}$ ratio diagnostic can be used for high-Z elements such as Fe in photoionized plasmas, which has wide applications in plasmas around compact objects at various scales.

X-rays: binaries↗
DOE OSTI2021

Benchmarking near-term quantum devices with the variational quantum eigensolver and the Lipkin-Meshkov-Glick model

The variational quantum eigensolver is a promising algorithm for noisy intermediate scale quantum (NISQ) computation. Verification and validation of NISQ algorithms' performance on NISQ devices is an important task. Here, we consider the exactly diagonalizable Lipkin-Meshkov-Glick (LMG) model as a candidate for benchmarking NISQ computers. We use the Bethe Ansatz to construct eigenstates of the trigonometric LMG model using quantum circuits inspired by the LMG's underlying algebraic structure. We construct circuits with depth $\mathcal{O}$(N) and $\mathcal{O}$(log 2 N) that can prepare any trigonometric LMG eigenstate of N particles. The number of gates required for both circuits is $\mathcal{O}$(N). The energies of the eigenstates can then be measured and compared to the exactly known answers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2011

Comparing, optimizing, and benchmarking quantum-control algorithms in a unifying programming framework

For paving the way to novel applications in quantum simulation, computation, and technology, increasingly large quantum systems have to be steered with high precision. It is a typical task amenable to numerical optimal control to turn the time course of pulses, i.e., piecewise constant control amplitudes, iteratively into an optimized shape. Here, we present a comparative study of optimal-control algorithms for a wide range of finite-dimensional applications. We focus on the most commonly used algorithms: GRAPE methods which update all controls concurrently, and Krotov-type methods which do so sequentially. Guidelines for their use are given and open research questions are pointed out. Moreover, we introduce a unifying algorithmic framework, DYNAMO (dynamic optimization platform), designed to provide the quantum-technology community with a convenient matlab-based tool set for optimal control. In addition, it gives researchers in optimal-control techniques a framework for benchmarking and comparing newly proposed algorithms with the state of the art. It allows a mix-and-match approach with various types of gradients, update and step-size methods as well as subspace choices. Open-source code including examples is made available at http://qlib.info.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Time-of-flight electron scattering from molecular hydrogen: Benchmark cross sections for excitation of the X 1 Σ g + → b 3 Σ u + transition

The electron impact X 1 Σ g + → b 3 Σ u + transition in molecular hydrogen is one of the most important dissociation pathways to forming atomic hydrogen atoms, and is of great importance in modeling astrophysical and industrial plasmas where molecular hydrogen is a substantial constituent. Recently, it has been found that the convergent close-coupling (CCC) cross sections of Zammit et al. [Phys. Rev. A 95, 022708 (2017)] are up to a factor of 2 smaller than the currently recommended data. Here, we have determined normalized differential cross sections for excitation of this transition from our experimental ratios of the inelastic to elastic scattering of electrons by molecular hydrogen using a transmission-free time-of-flight electron spectrometer, and find excellent agreement with the CCC calculations. Since there is already excellent agreement for the absolute elastic differential cross sections, we establish benchmark differential and integrated cross sections for the X 1 Σ g + → b 3 Σ u + transition, with theory and experiment being essentially in complete agreement.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2019

Generative model benchmarks for superconducting qubits

In this paper we demonstrate experimentally how generative model training can be used as a benchmark for small (fewer than five qubits) quantum devices. Performance is quantified using three data analytic metrics: the Kullback-Leibler divergence and two adaptations of the F 1 score. Using the 2×2 bars and stripes data set, we train several different circuit constructions for generative modeling with superconducting qubits. By taking hardware connectivity constraints into consideration, we show that sparsely connected shallow circuits outperform denser counterparts on noisy hardware.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2014

Benchmarking exchange-correlation functionals for hydrogen at high pressures using quantum Monte Carlo

The ab initio phase diagram of dense hydrogen is very sensitive to errors in the treatment of electronic correlation. Recently, it has been shown that the choice of the density functional has a large effect on the predicted location of both the liquid-liquid phase transition and the solid insulator-to-metal transition in dense hydrogen. To identify the most accurate functional for dense hydrogen applications, we systematically benchmark some of the most commonly used functionals using quantum Monte Carlo. By considering several measures of functional accuracy, we conclude that the van der Waals and hybrid functionals significantly outperform local density approximation and Perdew-Burke-Ernzerhof. We support these conclusions by analyzing the impact of functional choice on structural optimization in the molecular solid, and on the location of the liquid-liquid phase transition.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2016

Benchmark study of the two-dimensional Hubbard model with auxiliary-field quantum Monte Carlo method

Ground-state properties of the Hubbard model on a two-dimensional square lattice are studied by the auxiliary-field quantum Monte Carlo method. Accurate results for energy, double occupancy, effective hopping, magnetization, and momentum distribution are calculated for interaction strengths of U/t from 2 to 8, for a range of densities including half-filling and n = 0.3,0.5,0.6, 0.75, and 0.875. At half-filling, the results are numerically exact. Away from half-filling, the constrained path Monte Carlo method is employed to control the sign problem. Our results are obtained with several advances in the computational algorithm, which are described in this paper in detail. We discuss the advantages of generalized Hartree-Fock trial wave functions and its connection to pairing wave functions, as well as the interplay with different forms of Hubbard-Stratonovich decompositions. We study the use of different twist angle sets when applying the twist averaged boundary conditions. We propose the use of quasirandom sequences, which improves the convergence to the thermodynamic limit over pseudorandom and other sequences. With it and a careful finite size scaling analysis, we are able to obtain accurate values of ground-state properties in the thermodynamic limit. Detailed results for finite-sized systems up to 16 × 16 are also provided for benchmark purposes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Benchmarking the extraction of statistical neutron capture cross sections on short-lived nuclei for applications using the β -Oslo method

Numerous scientific fields including astrophysics, nuclear power, and nuclear forensics require a knowledge of basic nuclear properties for large numbers of short-lived, radioactive isotopes far removed from stable nuclei. Neutron-capture cross sections are one such piece of nuclear data where direct measurements are not possible and theoretical predictions can vary by orders of magnitude. A recently developed indirect technique for inferring neutron capture rates, the β-Oslo method, has been introduced but not compared against a known, directly measured neutron capture cross section. To provide this benchmark, two indirect methods based on β decay and charged-particle reactions were used to extract the nuclear level density and γ-ray strength function of 51 Ti. The nuclear level density and γ-ray strength function from the two data sets were found to be equivalent and were used to extract the neutron capture cross section of 50 Ti which agrees with previous direct measurements at high neutron energies. Here, the results demonstrate the validity of the β-Oslo method for extracting neutron capture cross sections of short-lived nuclei and provide a sufficiently small uncertainty to be used in various applications.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Benchmark calculations of pure neutron matter with realistic nucleon-nucleon interactions

Here, we report benchmark calculations of the energy per particle of pure neutron matter as a function of the baryon density using three independent many-body methods: Brueckner–Bethe–Goldstone, Fermi hypernetted chain/single-operator chain, and auxiliary-field diffusion Monte Carlo. Significant technical improvements are implemented in the latter two methods. The calculations are made for two distinct families of realistic coordinate-space nucleon-nucleon potentials fit to scattering data, including the standard Argonne v 18 interaction and two of its simplified versions, and four of the new Norfolk Δ -full chiral effective field theory potentials. Primarily because of the advancements in the auxiliary-field diffusion Monte Carlo, we observe good agreement among the three many-body techniques up to nuclear saturation density—the maximum difference in the energy per particle is within 1.5 MeV for all the potentials we consider. At higher densities, the divergences become more important, and are mainly driven by the Fermi hypernetted chain/single-operator calculations. We also study the connection between nucleon-nucleon scattering data and the energy per particle of pure neutron matter. Our results suggest that fitting to higher-energy nucleon-nucleon scattering helps reduce the spread of energies among the models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Benchmark neutrinoless double- β decay matrix elements in a light nucleus

We compute nuclear matrix elements of neutrinoless double-β decay mediated by light Majorana-neutrino exchange in the $\textit{A}$ = 6 system. The goal for this work is to benchmark two many-body approaches, the no-core shell model and the multireference in-medium similarity renormalization group (SRG). We use a SRG-evolved next-to-next-to-next-to-leading chiral order two-body potential for the nuclear interaction, and make the approximation that the isospin is conserved. We compare the results of the two approaches as a function of the cutoff on the many-body basis space. Although differences are seen in the predicted nuclear radii, the ground-state energies and neutrinoless double-β decay matrix elements produced by the two approaches show significant agreement. We discuss the implications for calculations in heavier nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Lifetime measurements of excited states in neutron-rich 53 Ti: Benchmarking effective shell-model interactions

Level lifetimes of the yrast (5/2 - ) to 13/2 - states in the neutron-rich nucleus 53 Ti, produced in a multinucleon-transfer reaction, have been measured for the first time. The recoil distance Doppler-shift method was employed and lifetimes of the excited states were extracted by a lineshape analysis aided by GEANT4-based Monte-Carlo simulations. The experiment was performed at the Grand Accelerateur National d'Ions Lourds facility in Caen, France, by using the Advanced Gamma Tracking Array for the gamma-ray detection coupled to the large-acceptance variable mode spectrometer for an event-by-event particle identification and the Cologne plunger for deep-inelastic reactions. Reduced transition probabilities, deduced from the lifetimes, give new information on the nuclear structure of 53 Ti, and are used to benchmark different shell-model calculations using established interactions in the fp shell.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Benchmark calculations of infinite neutron matter with realistic two- and three-nucleon potentials

In this study, we present the equation of state of infinite neutron matter as obtained from highly realistic Hamiltonians that include nucleon-nucleon and three-nucleon coordinate-space potentials. We benchmark three independent many-body methods: Brueckner-Bethe-Goldstone (BBG), Fermi hypernetted chain/single-operator chain (FHNC/SOC), and auxiliary-field diffusion Monte Carlo (AFDMC). We find them to provide similar equations of state when the Argonne v 18 and the Argonne v' 6 nucleon-nucleon potentials are used in combination with the Urbana IX three-body force. Only at densities larger than about 1.5 the nuclear saturation density ( ρ 0 =0.16 fm ⁻3 ) the FHNC/SOC energies are appreciably lower than the other two approaches. The AFDMC calculations carried out with all of the Norfolk potentials fitted to reproduce the experimental trinucleon ground-state energies and nd doublet scattering length yield unphysically bound neutron matter, associated with the formation of neutron droplets. Including tritium β decay in the fitting procedure, as in the second family of Norfolk potentials, mitigates but does not completely resolve this problem. An excellent agreement between the BBG and AFDMC results is found for the subset of Norfolk interactions that do not make neutron-matter collapse, while the FHNC/SOC equations of state are moderately softer.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗