Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Benchmark of the Fe xvv 𝓡 ratio in photoionized plasma during eclipse of Centaurus X-3 with XRISM/Resolve

The $\mathcal {R}$ ratio is a useful diagnostic of the X-ray emitting astrophysical plasmas and is defined as the intensity ratio of the forbidden over the inter-combination lines in the K$\alpha$ line complex of He-like ions. The value is altered by excitation processes (electron impact or UV photoexcitation) from the metastable upper level of the forbidden line, thereby constraining the electron density or UV field intensity. The diagnostic has been applied mostly in electron density constraints in collisionally ionized plasmas using low-Z elements, as was originally proposed for the Sun (Gabriel & Jordan, 1969a, MNRAS, 145, 241), but it can also be used in photoionized plasmas. To make use of this diagnostic, we need to know its value in the limit of no excitation of metastables ($\mathcal {R}_{0}$), which depends on the element, how the plasmas are formed, how the lines are propagated, and the spectral resolution affecting line blending principally with satellite lines from Li-like ions. We benchmark $\mathcal {R}_0$ for photoionized plasmas by comparing calculations using radiative transfer codes and observation data taken with the Resolve X-ray microcalorimeter onboard XRISM. We use the Fe xxv He$\alpha$ line complex of the photo-ionized plasma in Centaurus X-3 observed during eclipse, in which the plasma is expected to be in the limit of no metastable excitation. The measured $\mathcal {R} = 0.65 \pm 0.08$ is consistent with the value calculated using xstar for the plasma parameters derived from other line ratios of the spectrum. We conclude that the $\mathcal {R}$ ratio diagnostic can be used for high-Z elements such as Fe in photoionized plasmas, which has wide applications in plasmas around compact objects at various scales.

X-rays: binaries↗
DOE OSTI2025

Generalized Cycle Benchmarking Algorithm for Characterizing Midcircuit Measurements

Midcircuit measurements (MCMs) are crucial ingredients in the development of fault-tolerant quantum computation. While there have been rapid experimental progresses in realizing MCMs, a systematic method for characterizing noisy MCMs is still under exploration. In this work, we develop a cycle benchmarking (CB)-type algorithm to characterize noisy MCMs. The key idea is to use a joint Fourier transform on the classical and quantum registers and then estimate parameters in the Fourier space, analogous to Pauli fidelities used in CB-type algorithms for characterizing the Pauli-noise channel of Clifford gates. Furthermore, we develop a theory of the noise learnability of MCMs, which determines what information can be learned about the noise model (in the presence of state preparation and terminating measurement noise) and what cannot, which shows that all learnable information can be learned using our algorithm. As an application, we show how to use the learned information to test the independence between measurement noise and state-preparation noise in an MCM. Finally, we conduct numerical simulations to illustrate the practical applicability of the algorithm. Similar to other CB-type algorithms, we expect the algorithm to provide a useful toolkit that is of experimental interest. Published by the American Physical Society 2025

Zhang, Zhihan (ORCID:0009000862907691)↗
DOE OSTI2025

Benchmarking and Fidelity Response Theory of High-Fidelity Rydberg Entangling Gates

The fidelity of entangling operations is a key figure of merit in quantum information processing, especially in the context of quantum error correction. High-fidelity entangling gates in neutral atoms have seen remarkable advancement recently. A full understanding of error sources and their respective contributions to gate infidelity will enable the prediction of fundamental limits on quantum gates in neutral atom platforms with realistic experimental constraints. In this work, we implement the time-optimal Rydberg controlled-Z (CZ) gate, design a circuit to benchmark its fidelity, and achieve a fidelity, averaged over symmetric input states, of 0.9971 ( 5 ) , downward corrected for leakage error, which together with our recent work [Nature 634, 321–327 (2024)] forms a new state of the art for neutral atoms. The remaining infidelity is explained by an error model, consistent with our experimental results over a range of gate speeds, with varying contributions from different error sources. Further, we develop a fidelity response theory to efficiently predict infidelity from laser noise with nontrivial power spectral densities and derive scaling laws of infidelity with gate speed. Besides its capability of predicting gate fidelity, we also utilize the fidelity response theory to compare and optimize gate protocols, to learn laser frequency noise, and to study the noise response for quantum simulation tasks. Finally, we predict that a CZ gate fidelity of ≳ 0.999 is feasible with realistic experimental upgrades. Published by the American Physical Society 2025

Tsai, Richard Bing-Shiun (ORCID:0000000286758677)↗
DOE OSTI2026

Interlayer coupling in two-dimensional MoS 2 and phosphorene bilayers: Benchmark quantum Monte Carlo study of interaction energies and quasiparticle band gaps

Using high-accuracy many-body quantum Monte Carlo (QMC) methods, we study the effect of interlayer coupling on the properties of two-dimensional freestanding bilayers (BLs) of MoS 2 and phosphorene. The properties of the two BL-materials are very different and largely determined by the interlayer interaction, which is purely van der Waals in MoS 2 and partially electronic/chemical in phosphorene, resulting in a modest layer-dependent property modulation in MoS 2 and strong modulation in phosphorene. Multireference and symmetry considerations are used to construct state-of-the-art accuracy QMC trial wave functions. We determine the quasiparticle band gaps for both materials, $Δ^{\textrm{qp}}_{Γ→\textrm{K}}$ = 2.45 ± 0.05 eV in BL-MoS 2 and $Δ^{\textrm{qp}}_{Γ→Γ}$=1.59 ±0.1eV in BL-phosphorene. In conclusion, these benchmark band-gap values make it possible to consolidate the interpretation of the widely scattered experimental and theory data.

Huang, Yongda [Slovak Academy of Sciences (SAS), B↗
DOE OSTI2025

Lattice QCD Benchmark of Proton Helicity and Flavor-Dependent Unpolarized Transverse Momentum-Dependent Parton Distribution Functions at Physical Quark Masses

We present the first lattice QCD calculations of the isovector helicity transverse momentum-dependent parton distribution function (TMDPDF) and the flavor-dependent unpolarized TMDPDFs for up and down quarks in the proton. Our computations utilize domain-wall fermion discretization with physical quark masses. Employing Coulomb-gauge-fixed quark correlation functions within the large-momentum effective theory framework, we access nonperturbative transverse quark separations 𝑏 𝑇 up to approximately 1 fm, corresponding to transverse momenta as low as 200 MeV. Based on the quasi-TMD factorization theorem, we construct renormalization-group–invariant ratios that are equal to the corresponding light-cone TMDPDF ratios. At moderate 𝑥, our results reveal that the isovector helicity and unpolarized TMDPDFs exhibit nearly identical transverse structure up to a normalization factor, and the unpolarized distributions display only mild flavor dependence. These findings not only support key trends observed in recent global analyses but also provide robust, nonperturbative constraints that can distinguish between different parameterizations. This Letter establishes a first-principles benchmark for TMDPDFs, offering valuable input for ongoing and future experimental efforts to map the proton’s three-dimensional structure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Viscous Gubser flow with conserved charges to benchmark fluid simulations

We present semi-analytical solutions for the evolution of both the temperature and chemical potentials for viscous Gubser flow with conserved charges. Such a solution can be especially useful in testing numerical codes intended to simulate relativistic fluids with large chemical potentials. The freeze-out hypersurface profiles for constant energy density are calculated, along with the corresponding normal vectors, and presented as a new unit test for numerical codes. We also compare the influence of the equation of state on the semi-analytical solutions. We benchmark the newly developed smoothed particle hydrodynamics code ccake that includes both shear viscosity and three conserved charges. Here, the numerical solutions are in excellent agreement with the semi-analytical solution and are also able to accurately reproduce the hypersurface at freeze-out.

Hydrodynamic models↗
DOE OSTI2024

Benchmarking Optimizers for Qumode State Preparation with Variational Quantum Algorithms

Quantum state preparation involves preparing a target state from an initial system, a process integral to applications such as quantum machine learning and solving systems of linear equations. Recently, there has been a growing interest in qumodes due to advancements in the field and their potential applications. However there is a notable gap in the literature specifically addressing this area. This paper aims to bridge this gap by providing performance benchmarks of various optimizers used in state preparation with Variational Quantum Algorithms. We conducted extensive testing across multiple scenarios, including different target states, both ideal and sampling simulations, and varying numbers of basis gate layers. Our evaluations offer insights into the complexity of learning each type of target state and demonstrate that some optimizers perform better than others in this context. Notably, the Powell optimizer was found to be exceptionally robust against sampling errors, making it a preferred choice in scenarios prone to such inaccuracies. Additionally, the Simultaneous Perturbation Stochastic Approximation optimizer was distinguished for its efficiency and ability to handle increased parameter dimensionality effectively.

Kan, Shuwen [Fordham University]↗
DOE OSTI2025

Entanglement Benchmarking in Quantum Simulations of Spin Systems

We simulate quantum spin systems and measure entanglement using circuits tailored for near-term quantum computers. Traditional tools like entanglement entropy are limited to pure states and require full state tomography, making them impractical on current hardware. Instead, we employ the novel approach, Positive Partial Transpose (PPT) criterion to efficiently detect pairwise entanglement from two-spin reduced density matrices, applicable to both pure and mixed states. This method enables scalable entanglement detection, providing a practical route to study quantum correlations, phase transitions, and benchmark quantum devices.

Baul, Anshumitra [ORNL] (ORCID:0000000268947191)↗
DOE OSTI2026

Cooling Matters: Benchmarking Large Language Models and Vision-Language Models on Liquid-Cooled Versus Air-Cooled H100 GPU Systems

The unprecedented growth in artificial intelligence (AI) workloads, recently dominated by large language models (LLMs) and vision-language models (VLMs), has intensified power and cooling demands in data centers. This study benchmarks LLMs and VLMs on two HGX nodes, each with 8× NVIDIA H100 graphics processing units (GPUs), using liquid and air cooling. Leveraging GPU Burn, Weights & Biases, and IPMItool, we collect detailed thermal, power, and computation data. Results show that the liquid-cooled systems maintain GPU temperatures between 41-50$^\circ$C, while the air-cooled counterparts fluctuate between 54-72$^\circ$C under load. This thermal stability of liquid-cooled systems yields 17% higher performance (54 TFLOPs/ GPU vs. 46 TFLOPs/GPU), performance-per-watt, reduced energy overhead, and greater system efficiency than the air-cooled counterparts. These findings underscore the energy and sustainability benefits of liquid cooling, offering a compelling path forward for hyperscale data centers seeking to optimize AI infrastructure. https://github.com/iscaas/Cooling-Matters.

Latif, Imran↗
DOE OSTI2026

Optical nanofiber testbeds for benchmarking membrane-waveguide photonic integrated circuit platforms toward on-chip quantum inertial sensing

Recent advances in cold atom interferometry with optical and magnetic atom guides have set the stage for quantum inertial sensors capable of operating in dynamic environments. In this work, we present three key innovations—evanescent-field (EF) atom guides, optical nanofiber testbeds, and membrane-waveguide photonic integrated circuit (PIC) platforms—to advance EF-guided atom interferometry. First, we demonstrate EF atom guides on optical nanofiber testbeds, which serve as performance benchmarks for our membrane-waveguide PIC platforms. Second, we achieve low-power (⁠ ~ 5 mW) guiding of freely moving, laser-cooled 133 Cs atoms in two-color, traveling-wave EF optical dipole traps at the novel, heat-efficient magic wavelengths of 793 and 937 nm (i.e., “793/937-nm EF atom guides”). Concurrently, we design and fabricate membrane-waveguide PIC platforms for these EF atom guides; in our prior work, we showed that these structures safely accommodate 4–6 times the required optical trap power under vacuum and enable dense cold atom generation via magneto-optical trapping in the vicinity of the optical wavguide for efficient loading. Third, we verify preserved atomic coherence via microwave fields and EF-coupled Doppler-free Raman beams; to our knowledge, this is the first report of coherence fringes driven by co-propagating EF-coupled Raman beams with only 150 nW of total optical power. By providing a direct comparison between optical nanofiber testbeds and membrane-waveguide PIC platforms, our results lay critical groundwork for the on-chip realization of EF-guided atom interferometry and the development of fully integrated, compact, lightweight, and low-power quantum accelerometers and gyroscopes.

Orozco, Adrian [Sandia National Laboratories (SNL-↗
DOE OSTI2026

Did You Win the GPU Cloud Lottery? Benchmarking from TFLOPS to Tokens/$

Cloud GPUs are commonly assumed to deliver consistent performance for a given GPU model. This assumption does not always hold: cloud providers employ diverse system configurations and virtualization mechanisms, and GPUs themselves exhibit non-negligible manufacturing variability (the silicon lottery). In this work, we present a large-scale measurement study of GPU performance variability across 11 cloud providers, covering over 3,500 physical GPUs and 6,800 benchmark runs. Our hierarchical analysis shows that while execution-level variation stays below 9%, performance varies by up to 38% across devices and providers for the same GPU model. Regression analysis indicates that driver- and OS-related software factors contribute less than 1% of the variance; instead, silicon lottery effects dominate observed performance variation, and cloud providers further amplify them through persistent, systematic second-order effects.

Slynko, Platon [Silicon Data, New York, USA] (ORCI↗
DOE OSTI2025

System Noise Benchmarks

This project includes benchmarks to assess the presence of system noise on supercomputers. System noise is any activity that interferes with the execution of high-performance computing applications.

Moody, AdamT [Lawrence Livermore National Laborato↗
DOE OSTI2026

BLEECAM™ (Benchmarking Life Cycle Environmental, Economic, and Social Metrics for Critical and Advanced Minerals and Materials) [SWR-25-125]

The National Laboratory of the Rockies' (NLR) Benchmarking Life Cycle Environmental, Economic, and Social Metrics for Critical and Advanced Minerals and Materials (BLEECAM™) is an open-source, integrated decision-support tool for evaluating the impacts, risks, and trade-offs across U.S. and global materials supply chains. Funded by the U.S. Department of Energy, BLEECAM supports supply chain and market analysis. The tool integrates multi-objective supply chain optimization, system dynamics, network design, lifecycle assessment, techno-economic modeling, and social impact assessment methods to evaluate how supply chains evolve over time, geography, and deployment scenarios. BLEECAM also supports analysis related to energy infrastructure, data centers and digital infrastructure, advanced manufacturing, and other sectors that depend on critical materials.

Khalifa, SherifA. [National Laboratory of the Rock↗
DOE OSTI2026

Dataset for Role of electron correlation on the adenine dimer interaction for non-equilibrium geometries: a benchmark Quantum Monte Carlo study

Datasets for the calculations reported in "Role of electron correlation on the adenine dimer interaction for non-equilibrium geometries: A benchmark Quantum Monte Carlo study" by L. Washburn, A. Sedova, P. R. C. Kent. J. Chem. Phys. (2026) 165 (5): 054118. https://doi.org/10.1063/5.0332651. Includes the molecular geometries, QMCPACK, PySCF, and ORCA inputs and outputs, analysis scripts and files needed to reproduce all the figures and tables.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Preliminary Results on Bayesian Inverse UQ for OECD/NEA WPNCS Subgroup 14 Benchmark Exercise for Error Recovery and Experimental Coverage

The Organization for Economic Cooperation and Development (OECD) Working Party on Nucelar Criticality Safety (WPNCS) has proposed a benchmark exercise representative of neutronic behavior in criticality experiments. Here, the goal is to develop confidence in data assimilation techniques used to adjust nuclear data. Participants are given synthetic experimental models with associated measured data and asked to estimate the model parameters given the model and measurements as well as provide predictions for separate application models. In this work, we performed data assimilation using Bayesian inverse Uncertainty Quantification (UQ) with machine learning surrogate models to produce posterior parameter distributions for the requested parameters and posterior predictive distributions for the requested responses. Several experimental models are shown to insufficiently inform the posterior parameter distributions for the applications involved. However, given sufficient experimental data, posterior parameter estimates yielded reduced uncertainty in the response predictions of interest while covering the experimental data.

Bayesian Inference↗
DOE OSTI2024

DAISY Benchmark Performance Data

This repository contains the underlying data from benchmark experiments for Drifting Acoustic Instrumentation SYstems (DAISYs) in waves and currents described in "Performance of a Drifting Acoustic Instrumentation SYstem (DAISY) for Characterizing Radiated Noise from Marine Energy Converters" (https://link.springer.com/article/10.1007/s40722-024-00358-6). DAISYs consist of a surface expression connected to a hydrophone recording package by a tether. Both elements are instrumented to provide metadata (e.g., position, orientation, and depth). Information about how to build DAISYs is available at https://www.pmec.us/research-projects/daisy. The repository's primary content is three compressed archives (.zip format), each containing multiple MATLAB binary data files (.mat format). A table relating individual data files to figures in the paper, as well as the structure of each file, is included in the repository as a Word document (Data Description MHK-DR.docx). Most of the files contain time series information for a single DAISY deployment (file naming convention: [site]_DAISY_[Drift #].mat) consisting of processed hydrophone data and associated metadata. For a limited number of DAISY deployments, the hydrophone package was replaced with an acoustic Doppler velocimeter (file naming convention: [site]_DAISY_[Drift #]_ADV.mat). Data were collected over several years at three locations: (1) Sequim Bay at Pacific Northwest National Laboratory's Marine & Coastal Research Laboratory (MCRL) in Sequim, WA, the energetic tidal channel in Admiralty Inlet, WA (Admiralty Inlet), and the U.S. Navy's Wave Energy Test Site (WETS) in Kaneohe, HI. Brief descriptions of data files at each location follow. - MCRL - (1) Drift #4 and #16 contrast the performance of a DAISY and a reference hydrophone (icListen HF Reson), respectively, in the quiescent interior of Sequim Bay (September 2020). (2) Drift #152 and #153 are velocity measurements for a drifting acoustic Doppler velocimeter in in the tidally-energetic entrance channel inside a flow shield and exposed to the flow, respectively (January 2018). (3) Two non-standard files are also included: DAISY_data.mat corresponds to a subset of a DAISY drift over an Adaptable Monitoring Package (AMP) and AMP_data.mat corresponds to approximately co-temporal data for a stationary hydrophone on the AMP (February 2019). - Admiralty Inlet - (1) Drift #1-12 correspond to tests with flow shielded DAISYs, unshielded DAISYs, a reference hydrophone, and drifting acoustic Doppler velocimeter with 5, 10, and 15 m tether lengths between surface expression and hydrophone recording package (July 2022). (2) Drift #13-20 correspond to tests of flow shielded DAISYs with three different tether materials (rubber cord, nylon line, and faired nylon line) in lengths of 5, 10, and 15 m (July 2022). - WETS - (1) Drift #30-32 correspond to tests with a heave plate incorporated into the tether (standard configuration for wave sites), rubber cord only, and rubber cord, but with a flow shielded hydrophone (November 2022). (2) Drift #49-58 and Drift #65-68 correspond to measurements around mooring infrastructure at the 60 m berth where time-delay-of-arrival localization was demonstrated for different DAISY arrangements and hydrophone depths (November 2022).

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

2024 Water Splitting Technologies Benchmarking and Protocols Workshop

The sixth annual Advanced Water Splitting Pathways Benchmarking meeting was held on June 11-12, 2024 at the Arizona State University California Center- Los Angeles, CA. A total of 117 people participated (102 in person and 15 via Zoom). Attendance at most breakout sessions ranged from 10 - 25 attendees. The focus of many of the sessions was on developing plans to validate protocols written to date, defining future protocols to be written and aligning with international efforts. The plenary session provided perspectives on international activities in each technology area, as well as an overview of the ARCHES Hydrogen Hub.

08 HYDROGEN↗
DOE OSTI2025

Benchmarking the Use of BPM Quadrupole Moments to Measure Emittance

For the PIP-II program, transverse emittance in the Fermilab Booster must remain well controlled at higher bunch intensities. 4-plate beam position monitors (BPMs) have a small but measurable quadrupole moment, making it possible to infer transverse emittance. By compositing many BPMs together, it becomes possible to improve the quality of the quadrupole signal. The Fermilab Booster BPM system has been used to measure these quadrupole moments in the past year and derive emittances from them. Recent benchmarks show that the derived BPM emittances show similar emittance evolution and value to IPM and Multiwire data. This approach can both supplement and complement existing non-intercepting emittance monitors in accelerators.

Balcewicz, M. A. [Fermilab]↗