Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Advancing electrochemical impedance analysis through innovations in the distribution of relaxation times method

Electrochemical impedance spectroscopy (EIS) is a key tool across various scientific disciplines, including energy sciences, chemistry, and biology, enabling the analysis of electrochemical systems. However, conventional methods for interpreting EIS data are often complex and model dependent. The distribution of relaxation times (DRT) offers a non-parametric approach that simplifies the interpretation process by providing a timescale interpretation of EIS data. This article provides a comprehensive review of current methods for DRT inversion. Additionally, a survey of practitioners highlights key challenges in the field. Here, the findings underscore the need for standardized DRT analysis and benchmarks, as well as the development of automated analysis tools. These advancements would improve the usability and interpretability of EIS data. Ultimately, implementing these improvements could not only propel the field forward but also expand the application of DRT in scientific research by making it accessible to a broader range of researchers, including those without specialized expertise in programming or statistics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Image masks of global ship tracks for NASA MODIS data products

Ship tracks, long thin artificial cloud features formed from the pollutants in ship exhaust, are satellite-observable examples of aerosol-cloud interactions (ACI) that can lead to increased cloud albedo and thus increased solar reflectivity, phenomena of interest in solar radiation management. In addition to ship tracks being of interest to meteorologists and policy makers, their observed cloud perturbations provide benchmark evidence of ACI that remain poorly captured by climate models. To broadly analyze the effects of ship tracks, high-resolution satellite imagery data highlighting their presence are required. To support this, we provide a hand labelled dataset to serve as a benchmark for a variety of subsequent analyses. Established from a previous dataset that identified ship track presence using NASA’s MODIS Aqua satellite imager, our first-of-its-kind dataset is comprised of image masks: capturing full ship track regions, including their contours, emission points and dispersive patterns. In total, 300 images, or around 2,500 masked ship tracks, observed under varying conditions are provided, and may facilitate training of machine learning algorithms to automate extraction.

Atmospheric dynamics↗
DOE OSTI2024

Jemima Plate Characterization

The HEU Jemima plates have been utilized in numerous International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluations. ICSBEP evaluations are a vital com ponent of nuclear data validation for applications across the nuclear community. In the past, different combinations of mass, caliper measurements, and drawing dimensions have been used to define the HEU Jemima plates in ICSBEP evaluations. Some of these combinations result in large density ranges (17 g/cm 3 to 19 g/cm 3 ) or unrealistic densities (greater than 19 g/cm 3 ). Additionally, oxidation of the plates has led to questioning the flatness of each plate, which can add additional gaps in experiment configurations. This work proposes a standardized method of defining the commonly used HEU Jemima plates across different experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

A Measurement of the Neutron Electromagnetic Form Factor Ratio from a Rosenbluth Technique with Simultaneous Detection of Neutrons and Protons

The internal structure of protons and neutrons provides insight into both the dynamical behavior of the constitute quarks and gluons, and emergent properties of the nucleons (such as mass, spin, and electromagnetic distributions). Elastic electron-nucleon scattering can probe the elastic electromagnetic form factors of the nucleon. The electric and magnetic form factors, respectively, encode information about the internal charge and magnetization distributions within the nucleon. Precision data for these form factors, over a broad range of the four-momentum transfer squared, Q^2, can benchmark theoretical models describing the strong interaction of nuclear physics. The Super BigBite Spectrometer (SBS) program in Hall A at Jefferson Lab, is a series of high-precision experiments which seek to significantly extend the Q^2 reach of previous data for the nucleon electromagnetic form factors. The first two experiments of this program are known as G_M^n and the neutron Two Photon Exchange (nTPE) and the data were collected from October 2021 to February 2022. Both experiments were conducted with the simultaneous measurement of D(e,e'n) and D(e,e'p) reactions for quasi-elastic electron-deuteron scattering. The scattered electrons were detected in the BigBite Spectrometer, which features multiple large-acceptance Gas Electron Multiplier (GEM) detectors. The Super BigBite Spectrometer provided simultaneous detection of scattered nucleons, and utilized a large acceptance dipole magnet and Hadron Calorimeter (HCal). The G_M^n experiment provides precision measurements of the neutron magnetic form factor, via the ratio method, over a Q^2 range of 3.0 to 13.5 (GeV/c)2. From this data analysis, preliminary values for G_M^n/µ_n G_D are extracted. For Q^2=4.48 (GeV/c)2 we find G_M^n/µ_n G_D=0.9546±0.0132 and for Q^2=4.476 (GeV/c)2 we find G_M^n/µ_n G_D=0.9563±0.0110. These preliminary G_M^n/µ_n G_D values are more precise than existing world data in this Q^2 regime and are consistent with the most recent parameterization of the G_M^n/µ_n G_D world data. The nTPE experiment provides a first measurement of the neutron Rosenbluth Slope and seeks to quantify the two-photon exchange(TPE) contribution to elastic electron-neutron scattering at a fixed Q^2=4.5 (GeV/c)2 with two different beam energies and scattering angle values. For data of the proton form factor ratio, µ_p G_E^p/G_M^p, significant discrepancies exist between values obtained from Rosenbluth Separation and polarization transfer measurement, particularly at large Q^2, and TPE contributions are thought to resolve this discrepancy. The impacts of TPE contributions have not yet been experimentally established for the neutron. From the data analysis presented in this dissertation, a preliminary result for the neutron Rosenbluth Slope is found as S^n=(G_E^n )^2/t_n (G_M^n )^2=0.0916±0.0476 for Q^2=4.48 (GeV/c)2. This value of the neutron Rosenbluth Slope is consistent with the world data extrapolation and the absence of large TPE corrections.

Wertz, Ezekiel [Thomas Jefferson National Accelera↗
DOE OSTI2026

Beyond interpolation: Physics-inspired gating transformers for extrapolating irradiation conditions to novel nuclear fuels

The qualification of advanced nuclear fuels relies on irradiation experiments in test reactors that emulate commercial conditions. Designing these tests requires accurate prediction of key irradiation quantities, particularly heat generation rate and burnup, yet obtaining them typically involves computationally expensive multi-step simulation workflows. We propose a physics-inspired gating transformer (PIGT) that integrates an inverse-square, distance-based attenuation into the encoder representation to bias attention toward physically relevant spatial relationships while retaining data-driven flexibility. Using MiniFuel irradiation data from the High Flux Isotope Reactor at Oak Ridge National Laboratory, we benchmark against ensemble methods, feedforward and recurrent networks, convolutional models, and standard transformers. While baseline models perform well under interpolation, they exhibit a pronounced generalization gap when evaluated on fuels not included in the training set. The proposed model consistently improves extrapolative accuracy and stability, yielding the strongest performance on unseen fuel configurations. These results indicate that a lightweight physics structure embedded within attention mechanisms can substantially improve robustness, enabling more reliable surrogate predictions to accelerate the design of nuclear fuel irradiation experiments.

Fuel qualification↗
DOE OSTI2024

Divertor heat load estimates on NSTX and DIII-D using new and open-source 2D inversion analysis code

A thermography inversion algorithm has been developed in the open-source Python-based computer code, HYPERION, to calculate the heat flux incident on plasma-facing components (PFCs) in axisymmetric tokamaks. The chosen mesh size at the surface significantly affects the calculated transient heat flux results. The calculated transient heat flux will exceed the real value when the mesh size tends to zero but will underestimate the real value when the mesh size is large. A criterion for determining the appropriate mesh size for the transient heat flux calculation will be discussed. The numerical scheme for HYPERION uses a 2D fully implicit finite-difference approach, allowing temperature-dependent thermal properties of PFC materials. The inversion algorithm is benchmarked against established heat flux calculation codes, TACO and THEODOR, based on thermography data from NSTX and DIII-D respectively. The primary benefits of HYPERION compared to TACO and THEODOR are that it is open-source and it allows for the optimization of mesh thickness along the substrate. The algorithm also accounts for the thermal properties of thin surface layers that characteristically form on PFCs due to plasma-material interactions. The agreement between HYPERION and THEODOR is excellent, as the percent difference between the codes is ~5% on average in the case of the DIII-D data for moderate to high heat flux. Verification tests with TACO show slightly higher average percent differences of 8% and 12%. In using HYPERION to study filaments in heat flux, the initial results indicate that small ELMs filaments significantly broaden the divertor heat flux, and decrease divertor peak flux. Compared to the inter-ELM, the small ELM filaments decrease the divertor peak surface temperature. With intermittent divertor filaments, the divertor heat flux width is comparable with that found in L-mode.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

wa-hls4ml-paper

Code for plots, models, data generation and other utilities relating to the paper "wa-hls4ml: A Benchmark and Surrogate Models for hls4ml Resource and Latency Estimation" https://arxiv.org/abs/2511.05615 [FERMILAB-PUB-25-0359-CSAID]

Hawks, Ben [Fermi National Accelerator Laboratory ↗
DOE OSTI2024

Cell-free bioelectrocatalytic platform for carbon dioxide reduction (Final Technical Report)

The University of Minnesota (UMN) EcoSynBio Team aimed to develop a cell-free, enzyme-based platform for the electro- biocatalytic conversion of CO2 into formate as a platform chemical for further upgrading. This type of bio electrocatalytic process delivers a clean product stream without the need for extensive separation from the electrolyte as in electrochemical synthesis and microbial processes. The reduction reaction is catalyzed by metal-dependent formate dehydrogenases (mFDHs) that are capable of efficient electrocatalytic CO2 reduction without the need of costly co-factors. The development of an efficient, scalable electrobiocatalytic process with high total turnover numbers and viable space time yields, however, was not without its challenges. The UM team has developed a protein-based scaffolding system that facilitates enzyme stabilization and attachment to electrodes along with electron transfer. Yet, although FDHs are highly promising enzymes for cell-free, electrobiochemical CO2 reduction, they are also greatly understudied and especially for applications in electrocatalysis. The UM team used the best described mFDH from Clostridium as its benchmark system and spent significant time and effort in attempting to replicate published data and finally, redesigned a recombinant production system for proper metal co-factor incorporation. The UM team has also identified a small set of new enzyme homologs from extreme microorganisms with superior stabilities that have yielded initial structural data for further engineering. In addition, a new bioelectrocatalytic reactor system has been developed that can be 3D printed and used for enzyme attachment to electrodes. In summary the project has generated critical basic information for the further development of this class of enzymes for the electricity driven reduction of CO2 into formate as platform chemical for upgrading into various other chemicals, including fuels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Integrating Characteristic Arctic Vegetation in a Land Surface Model Improves Representation of Carbon Dynamics Across a Tundra Landscape

Arctic warming is altering vegetation and carbon dynamics with global implications, yet Earth System Model (ESM) predictions in the Arctic remain highly uncertain, in part due to historically limited data for model parameterization and validation. As such, ESMs typically represent Arctic ecosystems in an oversimplified manner. Recently, nine plant functional types (PFTs) designed to realistically represent tundra vegetation were integrated into the Energy Exascale Earth System Model (E3SM) Land Model (ELM) and parameterized using plot-scale observations from a single site. Additional evaluation was needed to determine their transferability across the Arctic. Here, in this study, we evaluated whether refined representation of tundra vegetation improved model accuracy by conducting spatially explicit 100 × 100 m resolution ELM simulations on Alaska's Seward Peninsula. Simulations with the default two-PFT configuration and with the nine Arctic-specific PFTs were benchmarked against observations of net ecosystem exchange, gross primary production, and aboveground biomass from multiple data streams including an eddy covariance flux tower, flux chambers, and aircraft and unoccupied aerial system hyperspectral remote sensing. Evaluation revealed that Arctic-specific PFT simulations produced more realistic landscape-level carbon exchanges, and better captured observed heterogeneity in biomass and productivity, explaining 60%–70% of spatial variance (R 2 = 0.6–0.7) compared to just 12%–18% (R 2 = 0.12–0.18) with the default configuration. However, the refined model failed to reproduce observed aboveground biomass for highly productive alder-willow communities, requiring further evaluation of carbon allocation parameterizations for tall shrubs that are increasingly expanding across tundra landscapes. Our results demonstrate that enhanced representation of vegetation heterogeneity boosts predictive understanding of tundra carbon dynamics, facilitating regional to pan-Arctic model and remote-sensing scaling.

Murphy, Bailey A. [Oak Ridge National Laboratory (↗
DOE OSTI2026

Robotic automation of maintenance work in nuclear power plants a cross-sector survey and roadmap

Nuclear power plants face increasing cost pressures, workforce constraints (aging workforce and skilled labor shortages), and safety requirements that are accelerating interest in robotic systems for inspection and maintenance. We conducted semi-structured interviews with personnel from seven U.S. nuclear utilities and compared deployment models, operational use cases, and integration practices with those reported by participants in the oil, gas, and petrochemical sector. In nuclear plants, robotic use remains concentrated in inspection—particularly indoor unmanned aerial vehicles and submersible remotely operated vehicles—with limited application to physical maintenance tasks. Reported near-term value includes reduced radiological and industrial risk, reduced outage labor, and improved data for planning and condition assessment. Key barriers include integration and data-interoperability constraints, operator qualification requirements, cybersecurity review burden, and difficulty demonstrating reliability in plant-representative environments. Cross-sector benchmarking highlights organizational and deployment practices that may help nuclear plants scale from pilots to routine use. We propose a deployment-oriented roadmap emphasizing modular payload strategies, representative qualification pathways and testing environments, and improved data governance to support safe and economically justified expansion of robotics in operating nuclear power plants.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

HPC ODA Commons [SWR-26-003]

HPC ODA Commons is a community-driven platform for standardizing HPC operational data analytics. HPC sites generate enormous volumes of operational data - scheduler logs, accounting records, monitoring streams - but turning that data into actionable insight is needlessly hard. Each site builds bespoke parsers, schemas, and evaluation pipelines. Results can't be compared across institutions. Promising analytics ideas stay siloed because there's no shared language for describing the data, the experiments, or the outcomes. HPC ODA Commons fixes this by establishing community-governed contracts - versioned schemas, canonical artifacts, and benchmark recipes - that make ODA workflows discoverable, reproducible, and comparable. It pairs these standards with a practical, CLI-first toolkit that lets operators and researchers go from raw logs to standardized results without sending data off-cluster.

Menear, Kevin [National Laboratory of the Rockies ↗
DOE OSTI2026

Dark Energy Survey Year 6 Results: Photometric Dataset for Cosmology

We describe the photometric dataset assembled from the full 6 yr of observations by the Dark Energy Survey (DES) in support of static-sky cosmology analyses. DES Y6 Gold is a curated dataset derived from DES Data Release 2 (DR2) that incorporates improved measurement, photometric calibration, object classification and value-added information. Y6 Gold comprises nearly 5000 deg$^{2}$ of grizY imaging in the south Galactic cap and includes 669 million objects with a depth of i$_{AB}$ ∼ 23.4 mag at a signal-to-noise ratio ∼ 10 for extended objects and a top-of-the-atmosphere photometric uniformity <2 mmag. Y6 Gold augments DES DR2 with simultaneous fits to multiepoch photometry for more robust galaxy shapes, colors, and photometric redshift estimates. Y6 Gold features improved morphological star–galaxy classification with an efficiency of 98.6% and a contamination of 0.8% for galaxies with 17.5 < i$_{AB}$ < 22.5. Additionally, it includes per-object quality information, and accompanying maps of the footprint coverage, masked regions, imaging depth, survey conditions, and astrophysical foregrounds that are used for cosmology analyses. After quality selections, benchmark samples contain 448 million galaxies and 120 million stars. This publication is complemented by data access and documentation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Building Energy Analysis of Manufactured and Multifamily Housing Types in Juneau, Alaska

This report details the results of building energy modeling analysis evaluating the potential energy savings, economic outcomes, and grid-level electricity reduction associated with cold climate air source heat pump (ccASHP) adoption across multifamily and manufactured housing (MMFH) building typologies in the City and Borough of Juneau (CBJ). Three building archetypes were evaluated: multifamily 4-plex apartments, multifamily 8-plex apartments, and manufactured housing units. Building energy models were developed using OpenStudio-HPXML and calibrated to actual utility consumption data and local meteorological data from the Juneau International Airport weather station using an automated calibration tool following the BPI-2400-S-2015 v.2 standard for model calibration. Occupant behaviors present the greatest variability in successful calibrations. Calibrated models were benchmarked against a baseline electric resistance heating condition, with the selected ccASHP modeled as the retrofit condition and typical meteorological year weather data for all results generation.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Real-Twin

Real-Twin is a unified, model-agnostic scenario generation tool designed to streamline and standardize the evaluation of emerging mobility technologies. It provides an end-to-end framework that includes robust workflows, integrated tools, and comprehensive metrics to generate, calibrate, and benchmark microscopic traffic simulation scenarios across multiple platforms. Key Features of Real-Twin include: - Unified Scenario Generation: generate transferable, simulation-ready scenarios from heterogeneous data sources using a consistent workflow. - Automated Calibration Workflow: bridges simulation and real-world data, minimizing manual effort and making traffic simulation more accessible to researchers and engineers. - Model-Agnostic Compatibility: supports SUMO, VISSIM, and AIMSUN for cross-platform scenario generation and benchmarking. Enables reliable comparisons and reproducibility across different simulation tools. - Consistent Scenarios across Different Simulators: generate comparable simulation scenarios across different microscopic traffic simulators, providing users the ability to conduct benchmarking and cross-validation that are crucial for ensuring the reliability and reproducibility of simulation results. - Emerging Technology Support: includes a scenario database and pipeline for studying autonomous vehicles (AVs), with planned extensions to CAVs, EVs, and other advanced technologies.

Wang, Chieh (Ross) [Oak Ridge National Laboratory ↗
DOE OSTI2025

A framework to evaluate machine learning crystal stability predictions

The rapid adoption of machine learning in various scientific domains calls for the development of best practices and community agreed-upon benchmarking tasks and metrics. We present Matbench Discovery as an example evaluation framework for machine learning energy models, here applied as pre-filters to first-principles computed data in a high-throughput search for stable inorganic crystals. We address the disconnect between (1) thermodynamic stability and formation energy and (2) retrospective and prospective benchmarking for materials discovery. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with adaptive user-defined weighting of various performance metrics allowing researchers to prioritize the metrics they value most. To answer the question of which machine learning methodology performs best at materials discovery, our initial release includes random forests, graph neural networks, one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials. We highlight a misalignment between commonly used regression metrics and more task-relevant classification metrics for materials discovery. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV per atom above the convex hull. The benchmark results demonstrate that universal interatomic potentials have advanced sufficiently to effectively and cheaply pre-screen thermodynamic stable hypothetical materials in future expansions of high-throughput materials databases.

Riebesell, Janosh↗
DOE OSTI2025

Direct I/O for RNTuple Columnar Data

RNTuple is the new columnar data format designed as the successor to ROOT’s TTree format. It allows to make use of modern hardware capabilities and is expected to be used in production by the LHC experiments during the HL-LHC. In this paper, we discuss the usage of Direct I/O to fully exploit modern SSDs, especially in the context of the recent addition of parallel RNTuple writing. We describe the alignment requirements imposed by Direct I/O and approaches to meet them for columnar data formats. Finally, we discuss performance results for both writing and reading, in synthetic benchmarks as well as real-world applications.

Hahnfeld, Jonas [CERN; Goethe U., Frankfurt (main)↗
DOE OSTI2024

High-fidelity dimer excitations using quantum hardware

The quantum simulation of entangled spin systems can play a central role in quantum magnetic materials discovery. Additionally, the simulation of spectroscopic signatures, such as the dynamical structure factor accessed in inelastic neutron scattering (INS), necessitates a long timescale for circuit evolution. This is because the energy resolution is directly related to the time over which the circuit could be meaningfully evolved. However, canonical Trotterization requires deep circuits precluding such long-time evolution—even for a small number of qubits. Here, in this study, we demonstrate “direct” resource efficient fast-forwarding (REFF) measurements with short-depth circuits that can be used to capture longer time dynamics of spin Hamiltonians. We showcase the results of the dynamics of a quantum spin dimer, the basic quantum unit of emergent many-body spin systems, whose density of states we simulate accurately. The long temporal evolution and measurement of the two-spin correlation functions enable the calculation of the dynamical structure factor S⁡(Q = 0, ω) measured in the neutron scattering cross-section. We exhibit the clarity of the triplet gap and the triplet splitting of the quantum dimer with class-leading fidelity that enables comparison to experimental neutron data. Our results on current circuit hardware outline an important workflow to predict and benchmark against the outputs of INS experiments of quantum magnets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗