Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Q1-2025 Solar Photovoltaic System Cost Benchmarks

The U.S. Department of Energy’s solar office and its national laboratory partners analyze cost data for U.S. solar photovoltaic systems to develop cost benchmarks to measure progress toward goals and guide research and development programs. The cost data is available in an Excel spreadsheet model that can be downloaded here.

14 SOLAR ENERGY↗

Statistical Analysis of NAS Parallel Benchmarks and LINPACK Results

In the last three years extensive performance data have been reported for parallel machines both based on the NAS Parallel Benchmarks, and on LINPACK. In this study we have used the reported benchmark results and performed a number of statistical experiments using factor, cluster, and regression analyses. In addition to the performance results of LINPACK and the eight NAS parallel benchmarks, we have also included peak performance of the machine, and the LINPACK n and n(sub 1/2) values. Some of the results and observations can be summarized as follows: 1) All benchmarks are strongly correlated with peak performance. 2) LINPACK and EP have each a unique signature. 3) The remaining NPB can grouped into three groups as follows: (CG and IS), (LU and SP), and (MG, FT, and BT). Hence three (or four with EP) benchmarks are sufficient to characterize the overall NPB performance. Our poster presentation will follow a standard poster format, and will present the data of our statistical analysis in detail.

Meuer, Hans-Werner↗

Benchmarking universal machine learning interatomic potentials for rapid analysis of inelastic neutron scattering data

The accurate calculation of phonons and vibrational spectra remains a significant challenge, requiring highly precise evaluations of interatomic forces. Traditional methods based on the quantum description of the electronic structure, while widely used, are computationally expensive and demand substantial expertise. Emerging universal machine learning interatomic potentials (uMLIPs) offer a transformative alternative by employing pre-trained neural network surrogates to predict interatomic forces directly from atomic coordinates. This approach dramatically reduces computation time and minimizes the need for technical knowledge. In this paper, we produce a phonon database comprising nearly 5000 inorganic crystals to benchmark the performance of several leading uMLIPs. We further assess these models in real-world applications by using them to analyze experimental inelastic neutron scattering data collected on a variety of materials. Through detailed comparisons, we identify the strengths and limitations of these uMLIPs, providing insights into their accuracy and suitability for fast calculations of phonons and related properties, as well as the potential for real-time interpretation of neutron scattering spectra. Our findings highlight how the rapid advancement of AI in science is revolutionizing experimental research and data analysis.

inelastic neutron scattering↗

Aeroassist flight experiment aerodynamics and aerothermodynamics

The problem is to determine the transitional flow aerodynamics and aerothermodynamics, including the base flow characteristics, of the Aeroassist Flight Experiment (AFE). The justification for the computational fluid dynamic (CFD) Application stems from MSFC's system integration responsibility for the AFE. To insure that the AFE objectives are met, MSFC must understand the limitations and uncertainties of the design data. Perhaps the only method capable of handling the complex physics of the rarefied high energy AFE trajectory is Bird's Direct Simulation Monte Carlo (DSMC) technique. The 3-D code used in this analysis is applicable only to the AFE geometry. It uses the Variable Hard Sphere (VHS) collision model and five specie chemistry model available from Langley Research Center. The code is benchmarked against the AFE flight data and used as an Aeroassisted Space Transfer Vehicle (ASTV) design tool. The code is being used to understand the AFE flow field and verify or modify existing design data. Continued application to lower altitudes is testing the capability of the Numerical Aerodynamic Simulation Facility (NASF) to handle 3-D DSMC and its practicality as an ASTV/AFE design tool.

Brewer, Edwin B.↗

Structural Life and Reliability Metrics: Benchmarking and Verification of Probabilistic Life Prediction Codes

Over the past two decades there has been considerable effort by NASA Glenn and others to develop probabilistic codes to predict with reasonable engineering certainty the life and reliability of critical components in rotating machinery and, more specifically, in the rotating sections of airbreathing and rocket engines. These codes have, to a very limited extent, been verified with relatively small bench rig type specimens under uniaxial loading. Because of the small and very narrow database the acceptance of these codes within the aerospace community has been limited. An alternate approach to generating statistically significant data under complex loading and environments simulating aircraft and rocket engine conditions is to obtain, catalog and statistically analyze actual field data. End users of the engines, such as commercial airlines and the military, record and store operational and maintenance information. This presentation describes a cooperative program between the NASA GRC, United Airlines, USAF Wright Laboratory, U.S. Army Research Laboratory and Australian Aeronautical & Maritime Research Laboratory to obtain and analyze these airline data for selected components such as blades, disks and combustors. These airline data will be used to benchmark and compare existing life prediction codes.

Litt, Jonathan S.↗

Development of an Improved RELAP5-3D Model for the High Temperature Test Facility

High-temperature gas-cooled reactors (HTGRs) are rapidly approaching deployment. Confidence in transient analysis of these systems requires modeling and simulation tools that have been validated against data relevant to HTGR conditions. The High Temperature Test Facility (HTTF) is an integral effects thermal hydraulics test facility for prismatic HTGRs. In spring and summer of 2019, HTTF was used for a series of experiments that now serve as the basis for the Organization of Economic Cooperation and Development / Nuclear Energy Agency Thermal Hydraulic Code Validation Benchmark for High Temperature Gas-Cooled Reactors using HTTF Data (HTGR T/H Benchmark). Previous analyses as part of the HTGR T/H benchmark used a RELAP5-3D model developed at Idaho National Laboratory (INL) and demonstrated an ability to reproduce trends in the measured data but difficulties reproducing experimental values within their uncertainty. These difficulties were largely attributed to assumptions made during the development of the initial RELAP5-3D model, which predated the HTTF experiments. A significant cause of difficulty reproducing the measured temperatures may be the radial nodalization of the previous RELAP5-3D model. In this paper, we present a new RELAP5-3D model of HTTF with finer radial nodalization built to assess the impact of radial heat transfer. We describe the new model and compare it against the old one at full-power steady state and for the pressurized conduction cooldown (PCC) transient. These analyses are based on the code-to-code comparison exercise for the PCC problem of the HTGR T/H benchmark. We compare maximum block temperature as the primary figure of merit and include discussion on intracore natural circulation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗

Real singlet scalar benchmarks in the multi-TeV resonance regime

Scalar extensions of the Standard Model (SM) are of much interest at the Large Hadron Collider (LHC) and future colliders. In particular, these models can give rise to resonant di-Higgs production and alter the Higgs trilinear coupling. In this paper, we study di-Higgs production in the Standard Model extended by a real scalar singlet with no additional symmetries. We determine how large the resonant di-Higgs rate and variation in the Higgs trilinear coupling can be in four scenarios: current LHC results and projected results at the high luminosity LHC (HL-LHC), the HL-LHC combined with a circular 𝑒 − ⁢𝑒 + collider such as the Circular Electron Positron Collider or Future Circular Collider with electron-positron collisions, and the HL-LHC combined with a linear 𝑒 − ⁢𝑒 + collider such as the International Linear Collider. While these are updated results from a previous study by [I. M. Lewis and M. Sullivan, Benchmarks for double Higgs production in the singlet extended standard model at the LHC, Phys. Rev. D 96, 035037 (2017).] using current LHC data, we go further and find benchmark points in the multi-TeV resonance regime for future colliders beyond the HL-LHC. Considering current LHC results, the resonant di-Higgs rate can still be an order of magnitude larger than the SM predicted di-Higgs rate. In the HL-LHC scenario, the Higgs trilinear coupling can still be a factor of three larger than the SM prediction for resonance masses in the 1.5–3.5 TeV range, where resonant searches may have less reach. This enhancement is just at the projected 2⁢𝜎 sensitivity of the HL-LHC. We find there are resonance masses for which the change in the Higgs trilinear is maximized while the resonant rate is negligible. We provide an analytical understanding of these effects with a discussion on the interplay of various constraints on the parameter space and the Higgs trilinear coupling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Use of Apollo 17 Epoch Neutron Spectrum as a Benchmark in Testing LEND Collimated Sensor

The Apollo 17 neutron experiment LPNE provided a unique set of data on production of neutrons in the Lunar soil bombarded by Galactic Cosmic Rays (GCR). It serves as valuable "ground-truth" in the age of orbital remote sensing. We used the neutron data attributed to Apollo 17 epoch as a benchmark for testing the LEND's collimated sensor, as introduced by the geometry of collimator and efficiency of He3 counters. The latter is defined by the size of gas counter and pressure inside it. The intensity and energy spectrum of neutrons escaping the lunar surface are dependent on incident flux of Galactic Cosmic Rays (GCR) whose variability is associated with Solar Cycle and its peculiarities. We obtain first the share of neutrons entering through the field of view of collimator as a fraction of the total neutron flux by using the angular distribution of neutron exiting the Moon described by our Monte Carlo code. We computed next the count rate of the 3He sensor by using the neutron energy spectrum from McKinney et al. [JGR, 2006] and by consider geometry and gas pressure of the LEND sensor. Finally the neutron count rate obtained for the Apollo 17 epoch characterized by intermediate solar activity was adjusted to the LRO epoch characterized by low solar activity. It has been done by taking into account solar modulation potential, which affects the GCR flux, and in turn changes the neutron albedo flux.

Chin, Gordon↗

Resolving femtosecond photoinduced energy flow: capture of nonadiabatic reaction pathway topography and wavepacket dynamics from photoexcitation through the conical intersection seam (Final Technical Report)

The dynamics that take place within just tens to hundreds of femtoseconds following the absorption of light by a molecule can play a critical role in how the absorbed energy is directed, allowing it to be used for a specific function or dissipated harmlessly. The form of chemical change that occurs rapidly in these molecules is called a “nonadiabatic electronic transition.” Such transitions are known to mediate energy flow in natural biological systems such as the ultraviolet photoprotection mechanism of DNA and the first step of the human vision response. Understanding how these mechanisms work precisely may help scientists achieve controlled manipulation of solar energy or optical control of a wide range of energy management functions in artificial systems. Experimental methods, however, have not yet allowed a precisely resolved and complete measurement of nonadiabatic electronic transitions. This constitutes a major obstacle to progress in the field. For progress to occur that would inform a wide body of research aiming to efficiently harness the energy of light for practical purposes, it is especially important to benchmark computational models of the molecules undergoing these rapid changes with experimental measurements, in order to learn which models are accurate. With Dept. of Energy funding, we have made strong progress towards establishing a new optical method for experimentally detecting the full nonadiabatic electronic transition. This requires having coordinated pulses of light covering the visible through the mid-infrared range of the electromagnetic spectrum that last only ten femtoseconds. We have developed a new, relatively simple approach for generating such pulses of laser light, and have incorporated them into a time-resolved spectrometer for measuring rapid changes in molecules. These tools can provide the greater precision and new types of data that are needed to benchmark computational models of molecular change and thus to make progress in the field. Our tools were tested on graphene, an excellent solid-state sample for verifying the capabilities and limitations of our instrumentation. The investment made in these tools by the Dept. of Energy Office of Science will allow new fundamental scientific understanding of energy dynamics in molecules in future studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning framework for predicting uranium enrichments from M400 CZT gamma spectra

A machine learning framework was developed for predicting uranium enrichments from M400 CZT gamma spectra. This framework leverages the availability of a large amount of measured M400 gamma spectra and uses a recently updated version of Gamma Detector Response and Analysis Software (GADRAS) for gamma spectrum analysis and generation. It also leverages the existing machine learning modules in Python for gamma spectrum data processing, curation, model training, benchmarking, and optimization of the deep machine learning models. The framework is used to develop a deep learning model to analyze gamma spectra from a set of U 3 O 8 samples with enrichments ranging from 0.31 to 93.17% and UF 6 cylinders with enrichments ranging from 0.2 to 4.95%, and the model performance is tested using a set of measured spectra and the respective declared enrichment values. Results show that the model can correctly classify 99.35% of the U 3 O 8 sample enrichments, and can predict the samples’ enrichments within an average absolute error of 0.099% (in percentage points of enrichment). For the UF 6 cylinders, the average absolute error was approximately 0.03%, with an accuracy of 98% in classifying discrete enrichment values of UF 6 samples. Finally, the results also show that the model has performed significantly better in terms of predicting enrichments in UF 6 cylinders based on measured gamma spectra than the GEM code, with a standard deviation (of the relative errors) of 2.23% (compared with the 11.51% value for the GEM code) based on results from a set of test data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data Comparisons and Summary of the Second Aeroelastic Prediction Workshop

This paper presents the computational results generated by participating teams of the second Aeroelastic Prediction Workshop and compare them with experimental data. Aeroelastic and rigid configurations of the Benchmark Supercritical Wing (BSCW) wind tunnel model served as the focus for the workshop. The comparison data sets include unforced ("steady") system responses, forced pitch oscillations and coupled fluid-structure responses. Integrated coefficients, frequency response functions, and flutter onset conditions are compared. The flow conditions studied were in the transonic range, including both attached and separated flow conditions. Some of the technical discussions that took place at the workshop are summarized.

Heeg, Jennifer↗

Data Accountability and Uncertainty Analysis for the Mars Science Laboratory

This paper presents machine learning-based approaches to automate and optimize the detection of volume loss for the downlink process of telemetry data from the Mars Curiosity Rover. The Curiosity observes volume loss and data corruption, requiring re-transmits from the rover and Ground Data System Analysts (GDSA) to monitor the data flow. To resolve this issue, we created a data pipeline to accumulate data from various data sources in the downlink process and detect where the data is missed. In this paper, we benchmarked different methodologies based on the accuracy and excitability of them to identify whether a downlink data that is received to the ground system is complete or incomplete. Our results show that machine learning methods can improve the performance of the GDSA by 55% while the user can diagnose why data is missed and provide an explanation for the data accountability problem.

Chowdhury, Ameera↗

LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers

Liquid cooling is critical for thermal management in high-density data centers with the rising AI workloads. However, machine learning-based controllers are essential to unlock greater energy efficiency and reliability, promoting sustainability. We present LC-Opt, a Sustainable Liquid Cooling (LC) benchmark environment, for reinforcement learning (RL) control strategies in energy-efficient liquid cooling of high-performance computing (HPC) systems. Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models spanning site-level cooling towers to data center cabinets and server blade groups. RL agents optimize critical thermal controls like liquid supply temperature, flow rate, and granular valve actuation at the IT cabinet level, as well as cooling tower (CT) setpoints through a Gymnasium interface, with dynamic changes in workloads. This environment creates a multi-objective real-time optimization challenge balancing local thermal regulation and global energy efficiency, and also supports additional components like a heat recovery unit (HRU). We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language through an agentic mesh architecture designed to foster user trust and simplify system management. LC-Opt democratizes access to detailed, customizable liquid cooling models, enabling the ML community, operators, and vendors to develop sustainable data center liquid cooling control solutions.

Naug, Avisek [Hewlett Packard Enterprise]↗

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗

FluxSat: Long-term Earth Science Data Record (ESDR) for Terrestrial Gross Primary Production (GPP) based on satellite data calibrated with eddy covariance data

Gross primary production (GPP), the amount of carbon dioxide (CO 2 ) assimilated by plants through photosynthesis, is one of the most variable and uncertain components of the global carbon cycle. Global GPP has been estimated with a number of process-based models, data-driven, and hybrid approaches. Dynamic global vegetation models (DGVMs), driven by observed environmental changes, are used for global carbon budget assessments and long-term (climate) prediction. Benchmarking these and other models globally with data-driven GPP estimates is critical for understanding the land sink and ensuring accurate forecasts of the carbon cycle. In addition, global data-driven GPP estimates are crucial for studies of interannual variability, including trends that are linked to mechanisms with large uncertainties, such as the indirect CO 2 fertilization effect related to greening. In response to a community need for a GPP data set that well captures spatio-temporal variability, we developed FluxSat, a data-driven approach that optimizes the use of satellite reflectance data from the NASA MODerate-resolution Imaging Spectroradiometer (MODIS) on the Terra and Aqua satellites, calibrated using ground-based eddy covariance (EC) data. We are enhancing (spatially, higher resolution) and extending FluxSat (in time, with additional sensors) to create a high quality long term GPP Earth System Data Record (ESDR) for use in model benchmarking, carbon cycle modeling, and studies of trends and interannual variability. Our team’s objectives are to: 1. Update and document the current MODIS FluxSat GPP (daily, 0.05o and 0.5o resolutions) products with latest available MODIS and EC data sets; 2. Extend FluxSat GPP record forward in time with the Visible Infrared Imaging Radiometer Suite (VIIRS) on operational weather satellites going forward; 3. Extend FluxSat GPP record backward in time using the Advanced Very High Resolution Radiometer (AVHRR) on weather satellites dating back to 1981; 4. Provide higher spatial resolution MODIS and VIIRS GPP (0.0083o). 5. Thoroughly evaluate all FluxSat products with independent data; and 6. Create a homogenized long-term GPP record spanning 40+ years. We will discuss plans for this long-term data set that is supported through the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) program.

gross Primary Production↗

Reference Intercalibration for the Climate Observing System

Reference Intercalibration is critical in supporting the construction of climate data records, which, given their necessary longevity, must consist of measurements from multiple instruments. Reference intercalibration enables placing multiple instruments on the same radiometric scale, reducing calibration-based biases in climate data records. Measurements that have characteristics of a climate benchmark make excellent in-orbit intercalibration references. Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) consists of a reflected solar (RS) spectrometer (350-2300 nm) that will take hyperspectral Earth reflectance measurements with unprecedented SI-traceable accuracy (0.3%, 1-sigma) from the International Space Station (ISS). CPF measurements will have several characteristics of climate benchmark measurements and will demonstrate its capability as a rigorous in-orbit intercalibration reference with Clouds and Earth’s Radiant Energy System (CERES) and Visible Infrared Imaging Radiometer Suite (VIIRS). The methodologies that have been developed to support CPF-CERES and CPF-VIIRS intercalibration can readily be extended to other Low Earth Orbit and Geostationary instrument targets. With its highly accurate hyperspectral observations, CPF measurements can also be used to improve the characterization of targets widely used for satellite instrument vicarious calibration including Earth land surface pseudo-invariant calibration sites, deep convective clouds, and the Moon. We will discuss the importance of climate benchmark measurement attributes for intercalibration and considerations for the associated intercalibration data analysis to support building and maintaining climate data records.

Yolanda Shea↗

The NAS parallel benchmarks

A new set of benchmarks has been developed for the performance evaluation of highly parallel supercomputers in the framework of the NASA Ames Numerical Aerodynamic Simulation (NAS) Program. These consist of five 'parallel kernel' benchmarks and three 'simulated application' benchmarks. Together they mimic the computation and data movement characteristics of large-scale computational fluid dynamics applications. The principal distinguishing feature of these benchmarks is their 'pencil and paper' specification-all details of these benchmarks are specified only algorithmically. In this way many of the difficulties associated with conventional benchmarking approaches on highly parallel systems are avoided.

Bailey, D. H.↗