Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

TEX-Chlorine for TerraPower - Experimental Execution Report

This report describes the critical configurations of the TEX4TerraPower project that were performed in FY26Q4. Within this report, the configurations are presented along with physical measurements performed in support of benchmarking. TEX4TerraPower builds upon the TEX-Chlorine experiments, which in turn were based on the TEX-HEU experiments. Similar to TEX-Chlorine, the TEX4TerraPower configurations iteratively layered HEU fuel with sodium chloride (NaCl) absorbers. However, the main difference in the density achieved during the fabrication process of the sodium chloride absorbers. Unlike TEX-Chlorine, which was able to achieve ~70% theoretical density, the TEX4TerraPower salt plates achieved >90% theoretical density by hydraulically pressing the salt.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Scaling and Benchmarking an Evolutionary Algorithm for Constructing Biophysical Neuronal Models

Single neuron models are fundamental for computational modeling of the brain's neuronal networks, and understanding how ion channel dynamics mediate neural function. A challenge in defining such models is determining biophysically realistic channel distributions. Here, we present an efficient, highly parallel evolutionary algorithm for developing such models, named NeuroGPU-EA. NeuroGPU-EA uses CPUs and GPUs concurrently to simulate and evaluate neuron membrane potentials with respect to multiple stimuli. We demonstrate a logarithmic cost for scaling the stimuli used in the fitting procedure. NeuroGPU-EA outperforms the typically used CPU based evolutionary algorithm by a factor of 10 on a series of scaling benchmarks. We report observed performance bottlenecks and propose mitigation strategies. Finally, we also discuss the potential of this method for efficient simulation and evaluation of electrophysiological waveforms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Data-Driven and Multiscale Modeling of DNA-Templated Dye Aggregates

Dye aggregates are of interest for excitonic applications, including biomedical imaging, organic photovoltaics, and quantum information systems. Dyes with large transition dipole moments (μ) are necessary to optimize coupling within dye aggregates. Extinction coefficients (ε) can be used to determine the μ of dyes, and so dyes with a large ε (>150,000 M –1 cm –1 ) should be engineered or identified. However, dye properties leading to a large ε are not fully understood, and low-throughput methods of dye screening, such as experimental measurements or density functional theory (DFT) calculations, can be time-consuming. In order to screen large datasets of molecules for desirable properties (i.e., large ε and μ), a computational workflow was established using machine learning (ML), DFT, time-dependent (TD-) DFT, and molecular dynamics (MD). ML models were developed through training and validation on a dataset of 8802 dyes using structural features. A Classifier was developed with an accuracy of 97% and a Regressor was constructed with an R2 of above 0.9, comparing between experiment and ML prediction. Using the Regressor, the ε values of over 18,000 dyes were predicted. The top 100 dyes were further screened using DFT and TD-DFT to identify 15 dyes with a μ relative to a reference dye, pentamethine indocyanine dye Cy5. Two benchmark MD simulations were performed on Cy5 and Cy5.5 dimers, and it was found that MD could accurately capture experimental results. The results of this study exhibit that our computational workflow for identifying dyes with a large μ for excitonic applications is effective and can be used as a tool to develop new dyes for excitonic applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter

The Compact Muon Solenoid (CMS) experiment is a general-purpose detector for high-energy collision at the Large Hadron Collider (LHC) at CERN. It employs an online data quality monitoring (DQM) system to promptly spot and diagnose particle data acquisition problems to avoid data quality loss. In this study, we present a semi-supervised spatio-temporal anomaly detection (AD) monitoring system for the physics particle reading channels of the Hadron Calorimeter (HCAL) of the CMS using three-dimensional digi-occupancy map data of the DQM. We propose the GraphSTAD system, which employs convolutional and graph neural networks to learn local spatial characteristics induced by particles traversing the detector and the global behavior owing to shared backend circuit connections and housing boxes of the channels, respectively. Recurrent neural networks capture the temporal evolution of the extracted spatial features. We validate the accuracy of the proposed AD system in capturing diverse channel fault types using the LHC collision data sets. The GraphSTAD system achieves production-level accuracy and is being integrated into the CMS core production system for real-time monitoring of the HCAL. We provide a quantitative performance comparison with alternative benchmark models to demonstrate the promising leverage of the presented system.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Systematic improvement of trial states in phaseless auxiliary-field quantum Monte Carlo

We extend the use of coupled cluster (CC) trial states in the phaseless auxiliary-field quantum Monte Carlo (AFQMC) method beyond single and double excitations to include both triple and quadruple excitations. With this AFQMC/CC hierarchy, we are able to systematically benchmark the method's performance on molecular systems as the quality of the trial is improved. Our results show that the phaseless AFQMC energy improves systematically and is typically significantly more accurate than the energy of the underlying trial state. However, the relative improvement compared to the trial CC energy decreases as we ascend the CC hierarchy. As the CC wavefunction is usually further approximated when used as an AFQMC trial, we also explore the relationship between the components of the CC wavefunction and the resulting AFQMC/CC error. Our results suggest that improving the representation of the CC wave function in the AFQMC trial does not always lower the bias even when it increases the fidelity of the trial with the exact ground state.

Chemical Physics (physics.chem-ph)↗
DOE OSTI2014

eProject Builder

eProject Builder enables Energy Services Companies (ESCOs) and their contracting agencies to: 1. upload and track project-level Information 2. generate basic project reports required by local, state, and/or federal agencies 3. benchmark new Energy Savings Performance Contract (ESPC) projects against historical data

Source record↗
DOE OSTI2020

Design and Operability of a Pressurized Oxy Combustion System

Fossil fuel powers more than two-thirds of the world’s electricity, a significant share of which is derived from coal power plants. Despite coal being an abundant and energy-rich fuel, the major halt to its progress is greenhouse gas emissions. Pressurized oxy-combustion cycles can achieve theoretically high thermal efficiencies along with a 90% carbon capture rate. Additionally, the high energy density allows smaller turbomachinery and save capital cost. Thus, the primary objective of this dissertation is to present the design and operability of a pressurized oxy-combustor system. The initial part of the dissertation investigates different thermodynamic cycles and presents a model that can be adapted for existing power plants. The thermodynamic model will be used in the later part to design the proposed combustor. The two cycles analyzed are ENEL and TIPS. This study focuses on qualitative analyses of the cycles using a commercially available software called Aspen Plus®. A detailed benchmark study has been performed to validate the modeling process. ENEL and TIPS cycles are designed in the software, adopting the same principles. Recirculation ratio and pressures are varied to find the efficiency range of the cycles. Power calculations are done to find overall and net efficiency for a fixed recirculation ratio. The efficiencies of the cycles are compared to select an optimum cycle. A recirculation ratio of 50% is selected for implementation. The comparison shows that ENEL is marginally efficient over TIPS, at the cost of a pressure difference of about 70bars. Technology Readiness Level analysis is performed to present the availability of the specialized equipment for the cycles. From the TRL analysis, it is seen that the cost and availability of high viii pressure equipment surmount the edge of TIPS over ENEL. Thus, ENEL is chosen as the better cycle for investigating a scaled experiment considering efficiency and viability. The later part of the dissertation focuses on developing the combustor's design for a pressurized oxy-combustion cycle. The proposed combustor is a powerhead-mounted design aimed to produce 1MW of thermal outputThe different aspects of the design of a down-fired pressurized swirl combustor are presented in this dissertation.

Chowdhury, Mehrin↗
DOE OSTI2023

Measurement of the pion charge exchange differential cross section on Argon with the ProtoDUNE-SP detector

The Deep Underground Neutrino Experiment (DUNE) utilizes Liquid Argon Time Projection Chamber (LArTPC) technology in its pursuit of uncovering the origins of matter. As a crucial prototype for the DUNE far detector (FD) module, ProtoDUNE-SP at CERN Neutrino Platform Facility employs a hadron test beam with a momentum range of 0.3 to 7 GeV/c to study the detector response to particles that could be produced in the neutrino interactions at the DUNE FD. Furthermore, ProtoDUNE-SP is dedicated to testing event reconstruction and performing detector calibration under controlled conditions. Neutral pion reconstruction performance is an important benchmark of the calorimetric and tracking capability of LArTPC, and understanding neutral pion in LArTPC is crucial to characterize backgrounds to oscillation measurements and rare searches. To improve neutral pion reconstruction in LArTPC, a kinematic fitting algorithm is developed, achieving a 12% resolution in neutral pion energy in ProtoDUNE-SP. This enhancement enables the first measurements of the pion-argon charge exchange differential cross-section. By comparing these results with the current model, valuable constraints can be made to improve generator simulations in the future DUNE experiment.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Bayesian estimation of cross-section and errors of experiment and calculation for accurate prediction of neutronic characteristics

In some experiments, there might be a correlation of experimental errors such as an error caused by fabrication. The correlation of calculation errors also might exist among analyses of experiments. In the present study, considering these correlations, the cross-section and errors of experiment and calculation are adjusted for the accurate prediction of neutronic characteristics. The adjustment method is derived based on Bayesian theory. The 'a posteriori' distributions of cross-section and errors of experiment and calculation are obtained by the derivation. The case study is performed by using the benchmarks of light-water moderated experiments reported in ICSBEP. The error from fuel rod fabrication and measurement are included in the experiment error, and the error from the simplification of the benchmark model is included in the calculation error. Since these errors have a positive correlation among the benchmarks, the prediction accuracy is expected to be improved by considering these correlations. For the sensitivity analysis of the correlation among benchmarks, the correlation coefficient of experiment error and that of calculation error is assumed from 0.0 to 0.9. The results indicate that the prediction accuracy of the multiplication factor can be improved by increasing the correlation coefficient of experiment error and that of calculation error. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

AGR 1 and 2 Isotopic Depletion Validation

This presentation includes work performed developing a computational benchmark for the AGR 1 and 2 experiments. These experiments involve irradiation of TRISO particle compact in the Advanced Test Reactor (ATR). Many post-irradiation measurements were made from these experiments, including isotopic concentrations of fission products. The benchmark involves a MCNP-ORIGEN coupled model of the ATR and AGR experiment capsules to calculate a comprehensive inventory of fission product and actinide concentrations in the compacts. This presentation describes the experiments, the measurements obtained, the benchmark model, and results of the model evaluation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and their smaller counterparts, with the goal of replicating the representational qualities of larger models in smaller models. We observe a geometric phenomenon which we term embedding condensation, where token embeddings collapse into a narrow cone-like subspace in some language models. Through systematic analyses across multiple Transformer families, we show that small models such as GPT2 and Qwen3-0.6B exhibit severe condensation, whereas larger models such as GPT2-x1 and Qwen3-32B are more resistant to this phenomenon. Additional observations show that embedding condensation is not reliably mitigated by knowledge distillation from larger models. To fight against it, we formulate a dispersion loss that explicitly encourages embedding dispersion during training. Experiments demonstrate that it mitigates condensation, recovers dispersion patterns seen in larger models, and yields performance gains across 10 benchmarks. We believe this work offers a principled path toward improving smaller Transformers without additional parameters.

Xiao, Xi [ORNL] (ORCID:0009000009316982)↗
DOE OSTI2024

Democratizing uncertainty quantification

Uncertainty Quantification (UQ) is vital to safety-critical model-based analyses, but the widespread adoption of sophisticated UQ methods is limited by technical complexity. In this paper, we introduce UM-Bridge (the UQ and Modeling Bridge), a high-level abstraction and software protocol that facilitates universal interoperability of UQ software with simulation codes. It breaks down the technical complexity of advanced UQ applications and enables separation of concerns between experts. UM-Bridge democratizes UQ by allowing effective interdisciplinary collaboration, accelerating the development of advanced UQ methods, and making it easy to perform UQ analyses from prototype to High Performance Computing (HPC) scale. In addition, we present a library of ready-to-run UQ benchmark problems, all easily accessible through UM-Bridge. These benchmarks support UQ methodology research, enabling reproducible performance comparisons. We demonstrate UM-Bridge with several scientific applications, harnessing HPC resources even using UQ codes not designed with HPC support.

Benchmarks↗
DOE OSTI2019

Balancing Performance and Portability with Containers in HPC: An OpenSHMEM Example

There is a growing interest in using Linux containers to streamline software development and application deployment. A container enables the user to bundle the salient elements of the software stack from an application’s perspective. In this paper, we discuss initial experiences in using the Open MPI implementation of OpenSHMEM with containers on HPC resources. We provide a brief overview of two container runtimes, Docker & Singularity, highlighting elements that are of interest for HPC users. The Docker platform offers a rich set of services that are widely used in enterprise environments, whereas Singularity is an emerging container runtime that is specifically written for use on HPC systems. We describe our procedure for container assembly and deployment that strives to maintain the portability of the container-based application. We show performance results for the Graph500 benchmark running along the typical continuum of development testbed up to full production supercomputer (ORNL’s Titan). The results show consistent performance between the native and Singularity (container) tests. The results also showed an unexplained drop in performance when using the Cray Gemini network with Open MPI’s OpenSHMEM, which was unrelated to the container usage.

Naughton III, Thomas↗
DOE OSTI2023

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗
DOE OSTI2016

Technical Report: Benchmarking for Quasispecies Abundance Inference with Confidence Intervals from Metagenomic Sequence Data

The software application “MetaQuant” was developed by our group at Lawrence Livermore National Laboratory (LLNL). It is designed to profile microbial populations in a sample using data from whole-genome shotgun (WGS) metagenomic DNA sequencing. Several other metagenomic profiling applications have been described in the literature. We ran a series of benchmark tests to compare the performance of MetaQuant against that of a few existing profiling tools, using real and simulated sequence datasets. This report describes our benchmarking procedure and results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

Data Testing CIELO Evaluations with ICSBEP Benchmarks

We review criticality data testing performed at Los Alamos with a combination of ENDF/B-VII.1 + potential CIELO nuclear data evaluations. The goal of CIELO is to develop updated, best available evaluated nuclear data files for 1 H, 16 O, 56 Fe, 235,238 U and 239 Pu. because the major international evaluated nuclear data libraries don’t agree on the internal cross section details of these most important nuclides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2014

Benchmarking kinetic calculations of resistive wall mode stability

Validating the calculations of kinetic resistive wall mode (RWM) stability is important for confidently predicting RWM stable operating regions in ITER and other high performance tokamaks for disruption avoidance. Benchmarking the calculations of the Magnetohydrodynamic Resistive Spectrum—Kinetic (MARS-K) [Y. Liu et al., Phys. Plasmas 15, 112503 (2008)], Modification to Ideal Stability by Kinetic effects (MISK) [B. Hu et al., Phys. Plasmas 12, 057301 (2005)], and Perturbed Equilibrium Nonambipolar Transport (PENT) [N. Logan et al., Phys. Plasmas 20, 122507 (2013)] codes for two Solov'ev analytical equilibria and a projected ITER equilibrium has demonstrated good agreement between the codes. The important particle frequencies, the frequency resonance energy integral in which they are used, the marginally stable eigenfunctions, perturbed Lagrangians, and fluid growth rates are all generally consistent between the codes. The most important kinetic effect at low rotation is the resonance between the mode rotation and the trapped thermal particle's precession drift, and MARS-K, MISK, and PENT show good agreement in this term. The different ways the rational surface contribution was treated historically in the codes is identified as a source of disagreement in the bounce and transit resonance terms at higher plasma rotation. Calculations from all of the codes support the present understanding that RWM stability can be increased by kinetic effects at low rotation through precession drift resonance and at high rotation by bounce and transit resonances, while intermediate rotation can remain susceptible to instability. The applicability of benchmarked kinetic stability calculations to experimental results is demonstrated by the prediction of MISK calculations of near marginal growth rates for experimental marginal stability points from the National Spherical Torus Experiment (NSTX) [M. Ono et al., Nucl. Fusion 40, 557 (2000)].

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗