Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

Predicting Cost/Performance Trade-Offs for Whitney: A Commodity Computing Cluster

Recent advances in low-end processor and network technology have made it possible to build a "supercomputer" out of commodity components. We develop simple models of the NAS Parallel Benchmarks version 2 (NPB 2) to explore the cost/performance trade-offs involved in building a balanced parallel computer supporting a scientific workload. We develop closed form expressions detailing the number and size of messages sent by each benchmark. Coupling these with measured single processor performance, network latency, and network bandwidth, our models predict benchmark performance to within 30%. A comparison based on total system cost reveals that current commodity technology (200 MHz Pentium Pros with 100baseT Ethernet) is well balanced for the NPBs up to a total system cost of around $1,000,000.

Becker, Jeffrey C.↗
DOE OSTI2023

Fast and accurate reduced-order modeling of a MOOSE-based additive manufacturing model with operator learning

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on existing simulation tools employed in AM. The goal of the present work is to construct a fast and accurate reduced-order model (ROM) for an AM model developed within the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, ultimately reducing the time/cost of AM control and optimization processes. Our adoption of the operator learning (OL) approach enabled us to learn a family of differential equations produced by altering process variables in the laser’s Gaussian point heat source. More specifically, we used the Fourier neural operator (FNO) and deep operator network (DeepONet) to develop ROMs for time-dependent responses. Furthermore, we benchmarked the performance of these OL methods against a conventional deep neural network (DNN)-based ROM. Ultimately, we found that OL methods offer comparable performance and, in terms of accuracy and generalizability, even outperform DNN at predicting scalar model responses. The DNN-based ROM afforded the fastest training time. Furthermore, all the ROMs were faster than the original MOOSE model yet still provided accurate predictions. FNO had a smaller mean prediction error than DeepONet, with a larger variance for time-dependent responses. Unlike DNN, both FNO and DeepONet were able to simulate time series data without the need for dimensionality reduction techniques. Finally, the present work can help facilitate the AM optimization process by enabling faster execution of simulation tools while still preserving evaluation accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A sensitivity analysis to predict the neutronics behavior of samples irradiated in the VTR rabbit system

We report a low-order neutronics model is developed to carry out hundreds of simulations efficiently and investigate the neutronics behavior of samples being irradiated in a test reactor setting under different geometrical constraints. The low-order model allowed for simulations that yield the expected neutronics behavior of any irradiated sample in any environment and allows for the calculation of highly accurate spatially averaged statistics and idealized spatial distributions in the neutron flux. Several benchmarks are performed to evaluate the performance and limitations of the low-order model revealing many important findings. The low-order model predicted the LHGR in the EBR-II driver fuel to within 2.34% by only simulating the fuel rod by itself, which served as a validation for the model. Sensitivity studies investigated 3% enriched UO 2 and U-10Zr being irradiated in the Versatile Test Reactor rabbit system. The analyses investigated a range of combinations of 15 radii and 5 heights for each sample in the rabbit system. Similar data sets are also provided for irradiations in the Advanced Test Reactor’s B-10 irradiation position, which is a thermal neutron spectrum environment. Generalized fits and fit coefficients are obtained for sample heating, reaction rate densities, and local multiplication rate characteristics, allowing the predictions of the neutronics behavior of the samples based on their geometrical constraints. The analyses and fits laid the groundwork for developing a user-end Multiphysics analysis framework to assist and accelerate irradiation experiment design and optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

A quantitative and holistic circular economy assessment framework at the micro level

Circular Economy (CE) aims to solve resource, waste, and emission challenges by creating a production-to-consumption supply chain that is restorative and environmentally benign. A variety of metrics has been developed with the focus mainly on the macro and meso levels. This work introduces a micro level CE assessment framework that provides i) a set of indicators and metrics with sector-specific dimensions, ii) quantitative and holistic CE overall and category-based metrics, iii) media for data visualization and analysis of CE indicators, and iv) an analytical tool to assess multi-national businesses and the multi-scale and interconnected CE supply chains. Using this quantitative tool, companies are able to track their transition towards CE, conduct temporal analysis, and benchmark their performance against their peers and industry’s standards. The applicability and the capabilities of the developed CE assessment framework is demonstrated through three case studies, with the results demonstrating a clear trend towards circularity.

42 ENGINEERING↗
DOE OSTI2026

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗
DOE OSTI2026

Rapid neutron and gamma-ray source localization using machine learning

Rapid localization of radiation sources is critical for applications including nuclear emergency response, safeguards, and security. However, conventional imaging systems such as neutron scatter cameras and Compton cameras depend on rare coincidence events, which often result in long acquisition times. In this work, we address the challenge of rapid source localization by developing a machine learning approach to predict the direction of a single radiation source using only count rates from an array of neutron and gamma-ray detectors. The proposed model is a fully connected neural network (FCNN) trained using Monte Carlo simulation data from a 252 Cf source. The model hyperparameters are optimized with a small set of routine 252 Cf measurements. We benchmarked the performance of the trained and optimized machine learning model using additional 252 Cf , 137 Cs , and PuBe measurements under laboratory conditions with varying source-detector configurations. For these measurements, the machine learning model achieved a mean localization error smaller than 30° with 3 x 10 3 system counts, corresponding to 8 s measurement time for the imaging system used in this work. In this low-statistics regime, the method outperformed traditional scatter-based imaging by more than 75% in localization accuracy for the evaluated measurement configurations. These results demonstrate that a machine learning-based approach can significantly reduce the time required for accurate single-source localization, providing a robust and computationally efficient alternative to traditional imaging systems in time-critical nuclear security and emergency response scenarios.

Gamma-ray imaging↗
DOE OSTI2023

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗
DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗
DOE OSTI2020

Electromagnetic full-$f$ gyrokinetics in the tokamak edge with discontinuous Galerkin methods

Here, we present an energy-conserving discontinuous Galerkin scheme for the full-f electromagnetic gyrokinetic system in the long-wavelength limit. We use the symplectic formulation and solve directly for ∂A II /∂t, the inductive component of the parallel electric field, using a generalized Ohm’s law derived directly from the gyrokinetic equation. Linear benchmarks are performed to verify the implementation and show that the scheme avoids the Amp`ere cancellation problem. We perform a nonlinear electromagnetic simulation in a helical open-field-line system as a rough model of the tokamak scrape-off layer using parameters from the National Spherical Torus Experiment (NSTX). This is the first published nonlinear electromagnetic gyrokinetic simulation on open field lines. Comparisons are made to a corresponding electrostatic simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

QC-GN 2 oMS 2 : a Graph Neural Net for High Resolution Mass Spectra Prediction

Predicting the mass spectrum of a molecular ion is often accomplished via three generalized approaches: rules-based methods for bond breaking, deep learning, or quantum chemical (QC) modeling. Rules-based approaches are often limited by the conditions for different chemical subspaces and perform poorly under chemical regimes with few defined rules. QC modeling is theoretically robust but requires significant amounts of computational time to produce a spectrum for a given target. Among deep learning techniques, graph neural networks (GNNs) have performed better than previous work with fingerprint-based neural networks in mass spectra prediction. To explore this technique further, we investigate the effects of including quantum chemically derived information as edge features in the GNN to increase predictive accuracy. The models we investigated include categorical bond order, bond force constants derived from extended tight-binding (xTB) quantum chemistry, and acyclic bond dissociation energies. Throughout this work, we evaluated these models against a control GNN with no edge features in the input graphs. Bond dissociation enthalpies yielded the best improvement with a cosine similarity score of 0.462 relative to the baseline model (0.437). In this work we also apply dynamic graph attention which improves performance on benchmark problems and supports the inclusion of edge features. Between implementations, we investigate the nature of the molecular embedding for spectra prediction and discuss the recognition of fragment topographies in distinct chemistries for further development in tandem mass spectrometry prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Benchmarking an Embedded Adaptive Sampling Configuration Interaction Method for Surface Reactions: H 2 Desorption from and CH 4 Dissociation on Cu(111)

Embedded (emb-) correlated wavefunction (CW) theory enables accurate assessments of both ground- and excited-state reaction mechanisms involved in heterogeneous catalysis. Embedded multireference second-order perturbation theory (emb-MRPT2) based on reference wavefunctions generated via embedded complete active space self-consistent field (emb-CASSCF) theory is currently state-of-the-art. However, the factorial scaling of CASSCF limits the size of active space and the complexity of systems that can be studied. In this work, we assess the efficacy of an alternative CW method, adaptive sampling configuration interaction (ASCI)–which enables large active spaces to be used–for studying surface reactions. We couple ASCI with density functional embedding theory (DFET) and benchmark its performance for two reactions: H 2 desorption from and CH 4 dissociation on the Cu(111) surface. Unlike embedded complete active space second-order perturbation theory (emb-CASPT2) that accurately reproduces a measured H 2 desorption barrier, embedded ASCI, using a very large active space (though one that still comprises a small portion of the full set of orbitals) fails to do so. Adding an extra correlation term from embedded Møller–Plesset second-order perturbation theory (emb-MP2) improves the desorption barrier and endothermicity predictions. Thus, the inaccuracy of embedded ASCI comes from the missing dynamic correlation from the many other electrons and orbitals not included in the active space. For CH 4 dissociation, again embedded ASCI overestimates the dissociation barrier compared to emb-CASPT2 predictions. Adding dynamic correlation from emb-MP2 helps correct the barrier. However, this composite approach suffers from double counting of correlation within embedded ASCI followed by emb-MP2 calculations. We therefore conclude that the state-of-the-art emb-MRPT2 based on reference wavefunctions generated via emb-CASSCF remains the method of choice for studying surface reactions. emb-ASCI is useful when large active spaces beyond the limit of emb-CASSCF are essential, such as to study complex surface reactions with significant multiconfigurational character (static correlation) but weak dynamic correlation.

08 HYDROGEN↗
DOE OSTI2025

Liquid–Vapor Phase Equilibrium in Molten Aluminum Chloride (AlCl 3 ) Enabled by Machine Learning Interatomic Potentials

Molten salts are promising candidates in numerous clean energy applications, where knowledge of thermophysical properties and vapor pressure across their operating temperature ranges is critical for safe operations. Due to challenges in evaluating these properties using experimental methods, fast and scalable molecular simulations are essential to complement the experimental data. In this study, we developed machine learning interatomic potentials (MLIP) to study the AlCl 3 molten salt across varied thermodynamic conditions (T = 473–613 K and P = 2.7–23.4 bar), which allowed us to predict temperature-surface tension correlations and liquid–vapor phase diagram from direct simulations of two-phase coexistence in this molten salt. Two MLIP architectures, a Kernel-based potential and neural network interatomic potential (NNIP), were considered to benchmark their performance for AlCl 3 molten salt using experimental structure and density values. The NNIP potential employed in two-phase equilibrium simulations yields the critical temperature and critical density of AlCl 3 that are within 10 K (∼3%) and 0.03 g/cm 3 (∼7%) of the reported experimental values. An accurate correlation between temperature and viscosities is obtained as well. In doing so, we report that the inclusion of low-density configurations in their training is critical to more accurately represent the AlCl 3 system across a wide phase-space. The MLIP trained using PBE-D3 functional in the ab initio molecular dynamics (AIMD) simulations (120 atoms) also showed close agreement with experimentally determined molten salt structure comprising Al 2 Cl 6 dimers, as validated using Raman spectra and neutron structure factor. Furthermore, the PBE-D3 as well as its trained MLIP showed better liquid density and temperature correlation for AlCl 3 system when compared to several other density functionals explored in this work. Overall, the demonstrated approach to predict temperature correlations for liquid and vapor densities in this study can be employed to screen nuclear reactors-relevant compositions, helping to mitigate safety concerns.

Ab initio molecular dynamics↗
DOE OSTI2025

Quantum Monte Carlo Benchmarking of Molecular Adsorption on Graphene-Supported Single Pt Atom

The precise understanding of adsorption energetics and molecular geometry at catalytic sites is fundamental for advancing catalysis, particularly under the constraints of resource efficiency and environmental sustainability. Here, this study benchmarks the performance of density functional theory (DFT) calculations against diffusion Monte Carlo (DMC) calculations for adsorption properties of small gas molecules relevant to CO oxidation—namely O 2 , CO, CO 2 , and atomic oxygen—on a single Pt atom supported by pristine graphene. Our findings reveal that DMC calculations provide a significantly different landscape of adsorption energetics compared to DFT results. Notably, DFT predicts different lowest-energy configurations and spin states, particularly for O 2 , which suggests potential discrepancies in predicting the catalytic behavior. Furthermore, this study identifies the critical issue of CO poisoning, highlighted by the large disparity between the DMC adsorption energies of O 2 (−1.23(2) eV) and CO (−3.37(1) eV), which can inhibit the catalytic process. These results emphasize the necessity for more sophisticated computational approaches in catalysis research, aiming to refine the prediction accuracy of reaction mechanisms and to enhance the design of more effective catalysts.

Ahn, Jeonghwan [University of Illinois at Urbana-C↗
DOE OSTI2026

Comparing Liquid Vortex Capture & the Rapid Droplet Sampling Interface for Single Cell Mass Spectrometry

High-throughput single-cell mass spectrometry is a rapidly evolving field that requires innovative sampling and ionization techniques to balance speed, sensitivity, and reliability for metabolomic and lipidomic analyses. This study provides a comparative analysis of two cutting-edge ionization platforms for single-cell analysis: Liquid Vortex Capture (LVC) and Rapid Droplet Sampling Interface (RDSI). The performance was benchmarked by testing pharmaceuticals, EquiSPLASH, and single-cell experiments. RDSI demonstrated up to 100-fold improvements in sensitivity for drugs and lipids such as propranolol, amiodarone, atorvastatin, and phosphocholines in water and phosphate-buffered solutions. This was attributed to its low-flow rate operation (3 μL/min) and reduced dilution. Conversely, LVC excelled in handling higher liquid volumes with greater reproducibility due to its higher solvent flow rate (200 μL/min), enabling increased dilution, solubility, and cleaning. Single-cell uptake of atorvastatin incubated for 10 min, or amiodarone incubated for 24 h in HepG2 cells, similarly revealed up to 85-fold enhancement in sensitivity by RDSI for drugs and lipids. These findings highlight the potential of RDSI for enhancing sensitivity in single-cell drug monitoring and lipidomics.

Cahill, John [ORNL] (ORCID:0000000298664010)↗
DOE OSTI2024

Trends and Drivers of Terrestrial Sources and Sinks of Carbon Dioxide: An Overview of the TRENDY Project

The terrestrial biosphere plays a major role in the global carbon cycle, and there is a recognized need for regularly updated estimates of land-atmosphere exchange at regional and global scales. An international ensemble of Dynamic Global Vegetation Models (DGVMs), known as the “Trends and drivers of the regional scale terrestrial sources and sinks of carbon dioxide” (TRENDY) project, quantifies land biophysical exchange processes and biogeochemistry cycles in support of the annual Global Carbon Budget assessments and the REgional Carbon Cycle Assessment and Processes, phase 2 project. DGVMs use a common protocol and set of driving data sets. A set of factorial simulations allows attribution of spatio-temporal changes in land surface processes to three primary global change drivers: changes in atmospheric CO 2 , climate change and variability, and Land Use and Land Cover Changes (LULCC). Here, we describe the TRENDY project, benchmark DGVM performance using remote-sensing and other observational data, and present results for the contemporary period. Simulation results show a large global carbon sink in natural vegetation over 2012–2021, attributed to the CO 2 fertilization effect (3.8 ± 0.8 PgC/yr) and climate (–0.58 ± 0.54 PgC/yr). Forests and semi-arid ecosystems contribute approximately equally to the mean and trend in the natural land sink, and semi-arid ecosystems continue to dominate interannual variability. The natural sink is offset by net emissions from LULCC (–1.6 ± 0.5 PgC/yr), with a net land sink of 1.7 ± 0.6 PgC/yr. Despite the largest gross fluxes being in the tropics, the largest net land-atmosphere exchange is simulated in the extratropical regions.

58 GEOSCIENCES↗
DOE OSTI2025

Quantum annealing for combinatorial optimization: a benchmarking study

Quantum annealing (QA) has the potential to significantly improve solution quality and reduce time complexity in solving combinatorial optimization problems compared to classical optimization methods. However, due to the limited number of qubits and their connectivity, the QA hardware did not show such an advantage over classical methods in past benchmarking studies. Recent advancements in QA with more than 5000 qubits, enhanced qubit connectivity, and the hybrid architecture promise to realize the quantum advantage. Here, we use a quantum annealer with state-of-the-art techniques and benchmark its performance against classical solvers. To compare their performance, we solve over 50 optimization problem instances represented by large and dense Hamiltonian matrices using quantum and classical solvers. The results demonstrate that a state-of-the-art quantum solver has higher accuracy (~0.013%) and a significantly faster problem-solving time (~6561×) than the best classical solver. Our results highlight the advantages of leveraging QA over classical counterparts, particularly in hybrid configurations, for achieving high accuracy and substantially reduced problem solving time in large-scale real-world optimization problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Plug-and-play polymer microfluidic chips for hydrated, room temperature, fixed-target serial crystallography

The practice of serial X-ray crystallography (SX) depends on efficient, continuous delivery of hydrated protein crystals while minimizing background scattering. Of the two major types of sample delivery devices, fixed-target devices offer several advantages over widely adopted jet injectors, including: lower sample consumption, clog-free delivery, and the ability to control on-chip crystal density to improve hit rates. In this study we present our development of versatile, inexpensive, and robust polymer microfluidic chips for routine and reliable room temperature serial measurements at both synchrotrons and X-ray free electron lasers (XFELs). Our design includes highly X-ray-transparent enclosing thin film layers tuned to minimize scatter background, adaptable sample flow layers tuned to match crystal size, and a large sample area compatible with both raster scanning and rotation based serial data collection. The optically transparent chips can be used both for in situ protein crystallization (to eliminate crystal handling) or crystal slurry loading, with prepared samples stable for weeks in a humidified environment and for several hours in ambient conditions. Serial oscillation crystallography, using a multi-crystal rotational data collection approach, at a microfocus synchrotron beamline (SSRL, beamline 12-1) was used to benchmark the performance of the chips. Furthermore, high-resolution structures (1.3–2.7 Å) were collected from five different proteins – hen egg white lysozyme, thaumatin, bovine liver catalase, concanavalin-A (type VI), and SARS-CoV-2 nonstructural protein NSP5. Overall, our modular fabrication approach enables precise control over the cross-section of materials in the X-ray beam path and facilitates chip adaption to different sample and beamline requirements for user-friendly, straightforward diffraction measurements at room temperature.

59 BASIC BIOLOGICAL SCIENCES↗