Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Quantification of silicon carbide grain structure in TRISO fuel by BSE image analysis

The grain structure of the silicon carbide (SiC) layer in tristructural-isotropic (TRISO) fuels has commonly been qualified in fuel specifications based on a qualitative comparison to visual standards to ensure undesirable microstructure are not produced. This approach is inherently dependent on subjective judgement and provides limited data for analysis or comparison. An alternative method to rapidly quantify (i.e., provide a numeric measure of) the grain structure of the SiC layer in TRISO fuels has been developed. This method relies on the identification of silicon carbide grain boundaries based on brightness variation in backscattered electron (BSE) images through the application of automated image processing algorithms. The speed with which the requisite BSE imaging and analysis may be completed enables the practical use of this method on an industrial scale as a part of qualifying TRISO fuel to meet a given specification on silicon carbide grain structure, which is an important parameter for TRISO fuel performance. The method is benchmarked by comparison to prior Electron-Backscattered Diffraction (EBSD) results for TRISO particles from the Advanced Gas Reactor (AGR) program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Benchmarking Coordination Number Prediction Algorithms on Inorganic Crystal Structures

Coordination numbers and geometries form a theoretical framework for understanding and predicting materials properties. Algorithms to determine coordination numbers automatically are increasingly used for machine learning and automatic structural analysis. In this work, we introduce MaterialsCoord, a benchmark suite containing 56 experimentally-derived crystal structures (spanning elements, binaries, and ternary compounds) and their corresponding coordination environments as described in the research literature. We also describe CrystalNN, a novel algorithm for determining near neighbors. We compare CrystalNN against 7 existing near-neighbor algorithms on the MaterialsCoord benchmark, finding CrystalNN to perform similarly to several well-established algorithms. For each algorithm, we also assess computational demand and sensitivity towards small perturbations that mimic thermal motion. Finally, we investigate the similarity between bonding algorithms when applied to the Materials Project database. Finally, we expect that this work will aid the development of coordination prediction algorithms as well as improve structural descriptors for machine learning and other applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Comparative Density Functional Theory Study of Magnetic Exchange Couplings in Dinuclear Transition-Metal Complexes

Multicenter transition-metal complexes (MCTMs) with magnetically interacting ions have been proposed as components for information-processing devices and storage units. For any practical application of MCTMs as magnetic units, it is crucial to characterize their magnetic behavior, and in particular, the isotropic magnetic exchange coupling, J, between its magnetic centers. Due to the large size of typical MCTMs, density functional theory is the only practical electronic structure method for evaluating the J coupling. Here, we assess the accuracy of different density functional approximations for predicting the magnetic couplings of eight dinuclear transition-metal complexes, including five dimanganese, two dicopper, and one divanadium with known reliable experimental J couplings spanning from ferromagnetic to strong antiferromagnetic. The density functionals considered include global hybrid functionals which mix semilocal density functional approximations and exact exchange with a fixed admixing parameter, six local hybrid functionals where the admixing parameters are extended to be spatially dependent, the SCAN and r 2 SCAN meta-generalized gradient approximations (GGAs), and two widely used GGAs. We found that global hybrids tested in this work have a tendency to over-correct the error in magnetic coupling parameters from the Perdew–Burke–Ernzerhof (PBE) GGA as seen for manganese complexes. The performance of local hybrid density functionals shows no improvement in terms of bias and is scattered without a clear trend, suggesting that more efforts are needed for the extension from global to local hybrid density functionals for this particular property. The SCAN and r 2 SCAN meta-GGAs are found to perform as well as benchmark global hybrids on most tested complexes. We further analyze the charge density redistribution of meta-GGAs as well as global and local hybrid density functionals with respect to that of PBE, in connection to the self-interaction error or delocalization error.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Completely Multipolar Model for Many-Body Water–Ion and Ion–Ion Interactions

This work constructs an advanced force field, the Completely Multipolar Model (CMM), to quantitatively reproduce each term of an energy decomposition analysis (EDA) for aqueous solvated alkali metal cations and halide anions and their ion pairings. We find that all individual EDA terms remain well-approximated in the CMM for ion-water and ion-ion interactions, except for polarization, which shows errors due to the partial covalency of ion interactions near their equilibrium. We quantify the onset of the dative bonding regime by examining the change in molecular polarizability and Mayer bond indices as a function of distance, showing that partial covalency manifests by breaking the symmetry of atomic polarizabilities while strongly damping them at short-range. This motivates an environment-dependent atomic polarizability parameter that depends on the strength of the local electric field experienced by the ions to account for strong damping, with anisotropy introduced by atomic multipoles. The resulting CMM model for ions provides accurate dimer surfaces and three-body polarization and charge transfer compared to EDA, and shows excellent performance on various ion benchmarks including vibrational frequencies and cluster geometries.

Heindel, Joseph P↗
DOE OSTI2026

Thermally Stable Co@C3N4 Single-Atom Catalysts for CO Oxidation: Atomic-Level Insights into Structure and Activity

Single Co atoms supported on C3N4 (Co@C3N4) have demonstrated high activity and selectivity in photocatalysis. However, the investigation of structure–function relationships and reaction mechanisms under photocatalytic conditions is very challenging due to the complex conditions of light absorption, charge transfer, and catalysis. In this study, we employed thermal CO oxidation as a prototypical probe reaction to benchmark the intrinsic catalytic performance and track the active-site evolution of Co@C3N4. Single Co atoms were identified and shown to be the catalytically active sites for CO oxidation based on control experiments and isotope-labeling experiments. The Co sites remained atomically dispersed before, during, and after the reaction with temperatures up to 400 °C, as established by in situ X-ray absorption fine structure (XAFS) combined with density functional theory (DFT), FDMNES simulations, and dynamic-time-warping (DTW)-assisted X-ray absorption near edge structure (XANES) matching. Together with theoretical calculations, the integrated analysis reveals a stable coordination environment under reaction conditions, which correlates with sustained activity, establishing Co@C3N4 single-atom catalysts as thermally stable CO oxidation catalysts. Beyond these findings, the current study provides a workflow for unambiguously assigning active sites in Co@C3N4 for thermal CO oxidation. This workflow will aid the understanding of their behavior in photocatalysis in the future, where light-driven dynamics obscure direct structure–function links. Notably, this study provides fundamental insights for the rational design of robust single-atom catalysts and a foundation for the broader application of Co@C3N4 catalysts in oxidation reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

A Lens into the Cu Nanograin by In Situ Vibrational Spectroscopy

Cu-based catalysts are uniquely capable of C-C coupling during electrochemical CO 2 reduction (CO 2 R), yet further mechanistic understanding remains hampered by the lack of spectroscopically resolved descriptors that demonstrate how surface adsorbates emerge and evolve within their catalytic environment. Here, in this study, we correlate in situ surface-enhanced Raman spectroscopy (SERS) and surface-enhanced infrared absorption spectroscopy (SEIRAS) to resolve the potential-dependent dynamics during CO 2 R on Cu nanograin catalysts. By building on previous benchmarking of low overpotential performance and nanograin structural evolution, we offer a diagnostic framework linking vibrational signatures to catalytic function, unveiling which species appear, persist, and turnover as the electrified surface and interfacial environment evolve under bias. The onset of linear CO is marked below -0.45 V, coincident with persistent adsorbed *OH/*O domains beyond the CO 2 R onset. In this context, Cu nanograins serve as a platform to dissect contributions of adsorbate coverage. By carefully dissecting the potential dependence of emergent twin-defect/step CO stretch bands (P1-P2), alongside the prototypical terrace-site CO stretch band (P3), we provide important context for interpreting coupled spectroscopic trends driven by coverage effects and resolve this for the evidently complex nanograin morphology. Together, these observations highlight the intertwined roles of surface stabilization and interfacial flux in steering multicarbon product formation. By directly linking vibrational signatures to catalytic behavior, this work aims to bridge the gap between observation and control and help guide toward a predictive framework of fine-tuned selectivity for CO 2 R.

Fonseca Guzman, Maria V. [University of California↗
DOE OSTI2019

Mathematical Reconstruction of Land Carbon Models From Their Numerical Output: Computing Soil Radiocarbon From C Dynamics

Radiocarbon ( 14 C) is a powerful tracer of the global carbon cycle that is commonly used to assess carbon cycling rates in various Earth system reservoirs and as a benchmark to assess model performance. Therefore, it has been recommended that Earth System Models (ESMs) participating in the Coupled Model Intercomparison Project Phase 6 report predicted radiocarbon values for relevant carbon pools. However, a detailed representation of radiocarbon dynamics may be an impractical burden on model developers. Here, we present an alternative approach to compute radiocarbon values from the numerical output of an ESM that does not explicitly represent these dynamics. The approach requires computed 12 C stocks and fluxes among all carbon pools for a particular simulation of the model. From this output, a time-dependent linear compartmental system is computed with its respective state-transition matrix. Using transient atmospheric 14 C values as inputs, the state-transition matrix is then applied to compute radiocarbon values for each pool, the average value for the entire system, and component fluxes. We demonstrate the approach with ELMv1-ECA, the land component of an ESM model that explicitly represents 12 C, and 14 C in 7 soil pools and 10 vertical layers. Results from our proposed method are highly accurate (relative error <0.01%) compared with the ELMv1-ECA 12 C and 14 C predictions, demonstrating the potential to use this approach in CMIP6 and other model simulations that do not explicitly represent 14 C.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Data from a multi-year targeted proteomics study of a longitudinal birth cohort of type 1 diabetes

The deployment of liquid chromatography-mass spectrometry-based plasma proteomics experiments in a large cohort is sparse, leading to a lack of data available for benchmarking, method development or validation. Comprised of 6,426 plasma analyses, The Environmental Determinants of Diabetes in the Young (TEDDY) proteomics validation study constitutes one of the largest targeted proteomics experiments in the literature to date. The proteomics data from this study were generated over the course of 2.5 years from over 900 study subjects, each providing up to 29 longitudinal samples. The data also includes 916 quality control samples. The targeted mass spectrometry assay was comprised of 694 peptides mapping to 167 proteins and the panel was measured in each subject and QC sample. The targeted proteomic dataset presented here can be used as a resource for new computational method development, such as for batch correction, as well as for benchmarking and comparing the performance of different methods/tools.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Extension of frozen natural orbital approximation to open-shell references: Theory, implementation, and application to single-molecule magnets

Natural orbitals are often used to achieve a more compact representation of correlated wave-functions. Using natural orbitals computed as eigenstates of the virtual–virtual block of the state density matrix instead of the canonical Hartree–Fock orbitals results in smaller errors when the same fraction of virtual space is frozen. This strategy, termed frozen natural orbital (FNO) approach, is effective in reducing the cost of regular coupled-cluster (CC) calculations and some multistate methods, such as EOM-IP-CC (equation-of-motion CC for ionization potentials). This contribution extends the FNO approach to the EOM-SF-CC ansatz (EOM-CC with spin-flip). In contrast to EOM-IP-CCSD, EOM-SF-CCSD relies on high-spin open-shell references. Using FNOs computed for an open-shell reference leads to an erratic behavior of the EOM-SF-CC energies and properties due to an inconsistent truncation of the α and β orbital spaces. A general solution to problems arising in the EOM-CC calculations utilizing open-shell references, termed OSFNO (open-shell FNO), is proposed. Furthermore, by means of singular value decomposition (SVD) of the overlap matrix of the α and β orbitals, the OSFNO algorithm identifies the corresponding orbitals and determines virtual orbitals corresponding to the singly occupied space. This is followed by SVD of the singlet part of the state density matrix in the remaining virtual orbital subspace. The so-computed FNOs preserve the spin purity of the open-shell orbital subspace to the extent allowed by the original reference, thus facilitating a safe truncation of the virtual space. The performance of OSFNO is benchmarked for selected diradicals and triradicals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Hybrid-gyrokinetic simulations of low- n toroidal Alfvén eigenmodes using gKPSP

Here, we report a benchmark study of toroidal Alfvén eigenmode (TAE) simulation using the hybrid-gyrokinetic code GyroKinetic Plasma Simulation Program (gKPSP). A simulation capability for energetic particles based on the gyrokinetic δf method has been newly implemented in the gKPSP code. Benchmark simulations have been performed in both circular and realistic tokamak geometries. Good agreement has been found with previously reported results, demonstrating the new capability of the gKPSP code. We have investigated the effects of the distribution function on TAE stability by examining both isotropic and anisotropic slowing-down distributions of energetic particles. The slowing-down distribution produces a higher linear growth rate than a Maxwellian distribution, while a growth rate scan with the anisotropy shows an opposite trend. This can be attributed to competition between Landau damping and the linear drive, which are correlated with the fraction of resonant passing particles and their distribution in phase space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Bayesian experimental design and parameter estimation for ultrafast spin dynamics

Abstract Advanced experimental measurements are crucial for driving theoretical developments and unveiling novel phenomena in condensed matter and materials physics, which often suffer from the scarcity of large-scale facility resources, such as x-ray or neutron scattering centers. To address these limitations, we introduce a methodology that leverages the Bayesian optimal experimental design paradigm to efficiently uncover key quantum spin fluctuation parameters from x-ray photon fluctuation spectroscopy (XPFS) data. Our method is compatible with existing theoretical simulation pipelines and can also be used in combination with fast machine learning surrogate models in the event that real-time simulations are unfeasible. Our numerical benchmarks demonstrate the superior performance in predicting model parameters and in delivering more informative measurements within limited experimental time. Our method can be adapted to many different types of experiments beyond XPFS and spin fluctuation studies, facilitating more efficient data collection and accelerating scientific discoveries.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

The ballad of LLM agents: philosophical reasoning for chemistry

Large language models (LLMs) show remarkable potential for scientific reasoning but often produce unreliable or scientifically unactionable outputs when faced with multi-step logic, domain grounding, and interpretability challenges, especially in complex fields like chemistry and materials science. Here, we introduce a framework of philosophical reasoning agents, inspired by canonical thinkers such as Socrates, Descartes, Kant, and Hume, to guide LLM behavior via structured prompt engineering. These agents embody distinct reasoning paradigms (dialectical inquiry, deductive logic, rule-based judgment, and empirical validation) and are evaluated across multiple chemistry subdomains, physical, analytical, general, inorganic, and organic chemistry, using the ChemBench benchmark. Our agentic prompting approach yields substantial accuracy gains on open-ended numerical chemistry questions, with gains of +11.5 percentage points for GPT-4o with Hume, +4.5 percentage points for GPT-5 with Kant, and +21.8 percentage points for GPT-5.1 with Socrates at the strict 1% error threshold, relative to the corresponding base models. Beyond accuracy, we observe benchmark-level model–agent performance patterns, suggesting that different prompting styles interact differently with each base model. These findings demonstrate that embedding philosophy-of-science principles into multi-agent frameworks can improve and produce interpretable, adaptive, and domain-aligned scientific LLMs.

Harb, Hassan [Argonne National Laboratory (ANL), A↗
DOE OSTI2025

Desmearing small-angle scattering data by central moment expansions of instrument resolution

This study introduces an enhanced numerical technique tailored specifically for refining 1D small-angle scattering (SAS) intensity profiles affected by smearing. Our primary objective is to address the resolution blurring commonly encountered in SAS data, particularly in systems with clearly defined correlation peaks whose spread aligns with the width of the resolution function at corresponding Q positions. Unlike previous approaches that expanded the SAS intensity using central moment expansion, the new method focuses on expanding the resolution function itself, thus eliminating artificial oscillations observed in smeared spectra due to limitations inherent in our earlier algorithm. This method is straightforward to implement, computationally efficient and consistently performs well in numerical benchmarking. To illustrate its effectiveness, we present a case study of a lamellar phase characterized by distinct peaks in its small-angle neutron scattering intensities.

central moment expansions↗
DOE OSTI2020

A fixed-target platform for serial femtosecond crystallography in a hydrated environment

For serial femtosecond crystallography at X-ray free-electron lasers, which entails collection of single-pulse diffraction patterns from a constantly refreshed supply of microcrystalline sample, delivery of the sample into the X-ray beam path while maintaining low background remains a technical challenge for some experiments, especially where this methodology is applied to relatively low-ordered samples or those difficult to purify and crystallize in large quantities. This work demonstrates a scheme to encapsulate biological samples using polymer thin films and graphene to maintain sample hydration in vacuum conditions. The encapsulated sample is delivered into the X-ray beam on fixed targets for rapid scanning using the Roadrunner fixed-target system towards a long-term goal of low-background measurements on weakly diffracting samples. As a proof of principle, we used microcrystals of the 24 kDa rapid encystment protein (REP24) to provide a benchmark for polymer/graphene sandwich performance. The REP24 microcrystal unit cell obtained from our sandwiched in-vacuum sample was consistent with previously established unit-cell parameters and with those measured by us without encapsulation in humidified helium, indicating that the platform is robust against evaporative losses. While significant scattering from water was observed because of the sample-deposition method, the polymer/graphene sandwich itself was shown to contribute minimally to background scattering.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Coarse Mesh Finite Difference Acceleration for Pebble Tracking Transport in Griffin

We implemented a coarse mesh finite difference (CMFD) for accelerating transport calculations with PTT (pebble tracking transport) in the Griffin code. More specifically, extensions for transport update with the consideration of scattering operator and CMFD projection were implemented for PTT. The implementation was verified with a simplified PBR (pebble bed reactor) benchmark problem and significant performance improvements in CPU time was observed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

ECP Report: Update on Proxy Applications and Vendor Interactions

The ExaLearn miniGAN team (Ellis and Rajamanickam) have released miniGAN, a generative adversarial network(GAN) proxy application, through the ECP proxy application suite. miniGAN is the first machine learning proxy application in the suite (note: the ECP CANDLE project did previously release some benchmarks) and models the performance for training generator and discriminator networks. The GAN's generator and discriminator generate plausible 2D/3D maps and identify fake maps, respectively. miniGAN aims to be a proxy application for related applications in cosmology (CosmoFlow, ExaGAN) and wind energy (ExaWind). miniGAN has been developed so that optimized mathematical kernels (e.g., kernels provided by Kokkos Kernels) can be plugged into to the proxy application to explore potential performance improvements. miniGAN has been released as open source software and is available through the ECP proxy application website (https://proxyapps.exascaleproject.ordecp-proxy-appssuite/) and on GitHub (https://github.com/SandiaMLMiniApps/miniGAN). As part of this release, a generator is provided to generate a data set (series of images) that are inputs to the proxy application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Nuclear Data Assessment for Advanced Reactors

Advanced reactor concepts being developed throughout the industry are significantly different from light-water reactor (LWR) designs with respect to geometry, materials, and operating conditions, and consequently, with respect to their reactor physics behavior. Given the limited operating experience with non-LWRs, the accurate simulation of reactor physics and the quantification of associated uncertainties are important for ensuring that the nuclear design for advanced reactor concepts include appropriate margins. Nuclear data are a major source of input uncertainties in reactor physics analysis. As part of a project sponsored by the US Nuclear Regulatory Commission at Oak Ridge National Laboratory (ORNL), key nuclear data relevant to reactor safety analysis in selected advanced reactor technologies were identified, and their impacts on important key figures of merit were assessed based on (1) a review of available advanced reactor specifications, (2) analysis of previous studies performed at ORNL and other research institutions, and (3) sensitivity and uncertainty analyses performed for six selected benchmarks—three experimental and three computational—to quantify the impacts of the identified key nuclear data on several key metrics. This report summarizes the key nuclear data—nominal data and nuclear data uncertainties— considering the most important nuclear reactions in the fuel and in various materials for the moderator, coolant, and structure of the considered advanced reactors.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Validation of ENDF/B-VIII.1 Nuclear Data Files [Slides]

ENDF-6 formatted files were processed into A Compact ENDF (ACE) files using NJOY2016. Several validation tests were performed: (1) LANL Legacy Benchmark Suite (2) “Modern” Benchmark Suite (3) HEU Benchmark Suite (4) LEU Benchmark Suite (5) Mixed (U+Pu) Benchmark Suite (6) Pu Benchmark Suite (7) 233 U Benchmark Suite.

97 MATHEMATICS AND COMPUTING↗