Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

The Surface Atmosphere Integrated Field Laboratory (SAIL) Campaign

The science of mountainous hydrology spans the atmosphere through the bedrock and inherently crosses physical and disciplinary boundaries: land-atmosphere interactions in complex terrain enhance clouds and precipitation, while watersheds retain and release water over a large range of spatial and temporal scales. Limited observations in complex terrain challenge efforts to improve predictive models of the hydrology in the face of rapid changes. The Upper Colorado River exemplifies these challenges, especially with ongoing mismatches between precipitation, snowpack, and discharge. Consequently, the U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) user facility has deployed an observatory to the East River Watershed near Crested Butte, Colorado between September 2021 and June 2023 to measure the main atmospheric drivers of water resources, including precipitation, clouds, winds, aerosols, radiation, temperature and humidity. This effort, called the Surface Atmosphere Integrated Field Laboratory (SAIL), is also working in tandem with DOE-sponsored surface and subsurface hydrologists and other federal, state, and local partners. SAIL data can be benchmarks for model development by producing a wide range of observational information on precipitation and its associated processes, including those processes that impact snowpack sublimation and redistribution, aerosol direct radiative effects in the atmosphere and in the snowpack, aerosol impacts on clouds and precipitation, and processes controlling surface fluxes of energy and mass. Preliminary data from SAIL’s first year showcase the rich information content in SAIL’s many data-streams and support testing hypotheses that will ultimately improve scientific understanding and predictability of Upper Colorado River hydrology in 2023 and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Coupling of nTRACER to COBRA-TF for full core high-fidelity analysis of VVERs

The evolution of computing clusters allows the use of high-resolution multi-physics solvers for reactor analysis. Despite the continuous expansion of VVER technology, only one other high-fidelity sub-pin multi-physics core solver is currently developed for safety analysis. To that end the Laboratory of Reactor Physics and Thermal-Hydraulics (LRT) of Paul Scherrer Institut is developing such a tool with the coupling of the neutronic code nTRACER and the sub-channel code COBRA-TF. This work follows the initial steps of the coupling and focuses to the extension of the core solver to full core VVER geometries. The X2 VVER-1000 benchmark is modeled with the novel core solver. The results are compared to the ones of a standalone nTRACER calculation where the feedbacks are provided by a simplified 1D thermal-hydraulic solver. Despite relatively good agreement in power distribution, the limitations of the simplified solver become apparent especially when comparing global temperature profiles. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2023

SCALE 6.2 Lattice Physics Performance Assessment

The US Nuclear Regulatory Commission relies on the lattice physics analysis capabilities of the SCALE code system to perform confirmatory licensing analyses. Either SCALE lattice physics code—TRITON/NEWT or Polaris—can be used to generate cross section data used by the PARCS nodal core simulator for full-core neutronics calculations. This report presents an assessment of the accuracy of SCALE lattice physics codes for preparation of lattice physics data that are used to support simulator codes such as the NRC’s PARCS, for UO 2 -mixed oxide (MOX)/Zr fueled light water reactor (LWR) analyses. Due to the nature of lattice physics calculations, critical reactor experiment benchmarks cannot be modeled in explicit detail in a lattice physics code. However, this limitation does not mean that these measurement data are not usable for lattice physics studies. Therefore, either geometry approximations or axial buckling must be implemented to determine the critical water height. These modeling limitations have led to development of a three-phase assessment strategy. In the first phase, selected critical experiment benchmarks are modeled using the SCALE 3D continuous-energy (CE) Monte Carlo (MC) code KENO, which is the most rigorous neutron transport method available in SCALE, with no approximations in the spatial, angle, or energy treatments. Biases and statistical uncertainties in quantities of interest such as k eff and pin power distributions are determined by comparing CE KENO results to experimental data. This first phase in the accuracy assessment is to demonstrate and establish the use of CE KENO as a reference solution for the second phase. In the second phase, 14 numerical test suites are used to compare SCALE lattice physics calculations with CE KENO as a reference solution. In the third phase, SCALE lattice physics depletion calculations are performed, and the spent fuel isotopic results are compared with available radiochemical assay measurements. Isotopic measurement comparisons provide quantitative assessment of isotopic density distribution predictions with the depletion models in SCALE lattice physics codes. This report documents results for all test suites. The assessment was performed using standard production techniques unless otherwise noted. Both TRITON/NEWT and Polaris exhibited acceptable accuracy for most test cases. For the few test cases in which acceptable accuracy criteria were not met, further code and data development are planned. The computer codes used in this assessment are as follows: SCALE 6.2 rev19189 (pre-release of 6.2.1) was used for CE KENO, TRITON/NEWT and Polaris (PWR only) calculations; SCALE 6.2.2 was used for Polaris calculations to address several updates in support of support boiling water reactor (BWR) lattice geometries. For this work, there is no difference between SCALE 6.2.1 and SCALE 6.2.2 beyond the inclusion of the Polaris BWR analysis capability; The ENDF/B-VII.1 continuous energy and 252 group libraries deployed in SCALE 6.2 were generated with AMPX 6.2 that is distributed with SCALE.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Preliminary benchmarks and analysis of boundary conditions in a trenched microstructured silicon radiation detector

Microstructured neutron detectors have the benefit of enhanced neutron detection efficiency as compared to planar devices, achieved by etching 6 LiF-filled trenches on the top surface of a silicon PIN diode. This sensor geometry results in a complex electric field distribution and depletion characteristics within the diode under reverse bias. For the first time on record, the effects of a fixed oxide charge on the microstructured device depletion characteristics and mobile carrier transport is investigated. Prototype detectors were fabricated with non-conformal surface doping. Capacitance voltage and current voltage measurements were performed for these prototypes and compared with COMSOL Multiphysics simulations. A spectral response from an 241Am alpha particle source was acquired and analyzed. It was found that monoenergetic alpha particles produce three prominent peaks in the pulse height spectrum output by the device. The peaks were confirmed by simulations to correlate with dead layers and incident trajectories into the microstructure. It was also found that significant differences in pulse rise time result, corresponding with events arriving in a low-field region in the fins and a high-field region in the bulk. Geant4 was utilized for radiation transport, interaction modeling, and benchmarking the spectral data. The results of this simulation work provide confidence in the ability to attain and benchmark electrical characteristics and spectral data for semiconductor radiation detectors employing complex microstructures.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Probabilistic evolution of stochastic dynamical systems: A meso-scale perspective

Stochastic dynamical systems arise naturally across nearly all areas of science and engineering. Typically, a dynamical system model is based on some prior knowledge about the underlying dynamics of interest in which probabilistic features are used to quantify and propagate uncertainties associated with the initial conditions, external excitations, etc. From a probabilistic modeling standing point, two broad classes of methods exist, i.e. macro-scale methods and micro-scale methods. Classically, macro-scale methods such as statistical moments-based strategies are usually too coarse to capture the multi-mode shape or tails of a non-Gaussian distribution. Micro-scale methods such as random samples-based approaches, on the other hand, become computationally very challenging in dealing with high-dimensional stochastic systems. In view of these potential limitations, a meso-scale scheme is proposed here that utilizes a meso-scale statistical structure to describe the dynamical evolution from a probabilistic perspective. The significance of this statistical structure is twofold. First, it can be tailored to any arbitrary random space. Second, it not only maintains the probability evolution around sample trajectories but also requires fewer meso-scale components than the micro-scale samples. To demonstrate the efficacy of the proposed meso-scale scheme, a set of examples of increasing complexity are provided. Connections to the benchmark stochastic models as conservative and Markov models along with practical implementation guidelines are presented.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Neuralized fermionic tensor networks for quantum many-body systems

In this work, we describe a class of neuralized fermionic tensor network states (NN-fTNSs) that introduce nonlinearity into fermionic tensor networks through configuration-dependent neural network transformations of the local tensors. The construction uses the fTNS algebra to implement a natural fermionic sign structure and is compatible with standard tensor network algorithms but gains enhanced expressivity through the neural network parametrization. Using the 1D and 2D Fermi-Hubbard models as benchmarks, we demonstrate that NN-fTNSs achieve order of magnitude improvements in the ground-state energy compared to pure fTNSs with the same bond dimension and can be systematically improved through both the tensor network bond dimension and the neural network parametrization. Compared to existing fermionic neural quantum states based on Slater determinants and Pfaffians, NN-fTNSs offer a physically motivated alternative fermionic structure. Furthermore, compared to such states, NN-fTNSs naturally exhibit improved computational scaling and we demonstrate a construction that achieves linear scaling with the lattice size.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Kinetic Monte Carlo Tool for Kinetic Modeling of Linear Step-Growth Polymerization: Insight into Recycling of Polyurethanes

A kinetic Monte Carlo model of polyurethane polymerization which explicitly tracks the polymer sequences is developed and shared. Here this model is benchmarked against theoretical and experimental polyurethane data and used to investigate the effect on oligomer distributions of unequal reactivity of the first and second isocyanate to react. The reverse reactions using thermodynamic consistency are then added to the framework, and analogous to the addition polymerization concept of ceiling temperature, equilibrium chain length distributions at various temperatures are calculated. For a mixture of three monomers AA, BB, and CC, where BB and CC do not react with one another, are present in stoichiometric proportions, and have different enthalpies of reaction with AA, an odd-even effect emerges. Odd length chains are more likely than even length chains for temperatures at which BB and CC have significantly different equilibrium conversions. The concept of ceiling temperature that is typically cited for addition polymers is extended here to provide a measure of conditions under which depolymerization for recycling is favored.

condensation polymerization↗
DOE OSTI2024

Modeling Enhancements, Cross-Section Generation Updates, and Benchmarking with Shift

This technical report documents the modeling enhancements, cross-section generation updates, and bench marking with the Shift Monte Carlo code performed under the US Department of Energy Nuclear Energy Advanced Modeling and Simulation Program in FY 2024. The work performed included several modeling enhancements, such as integration of cross-section generation in Titan and the ability to produce microscopic multigroup cross sections with Shift. Benchmarking of the cross sections produced by Shift and the two-step workflow with Griffin was performed for three problems: the Advanced Breeder Test Reactor, a generic pebble bed reactor, and a TRISO heat pipe microreactor. Comparisons of results from these benchmark problems were done with Serpent, OpenMC, and Griffin. These enhancements provide a robust foundation for applying Shift for both reference and two-step neutronics analysis for advanced reactor simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Active Learning‐Driven Inkless Additive Nanomanufacturing for Printed Electronics

Inkless additive nanomanufacturing for printed electronics promises broad material and substrate versatility, yet the high-dimensional print parameter space makes tuning print parameters time-intensive. We present a Bayesian optimization study that constructs a digital twin from printed-silver data to benchmark surrogate models, acquisition functions, and batch sizes head-to-head to achieve user-specified target resistance. Tested surrogate models included Gaussian process, random forest, and Bayesian neural network surrogates with expected improvement and confidence bound acquisition functions. In total, we evaluate 48 unique model configurations alongside a random sampling baseline for comparison. For printed silver, the Bayesian neural network with a batch size of one achieved the lowest average cumulative regret, approximately four times more efficient on average than random sampling. To balance performance and substrate space, a random forest model with expected improvement and a batch size of four was chosen as the model for validation testing. Applying this chosen configuration to copper with an additional print parameter, the model achieved a resistance within 0.15 Ω of a 1 Ω target in fewer than 30 printed lines across five validation sets. Altogether, the workflow yields a tuned and validated model that efficiently guides experiments toward the target while simultaneously learning the parameter space.

Bevel, Colton [Auburn University, AL (United State↗
DOE OSTI2026

Search for long-lived particles using displaced vertices with low-momentum tracks in proton-proton collisions at $\sqrt{s}=13$ TeV

A search for long-lived particles using final states including a displaced vertex with low-momentum tracks, large missing transverse momentum, and a jet from initial-state radiation is presented. This search uses proton-proton collision data at a center-of-mass energy of 13 TeV collected by the CMS experiment at the CERN LHC in 2017 and 2018, with a total integrated luminosity of 100 fb −1 . This analysis adopts specific supersymmetric (SUSY) coannihilation scenarios as benchmark signal models, characterized by a next-to-lightest SUSY particle (NLSP) with a mass difference of less than 25 GeV relative to the lightest SUSY particle, assumed to be a bino-like neutralino. In the top squark $\huge{(}$$\tilde{\textrm{t}}$$\huge{)}$ NLSP model, the NLSP is a long-lived $\tilde{\textrm{t}}$, while in the bino-wino NLSP scenario, the mass-degenerate NLSPs are a wino-like long-lived neutralino and a short-lived chargino. The search excludes top squarks with masses less than 400–1100 GeV and wino-like neutralinos with masses less than 220–550 GeV, depending on the signal parameters, including the mass difference, mass, and lifetime of the long-lived particle. It sets the most stringent limits to date for the $\tilde{\textrm{t}}$ and bino-wino NLSP models.

Beyond Standard Model↗
DOE OSTI2024

Semi-visible jets + X: illuminating dark showers with radiation

We investigate the potential to search for semi-visible jets (SVJs) at the Large Hadron Collider (LHC) using initial-state radiation (ISR). Both photon ISR and jet ISR channels are considered, using a benchmark signal model with the decay of a leptophobic Z$^{′}$ mediator forming two SVJs. We compare and extend several techniques to decompose the missing transverse momentum into per-jet contributions, in order to reconstruct the mediator mass and to define a new observable measuring the fraction of invisible dark hadrons. The presence of ISR facilitates the identification of the SVJs, and the resulting boost improves the resolution of the observables, especially for models with high invisible fractions. We combine the two observables to propose a complete search strategy and discuss an extension of the strategy to probe the whole model parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Divergent controls of soil organic carbon between observations and process-based models

Abstract The storage and cycling of soil organic carbon (SOC) are governed by multiple co-varying factors, including climate, plant productivity, edaphic properties, and disturbance history. Yet, it remains unclear which of these factors are the dominant predictors of observed SOC stocks, globally and within biomes, and how the role of these predictors varies between observations and process-based models. Here we use global observations and an ensemble of soil biogeochemical models to quantify the emergent importance of key state factors – namely, mean annual temperature, net primary productivity, and soil mineralogy – in explaining biome- to global-scale variation in SOC stocks. We use a machine-learning approach to disentangle the role of covariates and elucidate individual relationships with SOC, without imposing expected relationships a priori . While we observe qualitatively similar relationships between SOC and covariates in observations and models, the magnitude and degree of non-linearity vary substantially among the models and observations. Models appear to overemphasize the importance of temperature and primary productivity (especially in forests and herbaceous biomes, respectively), while observations suggest a greater relative importance of soil minerals. This mismatch is also evident globally. However, we observe agreement between observations and model outputs in select individual biomes – namely, temperate deciduous forests and grasslands, which both show stronger relationships of SOC stocks with temperature and productivity, respectively. This approach highlights biomes with the largest uncertainty and mismatch with observations for targeted model improvements. Understanding the role of dominant SOC controls, and the discrepancies between models and observations, globally and across biomes, is essential for improving and validating process representations in soil and ecosystem models for projections under novel future conditions.

58 GEOSCIENCES↗
DOE OSTI2025

Network of networks: Time series clustering of AmeriFlux sites

Environmental observation networks, such as AmeriFlux, are foundational for monitoring ecosystem response to climate change, management practices, and natural disturbances; however, their effectiveness depends on their representativeness for the regions or continents. We proposed an empirical, time series approach to quantify the similarity of ecosystem fluxes across AmeriFlux sites. We extracted the diel and seasonal characteristics (i.e., amplitudes, phases) from carbon dioxide, water vapor, energy, and momentum fluxes, which reflect the effects of climate, plant phenology, and ecophysiology on the observations, and explored the potential aggregations of AmeriFlux sites through hierarchical clustering. While net radiation and temperature showed latitudinal clustering as expected, flux variables revealed a more uneven clustering with many small (number of sites < 5), unique groups and a few large (> 100) to intermediate (15–70) groups, highlighting the significant ecological regulations of ecosystem fluxes. Many identified unique groups were from under-sampled ecoregions and biome types of the International Geosphere-Biosphere Programme (IGBP), with distinct flux dynamics compared to the rest of the network. At the finer spatial scale, local topography, disturbance, management, edaphic, and hydrological regimes further enlarge the difference in flux dynamics within the groups. Nonetheless, our clustering approach is a data-driven method to interpret the AmeriFlux network, informing future cross-site syntheses, upscaling, and model-data benchmarking research. Finally, we highlighted the unique and underrepresented sites in the AmeriFlux network, which were found mainly in Hawaii and Latin America, mountains, and at under-sampled IGBP types (e.g., urban, open water), motivating the incorporation of new/unregistered sites from these groups.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Parallels between enzyme catalysis, electrocatalysis, and photoelectrosynthesis

Catalysts are central to accelerating chemistry in biology and technology. In biochemistry, the relationship between the velocity of an enzymatic reaction and the concentration of chemical substrates is described via the Michaelis-Menten model. Additionally, the modeling and benchmarking of synthetic molecular electrocatalysts are also well developed. However, such efforts have not been as rigorously extended to photoelectrosynthetic reactions, where, in addition to chemical substrates and charge carriers, light is a required reagent. In this perspective, we draw parallels between concepts involving enzyme catalytic efficiency, the benchmarking of molecular electrocatalysts, and the performance of photoelectrosynthetic assemblies, while highlighting key differences, assumptions, and limitations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Separable physics-informed DeepONet: Breaking the curse of dimensionality in physics-informed machine learning

The deep operator network (DeepONet) has shown remarkable potential in solving partial differential equations (PDEs) by mapping between infinite-dimensional function spaces using labeled datasets. However, in scenarios lacking labeled data, the physics-informed DeepONet (PI-DeepONet) approach, which utilizes the residual loss of the governing PDE to optimize the network parameters, faces significant computational challenges, particularly due to the curse of dimensionality. This limitation has hindered its application to high-dimensional problems, making even standard 3D spatial with 1D temporal problems computationally prohibitive. Additionally, the computational requirement increases exponentially with the discretization density of the domain. Here, to address these challenges and enhance scalability for high-dimensional PDEs, we introduce the Separable physics-informed DeepONet (Sep-PI-DeepONet). This framework employs a factorization technique, utilizing sub-networks for individual one-dimensional coordinates, thereby reducing the number of forward passes and the size of the Jacobian matrix required for gradient computations. By incorporating forward-mode automatic differentiation (AD), we further optimize computational efficiency, achieving linear scaling of computational cost with discretization density and dimensionality, making our approach highly suitable for high-dimensional PDEs. We demonstrate the effectiveness of Sep-PI-DeepONet through three benchmark PDE models: the viscous Burgers’ equation, Biot’s consolidation theory, and a parameterized heat equation. Our framework maintains accuracy comparable to the conventional PI-DeepONet while reducing training time by two orders of magnitude. Notably, for the heat equation solved as a 4D problem, the conventional PI-DeepONet was computationally infeasible (estimated 289.35 h), while the Sep-PI-DeepONet completed training in just 2.5 h. These results underscore the potential of Sep-PI-DeepONet in efficiently solving complex, high-dimensional PDEs, marking a significant advancement in physics-informed machine learning.

Neural operator↗
DOE OSTI2022

Time series anomaly detection in power electronics signals with recurrent and ConvLSTM autoencoders

The anomalies in the high voltage converter modulator (HVCM) remain a major down time for the spallation neutron source facility, that delivers the most intense neutron beam in the world for scientific materials research. In this work, we propose neural network architectures based on Recurrent AutoEncoders (RAE) to detect anomalies ahead of time in the power signals coming from the HVCM. Bi-directional gated recurrent unit, bi-directional long-short term memory (LSTM), and convolutional LSTM (ConvLSTM) are developed, trained, and tested using real experimental signals from the HVCM module. The results show a good performance of the proposed RAE models, achieving precision up to 91%, recall up to 88%, false omission rate as low as 20% (i.e. 80% of the anomalies were detected), and area under the ROC curve up to 0.9. The three RAE models provide very comparable performance, with LSTM showing slightly better performance than GRU and ConvLSTM. The RAE models are benchmarked against other anomaly detection methods, including isolation forest, support vector machine, local outlier factor, feedforward and convolutional autoencoders, and others; showing a better performance. Here, the results of this study demonstrate the promising potential of RAE in anomaly detection for real-world power systems, and for increasing the reliability of the HVCM modules in the spallation neutron source.

42 ENGINEERING↗
DOE OSTI2021

Thermal-striping analysis methodology for sodium-cooled reactor design

Computational fluid dynamics simulations have been performed to study the applicability of engineering CFD methods for thermals striping analysis. Thermal striping is the fluctuating temperature profile in a solid caused by fluctuating fluid temperature, and the resulting fluctuating thermal stresses cause high cycle fatigue and eventual material failure. Here this study presents the methodology for thermal striping analysis that including a transient conjugate heat transfer RANS model and benchmark the results against a sodium triple jet experiment. The multiphysics calculations are implemented to analyze the thermal stresses in the solid domain caused by the coupled heat transfer between the fluid and solid domains. Validation data from a liquid sodium triple jet experiment include time-averaged temperature measurements and power spectra of the temperature signal. The numerical results agree well with these experimental measures, demonstrating key features such as the dominant frequency of temperature fluctuations. The applicability of a low-cost wall treatment method is demonstrated, enabling key computational savings. Finally, the performance of two finite element stress analysis software packages is compared, and the validity of the lower-cost method is confirmed. These results demonstrate the applicability of engineering methods for computational thermal striping calculations, enabling thermal striping estimations in large fluid systems such as the core of a Sodium-cooled nuclear reactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗