Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Search for lepton-flavour violation in high-mass dilepton final states using 139 fb−1 of pp collisions at $$ \sqrt{s} $$ = 13 TeV with the ATLAS detector

A search is performed for a heavy particle decaying into different-flavour, dilepton final states, using 139 fb − 1 of proton-proton collision data at $$ \sqrt{s} $$ s = 13 TeV collected in 2015–2018 by the ATLAS detector at the Large Hadron Collider. Final states with electrons, muons and hadronically decaying tau leptons are considered ( eμ , eτ or μτ ). No significant excess over the Standard Model predictions is observed. Upper limits on the production cross-section are set as a function of the mass of a Z ′ boson, a supersymmetric τ -sneutrino, and a quantum black-hole. The observed 95% CL lower mass limits obtained on a typical benchmark model Z ′ boson are 5.0 TeV (e μ ), 4.0 TeV (e τ ), and 3.9 TeV ( μτ ), respectively.

Aad, G.↗
DOE OSTI2023

A general spatial-temporal framework for short-term building temperature forecasting at arbitrary locations with crowdsourcing weather data

Weather forecasting has been a critical component to predict and control building energy consumption for better building energy management. Without accessibility to other data sources, the onsite observed temperatures or the airport temperatures are used in forecast models. In this paper, we present a novel approach by utilizing the crowdsourcing weather data from neighboring personal weather stations (PWS) to improve the weather forecast accuracy around buildings using a general spatial-temporal modeling framework. The final forecast is based on the ensemble of local forecasts for the target location using neighboring PWSs. Our approach is distinguished from existing literature in various aspects. First, we leverage the crowdsourcing weather data from PWS in addition to public data sources. In this way, the data is at much finer time resolution (e.g., at 5-minute frequency) and spatial resolution (e.g., arbitrary location vs grid). Second, our proposed model incorporates spatial-temporal correlation information of weather variables between the target building and a set of neighboring PWSs so that underlying correlations can be effectively captured to improve forecasting performance. Here, we demonstrate the performance of the proposed framework by comparing to the benchmark models on temperature forecasting for a building located at an arbitrary location at San Antonio, Texas, USA. In general, the proposed model framework equipped with machine learning technique such as Random Forest can improve forecasting by 50% compares with persistent model and has 90% chance to outperform airport forecast in short-term forecasting. In a real-time setting, the proposed model framework can provide more accurate temperature forecasting results compared with using airport temperature forecast for most forecast horizon. Moreover, we analyze the sensitivity of model parameters to gain insights on how crowdsourcing data from the neighboring personal weather stations impacts forecasting performance. Finally, we implement our model in other cities such as Syracuse and Chicago to test the model's performance in different landforms and climate types.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Search for lepton-flavour violation in high-mass dilepton final states using 139 fb –1 of pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search is performed for a heavy particle decaying into different-flavour, dilepton final states, using 139 fb –1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected in 2015–2018 by the ATLAS detector at the Large Hadron Collider. Final states with electrons, muons and hadronically decaying tau leptons are considered (eμ, eτ or μτ). No significant excess over the Standard Model predictions is observed. Upper limits on the production cross-section are set as a function of the mass of a Z' boson, a supersymmetric τ-sneutrino, and a quantum black-hole. The observed 95% CL lower mass limits obtained on a typical benchmark model Z' boson are 5.0 TeV (eμ), 4.0 TeV (eτ), and 3.9 TeV (μτ), respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Stable Simulation of the Community Atmosphere Model Using Machine‐Learning Physical Parameterization Trained With Experience Replay

In recent years, machine learning (ML) models have been used to improve physical parameterizations of general circulation models (GCMs). A significant challenge of integrating ML models into GCMs is the online instability when they are coupled for long‐term simulation. We present a new strategy that demonstrates robust online stability when the physical parameterization package of an atmospheric GCM is replaced by a deep ML model. The method uses experience replay with a multistep training scheme of the ML model in which the model's own output at the previous time step is used in the training. Predicted physics tendencies in the replay buffer with the most recent errors in the training iterations are reused, making the ML model learn from its own errors. The training method reduces the gap between the offline and online environments of the ML model. The method is used to train the ML model as the physical parameterization of the Community Atmosphere Model (CAM5) with training data from the Multi‐scale Modeling Framework high resolution simulations. Three 6‐year online simulations of the CAM5 are carried out by using the ML physics package. The simulated spatial distributions of precipitation, surface temperature and zonally averaged atmospheric fields demonstrate overall better accuracy than that of the standard CAM5 and benchmark model even without the use of additional physical constraints or tuning. This work is the first to demonstrate a solution to address the online instability problem in climate modeling with ML physics by using experience replay.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Sparse chronology strategy for integrating seasonal energy storage in capacity expansion models

Here, this study develops the sparse chronology method to enhance the representative period framework in capacity expansion models, enabling the effective integration of long-duration energy storage modeling. Traditional representative period methods cannot capture the state of charge of seasonal energy storage systems because they do not establish effective inter-day linkages to connect the state of charge between periods. The sparse chronology approach addresses this limitation by establishing inter-day linkages that allow state of charge to shift inter-seasonally. At the same time, it groups identical representative days into partitions, applying constraints sparsely and implicitly to reduce computational load further. Validation results demonstrate that this method successfully simulates long-duration energy storage patterns, achieving close alignment with a continuous yearly benchmark model, with seasonal trends and state of charge cycles clearly represented. The computational load analysis reveals that the sparse chronology method efficiently applies constraints on maximum and minimum state of charge limits within the representative day framework, eliminating the need for detailed constraints on each individual day. By partitioning representative days and constraining only the start and end of each partition, the method significantly decreases computational requirements. Simulation results show that sparse chronology closely approximates the continuous yearly method's accuracy, even with as few as 20 representative days, achieving correlation values with the benchmark of nearly 0.9 in state of charge plots. Furthermore, it maintains computational efficiency, requiring only 4 % of the solver time compared to the continuous yearly method with 20 representative days. This approach allows capacity expansion models to incorporate long-duration energy storage with high temporal, spatial, and technological resolution, enabling more detailed modeling for large-scale power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Mean field model parameterization to recover coverage-dependent kinetics

Lateral interactions between adsorbates introduce coverage dependence into adsorption energies and activation barriers of surface reactions. Lattice-based kinetic Monte Carlo (kMC) simulations can capture these interactions quantitatively but are laborious to parameterize and solve. Mean field models are more tractable, but protocols to construct and parameterize them are unclear. Here we explore the ability of a coverage-aware mean-field model to map to a lattice-kMC model of a generic two-step reaction network, including quasi-equilibrated adsorption and rate-limiting dissociation steps. We derive expressions for mean-field and coverage-dependent adsorption energies and dissociation barriers and parameterize against lattice-kMC predictions. We show that the parameterized mean-field rates correlate with ground truth lattice-kMC results across a wide range of reaction conditions and identify regions where the mean field fails. The mean field model similarly captures kMC-derived rate-order, Arrhenius and Sabatier plots at a greatly reduced computational cost. Further, the results provide guidance for parameterizing mean-field models, benchmarked against explicit lattice-based approaches for incorporating the influence of coverage effects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Measurements of Irradiated Low Enriched Fuel with a Gamma-Ray Scanning System (ANIMMA 2023 Conference Presentation)

A gamma-ray scanning system was designed to perform post-irradiation measurements of nuclear fuel at Idaho National Laboratory (INL). The system is composed of a coaxial high-purity germanium (HPGe) detector, a collimator, and mechanical positioning stages that translate the fuel sample across the front of the collimator. A Monte Carlo N-Particle code simulation of the system and the fuel were created with vendor-supplied design specifications, dimensional measurements, and x-ray radiographs of the HPGe detector as well as all available fuel specifications. Benchmark measurements were performed by scanning an irradiated fuel rodlet containing eight pellets of 0.74% enriched UO2 in zirconium alloy. This fuel rodlet was part of the Environment Rodlet Transient Test Apparatus (SERTTA) testing campaign in the Transient Reactor Test Facility (TREAT). These results were compared to simulated spectra to help characterize the detector model and establish fidelity. One goal of the system is to determine the number of fissions per gram of UO2 in the fuel. This article documents the modeling, benchmarking measurements, and the calculated number of fissions per gram in the SERTTA-A rodlet which was previously irradiated at TREAT.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Machine learning techniques for intermediate mass gap lepton partner searches at the large hadron collider

We consider machine learning techniques associated with the application of a boosted decision tree (BDT) to searches at the Large Hadron Collider (LHC) for pair-produced lepton partners which decay to leptons and invisible particles. This scenario can arise in the minimal supersymmetric Standard Model (MSSM), but can be realized in many other extensions of the Standard Model (SM). We focus on the case of intermediate mass splitting ( ∼ 30 GeV ) between the dark matter (DM) and the scalar. For these mass splittings, the LHC has made little improvement over LEP due to large electroweak backgrounds. We find that the use of machine learning techniques can push the LHC well past discovery sensitivity for a benchmark model with a lepton partner mass of ∼ 110 GeV , for an integrated luminosity of 300 fb − 1 , with a signal-to-background ratio of ∼ 0.3 . The LHC could exclude models with a lepton partner mass as large as ∼ 160 GeV with the same luminosity. The use of machine learning techniques in searches for scalar lepton partners at the LHC could thus definitively probe the parameter space of the MSSM in which scalar muon mediated interactions between SM muons and Majorana singlet DM can both deplete the relic density through dark matter annihilation and satisfy the recently measured anomalous magnetic moment of the muon. We identify several machine learning techniques which can be useful in other LHC searches involving large and complex backgrounds. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2025

Uncertainty-Guided Prediction Horizon of Phase-Resolved Ocean Wave Forecasting Under Data Sparsity: Experimental and Numerical Evaluation

Accurate short-term wave forecasting is critical for the safe and efficient operation of marine structures that rely on real-time, phase-resolved ocean wave information for control and monitoring purposes (e.g., digital twins). These systems often depend on environmental sensors (e.g., waverider buoys, wave-sensing LIDAR). Challenges arise when upstream sensor data are missing, sparse, or phase-shifted due to drift. This study investigates the performance of two machine learning models, time-series dense encoder (TiDE) and long short-term memory (LSTM), for forecasting phase-resolved ocean surface elevations under varying degrees of data degradation. We introduce the τ-trimming algorithm, which adapts the prediction horizon based on uncertainty thresholds derived from historical forecasts. Numerical wave tank (NWT) and wave basin experiments are used to benchmark model performance under short- and long-term data masking, spatially coarse sensor grids, and upstream phase shifts. Results show under a 50% probability of upstream data loss, the τ-trimmed TiDE model achieves a 46% reduction in error at the most upstream target, compared to 22% for LSTM. Furthermore, phase misalignment in upstream data introduces a near-linear increase in forecast error. Under moderate model settings, a ±3 s misalignment increases the mean absolute error by approximately 0.5 m, while the same error is accumulated at ±4 s using the more conservative approach. These findings inform the design of resilient, uncertainty-aware wave forecasting systems suited for realistic offshore sensing environments.

42 ENGINEERING↗
DOE OSTI2022

Health Physics Research Reactor Criticality Accident Alarm System Benchmark Overview [Slides]

This presentation discusses the Health Physics Research Reactor (HPRR) or Fast Burst Reactor (FBR) and how available data from Health Physics Research Reactor (HPRR) operation to can be used to create a benchmark report for inclusion in the ICSBEP, as a Criticality Accident Alarm System (CAAS) shielding benchmark. The evaluation of experimental data is also presented, specifically four experimental candidates are considered of potential value for the benchmark: 1. Neutron source estimation from a HPRR pulse (energy spectrum, fission yield), 2. Threshold Detector Unit (TDU) measurements at different distances from a HPRR pulse, shielded and unshielded, 3. Sulfur pellet activation at different distances from a HPRR pulse, shielded and unshielded, and 4. Total neutron fluence from a HPRR pulse measured by Bonner Sphere Spectrometry, shielded and unshielded. Additionally, a benchmark model overview is discussed as are sample calculation results.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

BISON fuel performance modeling optimization for experiment X447 and X447A using axial swelling and cladding strain measurements

With the recent need to qualify new reactor designs such as the Versatile Test Reactor (VTR), fuel performance calculations need to be performed to determine safety criteria of the proposed designs. In order to validate the fuel performance results obtained by a fuel performance code, BISON, for new reactor designs, legacy fuel from EBR-II and FFTF MFF with Post -Irradiation Examination (PIE) data need to be used as validation cases to benchmark models. Here in this work, BISON has been paired with the Fuels Irradiation & Physics Database (FIPD) and IFR Materials Information System (IMIS) to supply PIE data for comparison with simulations of EBR-II experiments X447/X447A. X447/X447A were assessed by implementing models for Fuel Cladding Chemical Interaction (FCCI) within BISON and optimizing the friction coefficient between the fuel surface and the cladding, the anisotropic swelling factor, and the HT9 first thermal creep scalar (which scales the first term in the HT9 creep equation) to best match the PIE axial fuel swelling height and cladding profilometry for all pins in X447/X447A. The optimal values were found using a generic algorithm developed to select different values for the three parameters until end criteria was met and error couldn’t be reduced further. The BISON-simulated cladding profilometry was evaluated using Standard Error of the Estimate (SEE) to account for the profile shape of the cladding profilometry. Optimal values for the friction coefficient, anisotropic fuel swelling factor, and HT9 first thermal creep scalar were found to best fit the BISON simulation results to the PIE measurements found in IMIS and FIPD. Improvements to current models are suggested to account for the underprediction of fuel swelling at low burnups and the overprediction of fuel swelling at higher burnups observed for the axial fuel swelling height. Although two pins in EBR-II X447/X447A (DP70 and DP75) were known to fail due to FCCI, none of the pins simulated in BISON reached a cumulative damage fraction (CDF) above 0.008 with FCCI correlations coupled in the BISON simulations. The error estimate generated for all pins in X447/X447A using optimal values was 209 µm, which is deemed acceptable.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Resilience-Motivated Distribution System Restoration Considering Electricity-Water-Gas Interdependency

A major outage in the electricity distribution system may affect the operation of water and natural gas supply systems, leading to an interruption of multiple services to critical customers. Therefore, enhancing resilience of critical infrastructures requires joint efforts of multiple sectors. In this paper, a distribution system service restoration method considering the electricity-water-gas interdependency is proposed. The objective is maximizing the supply of electricity, water, and gas to critical customers after an extreme event. The operational constraints of electricity, water, and natural gas networks are considered. Additionally, the characteristics of electricity-driven coupling components, including water pumps and gas compressors, are also modeled. Relaxation techniques are applied to non convex constraints posed by physical laws of those networks. Consequently, the restoration problem is formulated as a mixed-integer second-order cone program, which can readily be solved by the off-the-shelf solvers. The proposed method is validated by numerical simulations on an electricity-water-gas integrated system, developed based on benchmark models of the subsystems. The results indicate that considering the interdependency refines the allocation of limited generation resources and demonstrate the exactness of the proposed convex relaxation

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Assessing impacts of selective logging on water, energy, and carbon budgets and ecosystem dynamics in Amazon forests using the Functionally Assembled Terrestrial Ecosystem Simulator

Abstract. Tropical forest degradation from logging, fire, and fragmentation not only alters carbon stocks and carbon fluxes, but also impacts physical land surface properties such as albedo and roughness length. Such impacts are poorly quantified to date due to difficulties in accessing and maintaining observational infrastructures, as well as the lack of proper modeling tools for capturing the interactions among biophysical properties, ecosystem demography, canopy structure, and biogeochemical cycling in tropical forests. As a first step to address these limitations, we implemented a selective logging module into the Functionally Assembled Terrestrial Ecosystem Simulator (FATES) by mimicking the ecological, biophysical, and biogeochemical processes following a logging event. The model can specify the timing and aerial extent of logging events, splitting the logged forest patch into disturbed and intact patches; determine the survivorship of cohorts in the disturbed patch; and modifying the biomass and necromass (total mass of coarse woody debris and litter) pools following logging. We parameterized the logging module to reproduce a selective logging experiment at the Tapajós National Forest in Brazil and benchmarked model outputs against available field measurements. Our results suggest that the model permits the coexistence of early and late successional functional types and realistically characterizes the seasonality of water and carbon fluxes and stocks, the forest structure and composition, and the ecosystem succession following disturbance. However, the current version of FATES overestimates water stress in the dry season and therefore fails to capture seasonal variation in latent and sensible heat fluxes. Moreover, we observed a bias towards low stem density and leaf area when compared to observations, suggesting that improvements are needed in both carbon allocation and establishment of trees. The effects of logging were assessed by different logging scenarios to represent reduced impact and conventional logging practices, both with high and low logging intensities. The model simulations suggest that in comparison to old-growth forests the logged forests rapidly recover water and energy fluxes in 1 to 3 years. In contrast, the recovery times for carbon stocks, forest structure, and composition are more than 30 years depending on logging practices and intensity. This study lays the foundation to simulate land use change and forest degradation in FATES, which will be an effective tool to directly represent forest management practices and regeneration in the context of Earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗
DOE OSTI2024

Dark sector glueballs at the LHC

Abstract We study confining dark sectors where the lightest hadrons are glueballs. Such models can provide viable dark matter candidates and appear in some neutral naturalness scenarios. In this work, we introduce a new phenomenological model of dark glueball hadronization inspired by the Lund string model. This enables us to make the most physically-motivated predictions for dark glueball phenomenology at the LHC to date. Our model approximately reproduces the expected thermal distribution of hadron species as an emergent consequence of hadronization dynamics. The ability to predict the production of glueball states heavier than the lightest species significantly expands the reach of long-lived glueball searches in MATHUSLA compared to previous simplified estimates. We also characterize regions of parameter space where emerging and/or semivisible jets could arise from pure-glue dark sectors, thereby providing new benchmark models that motivate searches for these signatures.

Physics↗
DOE OSTI2020

SFCOMPO Database of Spent Nuclear Fuel Assay Data – the Next Frontier

SFCOMPO is the world’s largest database for measured spent nuclear fuel assay data. An international effort coordinated by the Nuclear Energy Agency (NEA) resulted in a significant expansion of the database and its release online in 2017 as a downloadable application. The SFCOMPO Technical Review Group (TRG) was recently formed under the direction of NEA’s Nuclear Science Committee/Working Party on Nuclear Criticality Safety and was mandated to maintain and further coordinate the development of SFCOMPO. This TRG is currently focused on (1) critical evaluation of the experimental assay data by independent experts and (2) development of benchmarks and benchmark models that can be applied to validate burnup codes. This will improve the quality and documentation of the experimental datasets and enable their use by the international community to support code validation for design and safety analysis of spent nuclear fuel transportation, storage, and repository applications. It follows the precedent and draws on the experience gained from similar NEA efforts in the International Reactor Physics Experiment Evaluation Project and the International Criticality Safety Benchmark Experiment Project. Ongoing SFCOMPO evaluations have served as a test bed to develop templates for documenting evaluations, develop review guidance, improve approaches for a global uncertainty analysis, and devise a strategy focused on providing practical information of highest value to the user community. The current effort, status, and associated challenges are discussed.

Ilas, Germina↗
DOE OSTI2020

ChIMES: A Machine-Learned Interatomic Model Targeting Improved Description of Condensed Phase Chemistry in Energetic Materials

In this report we detail completion of a Physics and Engineering Model Level Two Milestone targeting improved reactive interatomic potentials (IAPs) for energetic materials (EM) through machine learning. The specific goals of this milestone were to develop, validate, and document a new reactive molecular dynamics method for EM, based on machine learning by (1) generating databases of first-principles-derived forces, stresses, and energies for HN3 and 3,4-bis(3-nitrofurazan- 4-yl)furoxan (DNTF) (2) generate atomistic force fields from these databases via ML, and (3) benchmark model performance against first principles calculations. These goals were achieved by (1) further developing a machine learned reactive IAP and generation approach (i.e. the Chebyshev Interaction Model for Efficient Simulation or “ChIMES”), for which resulting IAPs can approach the predictive power of quantum-mechanical approaches at a fraction of the computational expense, and (2) applying the ChIMES framework to develop models for HN3 and DNTF. We find that for simple energetic materials like HN3, high accuracy ChIMES models can be obtained through application of a fitting approach that does not use active machine learning. We demonstrate the suitability of ChIMES models for simulations involving EM by using the HN3 model in multiscale shock technique simulations to predict the HN3 Chapman-Jouguet detonation state and investigate chemical evolution out to 1 ns following shock compression. This model is then used in larger direct shock (DS) simulations for a preliminary investigation of how bubbles (i.e. voids) influence material response under shock compression. We find that more complex EM (i.e. DNTF) necessitate a more sophisticated fitting approach, and develop a new active learning method and python tool to meet this challenge. We demonstrate that this fitting approach yields ChIMES models that out-perform commonly used standard reactive IAPs as well as semi-empirical quantum methods, and discuss the systematic improvability of these actively learned ChIMES models. We also describe challenges related to model development for EM such as DNTF, for which few experimental or previous simulation data are available (e.g. which could otherwise inform generation of training data). To overcome this issue, we establish a semi-empirical quantum ChIMES capability which can be used to efficiently map out relevant thermodynamic and configurational space, and generate ChIMES-IAP training data in a multiscale manner. We also show that these semi-empirical quantum ChIMES models can be used to generate predictions for the shock Hugoniot (the Hugoniot is the locus of thermodynamic states found in a shocked material) equation of state, investigate related thermochemistry, and explore carbon condensation following shock compression. This work represents a substantial advance in our atomistic modeling capability for EM that will provide much needed information on the chemistry of detonation for continued development of continuum models based on the Cheetah thermochemical code.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗