Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Solar neutrino detection in liquid xenon detectors via charged-current scattering to excited states

We investigate the prospects for real-time detection of solar neutrinos via the charged-current neutrino-nucleus scattering process in liquid xenon time projection chambers. We use a nuclear shell model, benchmarked with experimental data, to calculate the cross sections for populating specific excited states of the cesium nuclei produced by neutrino capture on Xe 131 and Xe 136 . The shell model is further used to compute the decay schemes of the low-lying 1 + excited states of Cs 136 , for which there is sparse experimental data. We explore the possibility of tagging the characteristic deexcitation γ rays/conversion electrons using two techniques: spatial separation of their energy deposits using event topology and their time separation using delayed coincidence. The efficiencies in each case are evaluated within a range of realistic detector parameters. We find that the topological signatures are likely to be dominated by radon backgrounds, but that a delayed-coincidence signature from long-lived states predicted in Cs 136 may enable background-free detection of CNO neutrino interactions in next-generation experiments with smaller uncertainty than current measurements. We also estimate the sensitivity as a function of exposure for detecting the solar-temperature-induced line shift in Be 7 neutrino emission, which may provide a new test of solar models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space

Background Protein language models (PLMs) have revolutionized protein fitness prediction, yet their application to rapidly evolving viral pathogens is often confounded by extreme sequence homology. This homology leads to “data leakage” in standard random validation splits, yielding inflated performance metrics that fail to translate into real-world biosurveillance utility. Results We present Protein Representation Inference for Mutation Evaluation (PRIME), a framework that integrates domain-specific fine-tuning with a rigorous position-stratified validation protocol to evaluate viral threats. Using a dataset of 347,432 SARS-CoV-2 receptor binding domain (RBD) sequences, we demonstrate that while random training data split yields deceptive R 2 values (> 0.90), they fail to generalize to novel mutational sites. By benchmarking models up to 650 M parameters, we show that domain-specific fine-tuning of the ESM-C 600 M model with correctly stratified data provides an initial demonstration of predictive signal for binding affinity and expression at unseen mutational sites of binding affinity and expression on unseen sites (R 2 ~0.23), a significant advancement over base foundation models which exhibit no predictive power (R 2 <0). PRIME’s embedding-based clustering identified 3.03% of bat coronavirus sequences as candidates for further experimental prioritization based on their functional similarity to human-infective strains in embedding space, offering a perspective complementary to traditional phylogenetic methods. Conclusion PRIME establishes a new benchmark for the application of PLMs in pathogen surveillance. Our findings demonstrate that state-of-the-art models and fine-tuning, when paired with stratified validation, provide biologically meaningful insights into pathogen evolution and zoonotic risk.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Axion-like particle searches at DarkQuest

Axion-like particles (ALPs) interacting with the Standard Model can be abundantly produced in proton beam fixed-target experiments. Looking for their displaced decays is therefore an effective search strategy for ALPs with a mass in the MeV to GeV range. Focusing on the benchmark models where the ALP interacts dominantly with photons or gluons, we show that the proposed DarkQuest experiment at Fermilab will be able to test parameter space which has been previously inaccessible. We pay particular attention to the self-consistency of gluon-coupled ALP production and decay calculations, which has been recently shown to be a problem in many existing predictions. We also apply these results to explore existing constraints in the ALP parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

LANL Critical Benchmark Comparison Study and Subsequent Revision

As part of an international collaboration within the DOE Nuclear Criticality Safety Program (NCSP), LANL is involved in a comparison study to quantify differences in k-effective results from neutron transport simulations of critical benchmark experiments. The DOE NCSP Mission and Vision details the activity in which the French Institut De Radioprotection et De Sûreté Nucléaire (IRSN) leads the study with LANL and in conjunction with ORNL and LLNL to compare results of various neutron transport codes and nuclear data libraries to compute k-effective for ICSBEP benchmarks held in common by the entities. This report documents results obtained through partial completion of the overall effort with a focus on the changes made to LANL benchmarks modeled with MCNP6 using ENDF/B-VII.1 nuclear data that appeared to have discrepant results when compared with results of other codes. The feedback received through participation in the comparison collaboration has prompted an effort to review particular input files for benchmarks and revise when necessary. This report documents the results of review and revision of specific benchmarks highlighted as possibly discrepant in the comparison study. In addition, this effort prompted a new collaboration between LANL XCP and NCS Divisions in the development of a shared review/revision procedure and use of a new benchmark repository.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Enhancement of PyARC for Westinghouse Electric Company’s Lead Fast Reactor Design and Modeling (Final TCF Report)

Westinghouse Electric Company is a nuclear reactor vendor headquartered in the U.S. that is developing advanced reactor technology for the U.S. and global markets. Westinghouse has been relying on the neutronics Argonne Reactor Codes (ARC) executed through the NEAMS Workbench and its PyARC module that are developed under the DOE-NE Nuclear Energy Advanced Modeling and Simulation (NEAMS) and Advanced Reactor Technology (ART) – Fast Reactor programs. Through this user experience, Westinghouse identified several enhancements that would benefit the ARC codes’ usability by the US industry and therefore its commercialization potential. The enhancements were proposed to deliver both improvements in workflow and analysis capabilities to better support effective fast reactor core design and analysis to the nuclear industry. The PyARC workflow was extended in this project by integrating non-neutronic ARC codes DASSH and NUBOW-3D. The Ducted Assembly Steady-State Heat equation (DASSH) code is developed at ANL to perform steady-state thermal hydraulic sub-channel analysis in liquid metal fast reactor assemblies to determine optimized coolant flow and temperature distributions, which in this project was updated and validated for lead fast reactor (LFR) applications. The interface between REBUS and NUBOW-3D were improved in this project to assess the impact of the core restraint design and thermal induced expansion effects on the reactivity of the core, and to model the deformations of the fuel assemblies induced by temperature and irradiation. Finally, the ARC models that were extensively verified and validated through various SFR-based modeling benchmarks are extended in this project through code-to-code comparison on relevant LFR-specific neutronics benchmarks against Monte-Carlo neutronic solutions. Overall, this work enables verification of the capability of the ARC codes for a wide range of Generation-IV reactor designs. The outcome of this project is the release of a comprehensive modeling toolkit of validated, robust and efficient codes, as well as their user interface, that enables industry to perform a wide range of fast reactor analyses for design and licensing of their concepts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Search for a W' boson decaying to a vector-like quark and a top or bottom quark in the all-jets final state at $\sqrt{\mathrm{s}}$ = 13 TeV

A search is presented for a heavy W' boson resonance decaying to a B or T vector-like quark and a t or a b quark, respectively. The analysis is performed using proton-proton collisions collected with the CMS detector at the LHC. The data correspond to an integrated luminosity of 138 fb -1 at a center-of-mass energy of 13 TeV. Both decay channels result in a signature with a t quark, a Higgs or Z boson, and a b quark, each produced with a significant Lorentz boost. The all-hadronic decays of the Higgs or Z boson and of the t quark are selected using jet substructure techniques to reduce standard model backgrounds, resulting in a distinct three-jet W' boson decay signature. No significant deviation in data with respect to the standard model background prediction is observed. Upper limits are set at 95% confidence level on the product of the W' boson cross section and the final state branching fraction. A W' boson with a mass below 3.1 TeV is excluded, given the benchmark model assumption of democratic branching fractions. In addition, limits are set based on generalizations of these assumptions. These are the most sensitive limits to date for this final state.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Godiva IV Thermal Neutron Dosimetry Modeling and Variance Reduction

The transfer of the Godiva IV experiment from the Los Alamos Critical Experiments Facility (LACEF) to the National Critical Experiments Research Center (NCERC) introduced a vastly different experiment room return to the neutron flux. The contribution of the background to the burst neutron energy spectrum is significant in the thermal and epithermal neutron energies. Target materials may be placed in various locations in the Godiva room, or outside of the room, for thermal neutron activation. Modeling of this dosimetry problem in Monte Carlo N-Particle (MCNP) presented a novel challenge compared to previous Godiva IV glory hole irradiation simulations. An advanced dosimetry modeling framework for high efficiency calculations in locations far from the Godiva IV fission source was desired. The mesh-based weight windows and point detector advanced variance reduction techniques in MCNP were implemented and tested using adaptations of the critical experiment benchmark model of the Godiva IV problem. The models were validated against measured activations of Nickel, Indium, Scandium, and Cobalt foils at locations 2 meters from the Godiva IV core. Dosimetry measurements were performed in collaboration with Sandia National Laboratory. The weight windows and point detector variance reduction coupled method resulted in the highest problem efficiency.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2010

Description of a Website Resource for Turbulence Modeling Verification and Validation

The activities of the Turbulence Model Benchmarking Working Group - which is a subcommittee of the American Institute of Aeronautics and Astronautics (AIAA) Fluid Dynamics Technical Committee - are described. The group s main purpose is to establish a web-based repository for Reynolds-averaged Navier-Stokes turbulence model documentation, including verification and validation cases. This turbulence modeling resource has been established based on feedback from a survey on what is needed to achieve consistency and repeatability in turbulence model implementation and usage, and to document and disseminate information on new turbulence models or improvements to existing models. The various components of the website are described in detail: description of turbulence models, turbulence model readiness rating system, verification cases, validation cases, validation databases, and turbulence manufactured solutions. An outline of future plans of the working group is also provided.

Rumsey, Christopher L.↗
DOE OSTI2023

Search for lepton-flavour violation in high-mass dilepton final states using 139 fb−1 of pp collisions at $$ \sqrt{s} $$ = 13 TeV with the ATLAS detector

A search is performed for a heavy particle decaying into different-flavour, dilepton final states, using 139 fb − 1 of proton-proton collision data at $$ \sqrt{s} $$ s = 13 TeV collected in 2015–2018 by the ATLAS detector at the Large Hadron Collider. Final states with electrons, muons and hadronically decaying tau leptons are considered ( eμ , eτ or μτ ). No significant excess over the Standard Model predictions is observed. Upper limits on the production cross-section are set as a function of the mass of a Z ′ boson, a supersymmetric τ -sneutrino, and a quantum black-hole. The observed 95% CL lower mass limits obtained on a typical benchmark model Z ′ boson are 5.0 TeV (e μ ), 4.0 TeV (e τ ), and 3.9 TeV ( μτ ), respectively.

Aad, G.↗
DOE OSTI2023

A general spatial-temporal framework for short-term building temperature forecasting at arbitrary locations with crowdsourcing weather data

Weather forecasting has been a critical component to predict and control building energy consumption for better building energy management. Without accessibility to other data sources, the onsite observed temperatures or the airport temperatures are used in forecast models. In this paper, we present a novel approach by utilizing the crowdsourcing weather data from neighboring personal weather stations (PWS) to improve the weather forecast accuracy around buildings using a general spatial-temporal modeling framework. The final forecast is based on the ensemble of local forecasts for the target location using neighboring PWSs. Our approach is distinguished from existing literature in various aspects. First, we leverage the crowdsourcing weather data from PWS in addition to public data sources. In this way, the data is at much finer time resolution (e.g., at 5-minute frequency) and spatial resolution (e.g., arbitrary location vs grid). Second, our proposed model incorporates spatial-temporal correlation information of weather variables between the target building and a set of neighboring PWSs so that underlying correlations can be effectively captured to improve forecasting performance. Here, we demonstrate the performance of the proposed framework by comparing to the benchmark models on temperature forecasting for a building located at an arbitrary location at San Antonio, Texas, USA. In general, the proposed model framework equipped with machine learning technique such as Random Forest can improve forecasting by 50% compares with persistent model and has 90% chance to outperform airport forecast in short-term forecasting. In a real-time setting, the proposed model framework can provide more accurate temperature forecasting results compared with using airport temperature forecast for most forecast horizon. Moreover, we analyze the sensitivity of model parameters to gain insights on how crowdsourcing data from the neighboring personal weather stations impacts forecasting performance. Finally, we implement our model in other cities such as Syracuse and Chicago to test the model's performance in different landforms and climate types.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Search for lepton-flavour violation in high-mass dilepton final states using 139 fb –1 of pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search is performed for a heavy particle decaying into different-flavour, dilepton final states, using 139 fb –1 of proton-proton collision data at $\sqrt{s}$ = 13 TeV collected in 2015–2018 by the ATLAS detector at the Large Hadron Collider. Final states with electrons, muons and hadronically decaying tau leptons are considered (eμ, eτ or μτ). No significant excess over the Standard Model predictions is observed. Upper limits on the production cross-section are set as a function of the mass of a Z' boson, a supersymmetric τ-sneutrino, and a quantum black-hole. The observed 95% CL lower mass limits obtained on a typical benchmark model Z' boson are 5.0 TeV (eμ), 4.0 TeV (eτ), and 3.9 TeV (μτ), respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Stable Simulation of the Community Atmosphere Model Using Machine‐Learning Physical Parameterization Trained With Experience Replay

In recent years, machine learning (ML) models have been used to improve physical parameterizations of general circulation models (GCMs). A significant challenge of integrating ML models into GCMs is the online instability when they are coupled for long‐term simulation. We present a new strategy that demonstrates robust online stability when the physical parameterization package of an atmospheric GCM is replaced by a deep ML model. The method uses experience replay with a multistep training scheme of the ML model in which the model's own output at the previous time step is used in the training. Predicted physics tendencies in the replay buffer with the most recent errors in the training iterations are reused, making the ML model learn from its own errors. The training method reduces the gap between the offline and online environments of the ML model. The method is used to train the ML model as the physical parameterization of the Community Atmosphere Model (CAM5) with training data from the Multi‐scale Modeling Framework high resolution simulations. Three 6‐year online simulations of the CAM5 are carried out by using the ML physics package. The simulated spatial distributions of precipitation, surface temperature and zonally averaged atmospheric fields demonstrate overall better accuracy than that of the standard CAM5 and benchmark model even without the use of additional physical constraints or tuning. This work is the first to demonstrate a solution to address the online instability problem in climate modeling with ML physics by using experience replay.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

The Ten Lockheed Martin Cyber-Physical Challenges: Formalized, Analyzed, and Explained

Capturing and analyzing requirements of Cyber-Physical Systems (CPS) can be challenging, since CPS models typically involve time-varying and real-valued variables, physical system dynamics, or even adaptive behavior. MATLAB/Simulinkis a development and simulation framework that is widely used in industry to capture such systems. In this paper, we report on the application of NASA Ames tools to perform end-to-end analysis of the Ten Lockheed Martin Challenge Problems (LMCPS). LMCPS is a set of industrial Simulink model benchmarks and natural language requirements developed by domain experts. Our framework, which integrates the tools FRET and COCOSIM, is used to: 1) elicit, explain, and formalize the semantics of the given natural language requirements; 2) generate verification code and monitors that can be automatically attached to the Simulink models; 3) perform verification by using SMT-based model checkers. FRET and COCOSIM are open source, and can be used by other researchers and practitioners to replicate our case study. We provide a categorization of recurring patterns in the formalization of the requirements and discuss the strengths and weaknesses of our automated verification approach.

Anastasia Mavridou↗
DOE OSTI2025

Sparse chronology strategy for integrating seasonal energy storage in capacity expansion models

Here, this study develops the sparse chronology method to enhance the representative period framework in capacity expansion models, enabling the effective integration of long-duration energy storage modeling. Traditional representative period methods cannot capture the state of charge of seasonal energy storage systems because they do not establish effective inter-day linkages to connect the state of charge between periods. The sparse chronology approach addresses this limitation by establishing inter-day linkages that allow state of charge to shift inter-seasonally. At the same time, it groups identical representative days into partitions, applying constraints sparsely and implicitly to reduce computational load further. Validation results demonstrate that this method successfully simulates long-duration energy storage patterns, achieving close alignment with a continuous yearly benchmark model, with seasonal trends and state of charge cycles clearly represented. The computational load analysis reveals that the sparse chronology method efficiently applies constraints on maximum and minimum state of charge limits within the representative day framework, eliminating the need for detailed constraints on each individual day. By partitioning representative days and constraining only the start and end of each partition, the method significantly decreases computational requirements. Simulation results show that sparse chronology closely approximates the continuous yearly method's accuracy, even with as few as 20 representative days, achieving correlation values with the benchmark of nearly 0.9 in state of charge plots. Furthermore, it maintains computational efficiency, requiring only 4 % of the solver time compared to the continuous yearly method with 20 representative days. This approach allows capacity expansion models to incorporate long-duration energy storage with high temporal, spatial, and technological resolution, enabling more detailed modeling for large-scale power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Mean field model parameterization to recover coverage-dependent kinetics

Lateral interactions between adsorbates introduce coverage dependence into adsorption energies and activation barriers of surface reactions. Lattice-based kinetic Monte Carlo (kMC) simulations can capture these interactions quantitatively but are laborious to parameterize and solve. Mean field models are more tractable, but protocols to construct and parameterize them are unclear. Here we explore the ability of a coverage-aware mean-field model to map to a lattice-kMC model of a generic two-step reaction network, including quasi-equilibrated adsorption and rate-limiting dissociation steps. We derive expressions for mean-field and coverage-dependent adsorption energies and dissociation barriers and parameterize against lattice-kMC predictions. We show that the parameterized mean-field rates correlate with ground truth lattice-kMC results across a wide range of reaction conditions and identify regions where the mean field fails. The mean field model similarly captures kMC-derived rate-order, Arrhenius and Sabatier plots at a greatly reduced computational cost. Further, the results provide guidance for parameterizing mean-field models, benchmarked against explicit lattice-based approaches for incorporating the influence of coverage effects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Measurements of Irradiated Low Enriched Fuel with a Gamma-Ray Scanning System (ANIMMA 2023 Conference Presentation)

A gamma-ray scanning system was designed to perform post-irradiation measurements of nuclear fuel at Idaho National Laboratory (INL). The system is composed of a coaxial high-purity germanium (HPGe) detector, a collimator, and mechanical positioning stages that translate the fuel sample across the front of the collimator. A Monte Carlo N-Particle code simulation of the system and the fuel were created with vendor-supplied design specifications, dimensional measurements, and x-ray radiographs of the HPGe detector as well as all available fuel specifications. Benchmark measurements were performed by scanning an irradiated fuel rodlet containing eight pellets of 0.74% enriched UO2 in zirconium alloy. This fuel rodlet was part of the Environment Rodlet Transient Test Apparatus (SERTTA) testing campaign in the Transient Reactor Test Facility (TREAT). These results were compared to simulated spectra to help characterize the detector model and establish fidelity. One goal of the system is to determine the number of fissions per gram of UO2 in the fuel. This article documents the modeling, benchmarking measurements, and the calculated number of fissions per gram in the SERTTA-A rodlet which was previously irradiated at TREAT.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Machine learning techniques for intermediate mass gap lepton partner searches at the large hadron collider

We consider machine learning techniques associated with the application of a boosted decision tree (BDT) to searches at the Large Hadron Collider (LHC) for pair-produced lepton partners which decay to leptons and invisible particles. This scenario can arise in the minimal supersymmetric Standard Model (MSSM), but can be realized in many other extensions of the Standard Model (SM). We focus on the case of intermediate mass splitting ( ∼ 30 GeV ) between the dark matter (DM) and the scalar. For these mass splittings, the LHC has made little improvement over LEP due to large electroweak backgrounds. We find that the use of machine learning techniques can push the LHC well past discovery sensitivity for a benchmark model with a lepton partner mass of ∼ 110 GeV , for an integrated luminosity of 300 fb − 1 , with a signal-to-background ratio of ∼ 0.3 . The LHC could exclude models with a lepton partner mass as large as ∼ 160 GeV with the same luminosity. The use of machine learning techniques in searches for scalar lepton partners at the LHC could thus definitively probe the parameter space of the MSSM in which scalar muon mediated interactions between SM muons and Majorana singlet DM can both deplete the relic density through dark matter annihilation and satisfy the recently measured anomalous magnetic moment of the muon. We identify several machine learning techniques which can be useful in other LHC searches involving large and complex backgrounds. Published by the American Physical Society 2024

Astronomy & Astrophysics↗