Search NASA⌕ Search

SEARCH · Search NASA

Results for “input uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

RAVEN Theory Manual

RAVEN is a software framework able to perform parametric and stochastic analysis based on the response of complex system codes. The initial development was aimed at providing dynamic risk analysis capabilities to the thermohydraulic code RELAP-7, currently under development at Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose stochastic and uncertainty quantification platform, capable of communicating with any system code. In fact, the provided Application Programming Interfaces (APIs) allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating system response and explore input space using various sampling schemes such as Monte Carlo, grid, or Latin hypercube. However, RAVEN strength lies in its system feature discovery capabilities such as: constructing limit surfaces, separating regions of the input space leading to system failure, and using dynamic supervised learning techniques. The development of RAVEN started in 2012 when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework arose. RAVEN’s principal assignment is to provide the necessary software and algorithms in order to employ the concepts developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just to identify the frequency of an event potentially leading to a system failure, but the proximity (or lack thereof) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. peak pressure in a pipe) is exceeded under certain conditions. Most of the capabilities, implemented having RELAP-7 as a principal focus, are easily deployable to other system codes. For this reason, several side activates have been employed (e.g. RELAP5-3D, any MOOSE-based App, etc.) or are currently ongoing for coupling RAVEN with several different software. The aim of this document is to provide a set of commented examples that can help the user to become familiar with the RAVEN code usage.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Photon strength functions and nuclear level densities: invaluable input for nucleosynthesis

The pivotal role of nuclear physics in nucleosynthesis processes is being investigated, in particular the intricate influence of photon strength functions (PSFs) and nuclear level densities (NLDs) on shaping the outcomes of the i-, r- and p-processes. Exploring diverse NLD and PSF model combinations uncovers large uncertainties for (p, γ ), (n, γ ) and ( α , γ ) rates across many regions of the nuclear chart. These lead to potentially significant abundance variations of the nucleosynthesis processes and highlight the importance of accurate experimental nuclear data. Theoretical insights and advanced experimental techniques lay the ground work for profound understanding that can be gained of nucleosynthesis mechanisms and the origin of the elements. Recent results further underscore the effect of PSF and NLD data and its contribution to understanding abundance distributions and refining knowledge of the intricate nucleosynthesis processes. This article is part of the theme issue ‘The liminal position of Nuclear Physics: from hadrons to neutron stars’.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

An Uncertainty-Informed and High-Fidelity Performance Forecasting Framework for Heliostat Fields

Concentrating Solar Thermal (CST) tower systems employ heliostat fields to direct solar energy to a central receiver, which then transfers the heat either directly to a thermal process (e.g., steam production) or to a thermal energy storage system for future use. Heliostat fields compose a significant proportion of the project costs of a CST tower system and the performance of the heliostats determines a plant's productivity at a given location. While CST characterization tools such as SolarPILOT and System Advisor Model (SAM) include a large collection of inputs that influence the performance of a CST tower system, many are uncertain prior to the development of the project and may have a significant impact on the overall energy delivery and profitability of a project; moreover, the fidelity of these models under default conditions may be insufficient to determine the value of component improvements such as those under development in the Heliostat Consortium. This work introduces a Monte Carlo simulation framework that incorporates uncertainty in key performance parameters to generate confidence intervals and percentile estimates for a CST solar field's energy delivery.

14 SOLAR ENERGY↗
DOE OSTI2025

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment↗
DOE OSTI2021

Tracking Soiling Losses: Assessment, Uncertainty, and Challenges in Mapping

Several models have been presented in the recent years to estimate the magnitude of soiling from environmental parameters. However, these models are often based on data from a single site, or at most a few sites, and only limited data are, as of yet, available on their uncertainty. The present work aims to present a first comparative analysis of soiling estimation models, using measured soiling data from various locations in the USA. The study also investigates the impact that the source of the input data can have on the estimation. The results show that the model selection is only one of the factors that can affect the evaluation. Indeed, the use of satellite-derived or ground-mounted particulate matter data can lead to the generation of different soiling maps, with factors greater than 2x between the modeled losses. The current challenges and the unanswered questions that can bias soiling estimation are discussed. Additionally, potential research directions to improve the quality of soiling modeling are identified.

14 SOLAR ENERGY↗
DOE OSTI2026

Statistical Uncertainty of Inhalation Dose Coefficients: Impact of Particle Deposition in ICRP 66 Human Respiratory Tract Model

Inhaled radioactive materials can pose a long-term health concern, as the material can be incorporated into the body’s metabolic pathways and remain in organs and tissues for extended durations. During the retention period, the radioactive material may localize in a source organ and irradiate adjacent target organs and tissues. Distribution of these materials changes over time, requiring biokinetic modeling to evaluate their movement through various tissues and organs. The evolving distribution depends on multiple inputs characterizing the inhaled material, such as particle size and size distribution, particle density, aspect ratio, specific radionuclide, the chemical form, and solubility. In addition, biological parameters such as breathing rate, breathing type (nasal or nasal/oral), respiratory system morphometry, tidal volume, functional residual capacity, and anatomical dead space all influence material transport. These aerosol properties and physiological characteristics of the respiratory tract jointly define a range of initial conditions that influence the time-dependent distribution of radioactive material. To evaluate both uncertainty in the initial conditions of inhalation exposure and the final output (committed effective dose) from biokinetic models, a Python-based software tool, Radiological Exposure Dose Calculator (REDCAL), was developed to propagate uncertainty within the human respiratory tract model. Focusing on deposition fraction uncertainty, the primary objective was to characterize the initial activity distribution across respiratory regions as a function of anticipated particle sizes and distributions. The impact of the deposition fraction uncertainty was propagated to committed effective dose coefficients for selected radionuclides in a companion publication. For each particle size, a lognormal distribution, characterized by its geometric mean as defined within ICRP Publication 66, serves as the basis for introducing uncertainty into the physical processes governing deposition in various lung regions. Finally, this study addresses the deposition process and examines how uncertainty in deposition mechanisms affects activity distribution in the airways, ultimately presenting the expected range and standard deviation of deposited activity as a function of particle size.

International Commission on Radiological Protectio↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2023

DeepONet-grid-UQ: A trustworthy deep operator framework for predicting the power grid’s post-fault trajectories

This paper proposes a novel data-driven method for the reliable prediction of the power grid’s post-fault trajectories, i.e., the power grid’s dynamic response after a disturbance or fault. Here, the proposed method is based on the recently proposed concept of Deep Operator Networks (DeepONets). Unlike traditional neural networks that learn to approximate functions, DeepONets are designed to approximate nonlinear operators, i.e., mappings between infinite-dimensional spaces. Under this operator framework, we design a novel and efficient DeepONet that (i) takes as inputs the trajectories collected before and during the fault and (ii) outputs the predicted post-fault trajectories. In addition, we endow our method with the much-needed ability to balance efficiency with reliable/trustworthy predictions via uncertainty quantification. To this end, we propose and compare two novel methods that enable quantifying the predictive uncertainty. First, we propose a Bayesian DeepONet (B-DeepONet) that uses stochastic gradient Hamiltonian Monte-Carlo to sample from the posterior distribution of the DeepONet trainable parameters. Then, we design a Probabilistic DeepONet (Prob-DeepONet) that uses a probabilistic training strategy to enable quantifying uncertainty at virtually no extra computational cost. Finally, we validate the proposed methods’ predictive power and uncertainty quantification capability using the New York-New England power grid model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Sensitivity Analysis and Effective Parametrization of PEM Fuel Cell Models

The cost of proton-exchange-membrane fuel cells (PEMFCs) remains a major hurdle in large-scale commercialization of this technology. To improve their performance and reduce cost, novel materials and electrode designs are continuously envisioned, e.g., non-PGM catalyst layers, ultra-thin Pt/Pt-Ni based catalyst layers, structured ionomer arrays or NSTF catalyst layers.1 Understanding the impact of these improvement strategies can be extremely time and cost intensive due to complex physical phenomena and large design space. We have previously developed a PEMFC modeling framework2 which has been a time and cost effective tool for understanding and optimizing the complex multi-physics phenomena within PEMFCs; however, several of the cell parameters used in the modeling have large spread in measured data.3 Furthermore, several transport parameters such as water adsorption kinetics have not been accurately measured and the approximations are spread over several orders of magnitude. These uncertainties cause problems in ascertaining accuracy of the modeling approach and they reduce the predictive power of the numerical models. The aim of this work is to identify the sensitivity of PEFC numerical model outputs to various input parameters. The previously in-house developed MEA modeling framework2 is used for PEMFC modeling. The sensitivity of the model outputs with respect to inputs parameters is obtained by analyzing the condition numbers for different output-input pairs at varying operating conditions. An example of the sensitivity analysis is shown in Figure 1. The condition numbers are obtained for the entire possible range of input parameters at varying operating conditions to identify the most crucial parameters of the PEMFC model. Based on our preliminary analysis, parameters related to kinetics (exchange current density and ECSA) and heat/water management in electrodes and ionomer (ionomer fraction, thermal conductivity) are most crucial. One of the major goals of this work is to identify the most crucial set of parameters towards which the model shows maximum sensitivity. This will guide future experimentalists to measure these properties with higher accuracy. Furthermore, the sensitivity analysis will also enable us to optimize the PEMFC performance by selectively targeting the most sensitive parameters and thereby making the largest impact. Acknowledgements The work is funded under the Fuel Cell Performance and Durability Consortium (FC-PAD), by the Fuel Cell Technologies Office (FCTO), Office of Energy Efficiency and Renewable Energy (EERE), of the U.S. Department of Energy under contract number DE-AC02-05CH11231. The authors would like to thank Nathan Craig at Robert Bosch LLC for his valuable input in designing the sensitivity analysis. The authors would also like to thank Giovanna Bucci and Matthias Hanauer at Robert Bosch for their valuable inputs and discussion. References P. K. Sinha, W. Gu, A. Kongkanand and E. Thompson, J. Electrochem. Soc., 158, B831 (2011). L. M. Pant, M. R. Gerhardt, N. Macauley, R. Mukundan, R. L. Borup and A. Z. Weber, Electrochim. Acta, 326, 134963 (2019). R. Vetter and J. O. Schumacher, ArXiv181110091 Phys. (2018). Figure 1

Pant, Lalit↗
DOE OSTI2020

SAM Plug-in Development (Phase I Final Report)

The DOE Office of Nuclear Energy (NE) has created an extensive set of advanced modeling and simulation tools for nuclear engineering analysis. The advanced capabilities of these newer analysis codes require more in-depth training, skills, and knowledge in order to effectively utilize them for the design, analysis, and licensing of advanced nuclear systems and experiments. A high learning curve for inexperienced users may deter organizations from incorporating these tools into their internal processes. This project involved development of a plug-in to the Symbolic Nuclear Analysis Package (SNAP) for the System Analysis Module (SAM) tool. SAM is an advanced system analysis tool for reactor transient analyses being developed at Argonne National Laboratory under the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. SAM utilizes an object-oriented application framework (MOOSE), and its underlying meshing and finite-element library (libMesh) and linear and non-linear solvers (PETSc), to leverage modern advanced software environments and numerical methods. SNAP provides a highly flexible framework for creating, modifying and documenting input for engineering analysis codes such as SAM as well as extensive functionality for submitting, monitoring, and interacting with the codes through an intuitive graphical user interface (GUI). The common user interface provided by SNAP minimizes the learning curve for engineers starting with a new analysis code and provides an intuitive framework for transitioning between different analysis codes. SNAP provides a powerful but intuitive interface to facilitate access to advanced modeling and simulation tools for inexperienced users. Unlike many “form based” GUI’s, SNAP maps each engineering code’s component input to an internal database which manages all component input parameters along with component interconnections. This level of abstraction permits SNAP to support several advanced capabilities such as renodalization, model validation and consistency checks, embedded documentation, model notebook generation, data ownership and reviewer tracking, and variable assignment for inputs to name a few. SNAP includes a built-in Python interpreter and is interfaced to several commercial and open source packages including CPython, MATLAB/OCTAVE, Microsoft Office, Open Office, and SANDIA’s DAKOTA package which provides Uncertainty Quantification analysis through the SNAP plug-ins. Phase I of this project involved development a fully functional basic SAM plug-in to SNAP. This plug-in provides the ability to import existing models, graphically construct, edit and submit models using SNAP’s extensive functionality.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Sensitivity Study for Forecasting Variables of WRF-Solar Using a Tangent Linear Approach

Integrating solar generation in recent years has highlighted the need for improved accuracy in predicting solar power. Confidence in solar power forecasting can be achieved by designing an ensemble that provides reliable probabilistic information for solar radiation with reduced uncertainty and error. Ideally, ensemble members are created through the optimized perturbation of the initial conditions in numerical weather prediction (NWP) models. Tangent linear models are capable of efficiently investigating the sensitivity of solar radiation to model input parameters because they do not require individual perturbation of each variable. This sensitivity study using tangent linear models provide us the capability to identify the right variables to perturb in an ensemble prediction system. In this study, we developed tangent linear models for WRF-Solar modules that directly impact the computation of solar radiation and the simulation of cloud formation and dissipation including the Fast All-sky Model for Solar Applications (FARMS), the Noah land surface model (LSM), the Thompson microphysics, the Mello-Yamada-Nakanishi-Niino (MYNN) boundary layer parameterization, and the Deng scheme for a shallow-convection parameterization. A sensitivity analysis was conducted under various scenarios based on satellite observations and model simulations from the National Solar Radiation Data Base (NSRDB) and WRF-Solar, respectively. Critical forecasting variables that are highly sensitive to the forecasting of global horizontal irradiance (GHI), direct normal irradiance (DNI), cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes were determined using the relevant WRF-Solar module. This study will be used as a guidance on future research leading to high-quality probabilistic solar forecasting. In this presentation, we discuss the validation of tangent linear approach for WRF-Solar modules and illustrate how the sensitivity results are valuable in the improvement of probabilistic solar prediction.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Unbinned extraction of $γ$ from $B\to DK$ with normalizing flows

We introduce an unbinned method for extracting the CKM angle $γ$ from the decay chain $B^\pm \to (D \to K_S π^+ π^-) K^\pm$ using normalizing flows (NFs). The NFs, trained on $D$ decay data, learn a faithful continuous representation of the amplitude and strong phase variation over the $D\to K_Sπ^+π^-$ Dalitz plot whose fidelity improves with increased data sample sizes. With this input, the $B$ decay data can be used to extract the parameters $r_B$, $δ_B$, and $γ$. We test the method on Monte Carlo generated data, where it successfully recovers the injected value of $γ$ within uncertainties. The present implementation propagates statistical uncertainties from finite training data via an ensemble of independently trained flows, and does not attempt to capture the effects of systematic experimental errors. We explore two versions of the method that differ in how the trigonometric constraint on phase variation is encoded, and comment on the possible extension to Bayesian NFs, which would provide direct uncertainty estimates on the learned densities without requiring ensemble training.

Grossman, Yuval [Cornell U., LEPP]↗
DOE OSTI2023

Prediction and uncertainty quantification of shale well performance using multifidelity Monte Carlo

Uncertainty quantification is an integral component of reservoir management, especially considering the inherent uncertainty in subsurface systems. While a standard practice to estimate the uncertainty, Monte Carlo (MC) simulation is computationally intense when the sampling population comprises high-fidelity simulations. Alternatively, the Multi-fidelity Monte Carlo (MFMC) simulation overcomes this computational intensity by integrating low- and high-fidelity simulations. Our goal is to minimize the number of expensive high-fidelity simulations while maintaining accuracy and using numerous fast and cheap low-fidelity simulations to efficiently sample to input parameter space of interest. We selected gas production from unconventional wells to demonstrate the potential speedups and accuracy of the MFMC approach. The model fidelity usually determines the trade-off between accuracy and efficiency. While the high-fidelity model is more accurate, the low-fidelity model is more efficient. Our high-fidelity simulation includes reservoir simulations of a hydraulically fractured well. On the other hand, our low-fidelity model comprises the parallel-plate flow model. We used differential programming to efficiently solve the 1D flow model, where automatic differentiation is used to efficiently compute the gradients. We matched the production profile of high-fidelity simulations with our low-fidelity simulations. Then, we used a support vector regression to map the high- and low-fidelity input parameters. The mapping function is essential to tune the low-dimensional parameter space of the low-fidelity model to the high-dimensional parameter space of the high-fidelity model. We found that we can use a combination of 9 high fidelity and 10,000 low fidelity simulations to efficiently and accurately simulate pressure management. This method is at least two orders of magnitude faster than only using high-fidelity simulations. Finally, from a broader perspective, MFMC could efficiently estimate the uncertainty of various systems and models, integrating low- and high-fidelity models.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2026

The Role of Nuclear Data Sensitivities in Prompt α-Eigenvalue Predictions of Delayed Critical Benchmarks

Alpha (α) eigenvalues, which describe the logarithmic time derivative of the neutron population in a multiplying system, are integral to time-dependent behavior and diagnostic applications. However, uncertainties in the evaluated nuclear data can significantly impact the accuracy of transport simulations for such quantities. This work explores the use of machine learning models to predict two key outputs, α-eigenvalues and keff bias, using input features derived from α-eigenvalue sensitivities to nuclear data. The criticality safety benchmark models used in this study come from the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Three models, random forest, XGBoost, and NGBoost, are trained on both energy-resolved and energy-summed α sensitivities. For the α-eigenvalue bias prediction, NGBoost achieved the highest R 2 (0.9476) using energy-resolved features, while XGBoost performed best using summed sensitivities. In contrast, when predicting the keff bias, all the models showed moderate predictive capability (best R 2 ≈ 0.72), as the mapping from the static α-sensitivities to the static keff bias was less direct. SHAP (SHapley Additive exPlanations) analysis was used to interpret the model predictions. Across both prediction tasks, the features associated with neutron capture [H-1 (n, γ)], uranium scattering reactions (such as 235 U elastic/inelastic), and actinide capture/fission reactions (such as 239 Pu and 234 U) were consistently identified as the most impactful. This highlights the key role of specific nuclear reactions and energy ranges in shaping both time-dependent and steady-state criticality behavior. These results demonstrated that α-sensitivities, despite being computed for time-dependent metrics, can provide valuable insights for predicting both α-eigenvalues and the keff bias. Moreover, machine learning models offer a promising pathway for uncovering important nuclear data dependencies and guiding future data evaluation efforts.

Nuclear data↗
DOE OSTI2022

The PDF4LHC21 combination of global PDF fits for the LHC Run III

A precise knowledge of the quark and gluon structure of the proton, encoded by the parton distribution functions (PDFs), is of paramount importance for the interpretation of high-energy processes at present and future lepton–hadron and hadron–hadron colliders. Motivated by recent progress in the PDF determinations carried out by the CT, MSHT, and NNPDF groups, we present an updated combination of global PDF fits: PDF4LHC21. It is based on the Monte Carlo combination of the CT18, MSHT20, and NNPDF3.1 sets followed by either its Hessian reduction or its replica compression. Extensive benchmark studies are carried out in order to disentangle the origin of the differences between the three global PDF sets. In particular, dedicated fits based on almost identical theory settings and input datasets are performed by the three groups, highlighting the role played by the respective fitting methodologies. We compare the new PDF4LHC21 combination with its predecessor, PDF4LHC15, demonstrating their good overall consistency and a modest reduction of PDF uncertainties for key LHC processes such as electroweak gauge boson production and Higgs boson production in gluon fusion. We study the phenomenological implications of PDF4LHC21 for a representative selection of inclusive, fiducial, and differential cross sections at the LHC. The PDF4LHC21 combination is made available via the LHAPDF library and provides a robust, user-friendly, and efficient method to estimate the PDF uncertainties associated to theoretical calculations for the upcoming Run III of the LHC and beyond.

quantum chromodynamics↗
DOE OSTI2025

Development of a Discrepancy Checker for the Digital Twin in a Supervisory Control System for a Thermal Energy Delivery System

Defined as a virtual representation of a physical object, process, or service, and used to support real-world decision-making, a digital twin (DT) can be utilized to combine classical and novel frameworks in sensors, state predictions, and multi-input/multi-output systems, and to enable optimal autonomous operations. However, a DT’s usefulness largely depends on its ability to adequately mirror the state of its physical counterpart, and this adequacy should be reflected by the level of uncertainty in the underlying simulation models when estimating and predicting quantities of interest (QOIs). Moreover, simulation models in a DT may involve multiple fidelities of representations—ranging from physics-based models to data-driven ones—but classical uncertainty quantification (UQ) methods struggle to handle numerous uncertainty sources, nor are they designed for real-time applications. This work presents a UQ-based discrepancy checking and diagnosis tool for a DT-based supervisory control system applied to a thermal energy delivery system (TEDS) at Idaho National Laboratory. The discrepancy checker was developed using metadata from an automated DT development process, and these metadata included different combinations of physical model forms and model parameters, training data and hyperparameters for surrogate models, and design parameters for supervisory control systems. Next, correlations between the uncertainty results and the metadata were established and then applied to the DT operations. The discrepancy checker evaluates the discrepancies between model predictions from virtual and sensor measurements and backtraces them to the corresponding major sources of uncertainty. The discrepancy checker showed reasonable performance in detecting discrepancies and diagnosing sources of uncertainty in testing scenarios.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Model uncertainty obscures major driver of soil carbon

Understanding the formation and stabilization mechanisms of soil organic carbon (SOC) is important for managing land carbon (C) and mitigating climate change. Tao et al. reported that microbial C use efficiency (CUE) is the primary determinant of global SOC storage and that the relative impact of plant C inputs on SOC is minor. Although soil microbes undoubtedly play an important role in SOC cycling, we are concerned about the robustness of the approach taken by Tao et al. In conclusion, the potential biases in their analyses may lead to misleading, model-dependent results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Jet classification using high-level features from anatomy of top jets

Recent advancements in deep learning models have significantly enhanced jet classification performance by analyzing low-level features (LLFs). However, this approach often leads to less interpretable models, emphasizing the need to understand the decision-making process and to identify the high-level features (HLFs) crucial for explaining jet classification. To address this, we consider the top jet tagging problems and introduce an analysis model (AM) that analyzes selected HLFs designed to capture important features of top jets. Our AM mainly consists of the following three modules: a relation network analyzing two-point energy correlations, mathematical morphology and Minkowski functionals for generalizing jet constituent multiplicities, and a recursive neural network analyzing subjet constituent multiplicity to enhance sensitivity to subjet color charges. We demonstrate that our AM achieves performance comparable to the Particle Transformer (ParT) while requiring fewer computational resources in a comparison of top jet tagging using jets simulated at the hadronic calorimeter angular resolution scale. Furthermore, as a more constrained architecture than ParT, the AM exhibits smaller training uncertainties because of the bias-variance tradeoff. We also compare the information content of AM and ParT by decorrelating the features already learned by AM. Lastly, we briefly comment on the results of AM with finer angular resolution inputs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗