Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Advancing environmental assessment of the circular economy: Challenges and opportunities

The lifecycle assessment (LCA) framework is widely applied to comprehensively evaluate and improve the environmental performance of a circular economy (CE). The advances and application of LCA has been primarily restricted to evaluate the environmental performance of the CE at a micro-level, wherein the CE is implemented for a single product system. However, the CE can be operationalized at two broader levels: the meso–level (for eco-industrial parks) and the macro-level (for a city, state, or nation). Six methodological challenges emerge when applying LCA to a meso- or macro-level CE and remain unaddressed in the existing literature. This includes: selecting a relevant system boundary and functional unit, addressing data paucity and uncertainty, accounting for stakeholder behavior, assessing the trade-offs from renewable energy (RE) use, accounting for manufacturing and technology evolution, and quantifying displacement and rebound. This article proposes potential solutions and research priorities to address the above challenges.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Uncertainty Analysis Framework for the Hospital Resource Supply Model for Covid-19

In March and April of 2020 there was widespread concern about availability of medical resources required to treat Covid-19 patients who become seriously ill. A simulation model of supply management was developed to aid understanding of how to best manage available supplies and channel new production. Forecasted demands for critical therapeutic resources have tremendous uncertainty, largely due to uncertainties about the number and timing of patient arrivals. It is therefore essential to evaluate any process for managing supplies in view of this uncertainty. To support such evaluations, we developed a modeling framework that would allow an integrated assessment in the context of uncertainty quantification. At the time of writing there has been no need to execute this framework because adaptations of the medical system have been able to respond effectively to the outbreak. This report documents the framework and its implemented components should need later arise for its application.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗
DOE OSTI2021

Treatment of uncertainties for security-related design aspects of advanced reactors when using a risk-informed licensing approach

Sabotage of nuclear plants and theft of special nuclear material are different from many other issues potentially affecting public health and safety, and some of those differences drive the content of the present report. A high-level indication of these differences is provided in the US Nuclear Regulatory Commission’s Safety Goal Policy. Promulgated in the mid-1980’s, when it had become reasonably clear that risk analysis had improved to the point where it was possible to understand the risks associated with plant operation, the Safety Goal Policy articulates qualitative safety goals and quantitative health objectives that are meant to guide regulatory and risk management activities, with the following key exceptions noted in the original policy statement: The possible effects of sabotage or diversion of nuclear material are also not presently included in the safety goals. At present there is no basis on which to provide a measure of risk on these matters. It is the Commission’s intention that everything that is needed will be done to keep these types of risks at their present very low level; and it is the Commission’s expectation that efforts on this point will continue to be successful. With these exceptions, it is the Commission’s intent that the risks from all the various initiating mechanisms be considered to the best of the capability of current evaluation techniques. The present report discusses extensions of classical risk management to address some of the special issues that arise in the context of security. Although the present emphasis is on physical security, some attention will be paid to cyber security. A particular focus of the report is on quantitative framework to manage and address uncertainties. This framework is demonstrated via a couple of hypothetical examples.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗
DOE OSTI2020

Model uncertainty in accelerator application simulations

Monte-Carlo nuclear reaction and transport codes are widely used to devise accelerator-based nuclear physics experiments; at the same time, many experiments are performed to validate the Monte-Carlo codes, which can be used for the design of full-scale nuclear power applications or the design of new benchmark experiments. Dedicated model benchmark studies investigate a broad range of nuclear reactions and quantities. Examples of these include isotope formation or secondary particle fluxes that result from the interactions of GeV-range hadrons with monoisotopic targets, which can be used to assess the respective systematic uncertainty of models. Such benchmark studies, as well as many nuclear application experiments and simulations carried out by various groups over the last few decades, enable us to draw methodological lessons. In this work, model uncertainty determined based on available experimental data allow us to identify the effects of practitioner expertise as well as the design of codes (user access to micro-scale parameters) on the range of uncertainties. We found that in cases when simulations are performed by code developers or users that are very experienced in performing simulations, the model to experiment quantity ratios generally agree with the limits determined by dedicated benchmark studies. In other cases, the ratios generally tend to be either smaller (underestimation of model error) or larger (overestimation of model error). A plausible explanation of the aforementioned effects is suggested.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Hero Carbonsafe Phase 2 Project in the Columbia River Basalt Group: Technical Program Overview

The Hermiston, Oregon Basalt CarbonSAFE Phase II project (HERO CarbonSAFE) seeks to accelerate the deployment of commercial carbon dioxide (CO2) storage projects in basaltic rocks. Hermiston is located near the center of the Columbia River Basalt Group (CRBG), which is one of the largest basalt flows in the US. Basalt CO2 storage has potential advantages to conventional saline storage reservoirs including 1. The potential for rapid mineralization of CO2, 2. associated decreases in pressure and CO2 migration risks, 3. reduced long-term monitoring requirements with respect to plume tracking, 4. widespread geographic distribution and, 5. large storage potential due to thickness, porosity, and CO2 interactions with basalt. For locations such as the Pacific Northwest (PNW), Hawaii, Iceland, India and Japan, whose localities are isolated from large sedimentary basins offering conventional saline storage options, basalt may offer the only feasible option for local CO2 storage. However, mineralization/basalt storage still has many uncertainties, as there are limited field-scale assessments of CO2 storage in basalt. There are significant uncertainties hindering the effective implementation of carbon capture utilization and storage (CCUS) in basalt. These include the lack of proven storage capacities, challenges in methodologies for modeling the area of review in igneous formations, limited understanding of mineralization kinetics and timing, and uncertainties in injectivity. Additionally, the domestic availability of specialized services and drilling expertise is constrained, and existing CCUS permitting and regulatory frameworks, originally developed for conventional saline reservoirs, may not adequately address the unique requirements of basalt systems. HERO CarbonSAFE is designed to address major research gaps and uncertainties associated with basalt storage. Specifically, the project will assess the feasibility of CO2 injection in the deep layered basalts of the CRBG, long-term storage (mineralization), practical approaches for large-scale implementation (50+ million metric tons of CO2 over 30 years), lithology-specific risks, and the technoeconomic potential for CO2 storage in basalts.

58 GEOSCIENCES↗
DOE OSTI2025

Initial Uncertainty Analysis of Carbon Tetrachloride Contamination and Remediation in the Ringold A and Lower Mud Units at the Central Plateau

The long-term effectiveness of groundwater cleanup at the Hanford Site Central Plateau depends on predictive models that can capture key uncertainties in contaminant fate and transport. Carbon tetrachloride (CCl 4 ), a persistent and toxic compound, presents particular challenges due to variability in degradation rates, uncertainty in initial plume distribution, and subsurface heterogeneity. These uncertainties directly influence plume persistence, migration pathways, and remedy performance, and thus must be systematically evaluated to support long-term remediation planning. To address these gaps, a large-scale Monte Carlo analysis was conducted using the Plateau to River (P2R) model framework. The modeling approach parameterized three primary uncertainty factors: (1) degradation rate, (2) initial plume distribution, and (3) hydraulic conductivity. Degradation was represented as a first-order process, with half-lives ranging from 70 to 700 years. Initial plume distributions were created using a geostatistical simulation method (sgsim), which generates many equally plausible versions of how contaminants might be distributed underground. From this, 100 different scenarios were mapped onto the P2R grid. Variability in hydraulic conductivity was represented in a similar way, with 100 scenarios each for the Ringold Lower Mud and Ringold A units (layers 6 and 7), based on fitted exponential variograms and conditioned to well data. In total, more than 1000 realizations were simulated to assess plume behavior under uncertainty. Results demonstrate that degradation kinetics exert the strongest control over plume persistence: Shorter half-lives produced rapid mass reduction, while longer half-lives yielded persistent plumes with limited attenuation. A nonlinear response was observed, with steep mass reductions at half-lives greater than 200 years and near-linear declines beyond this threshold, reflecting interactions between degradation and pumping. The initial plume distribution strongly influenced early transport patterns, with broader sources generating larger plume footprints, although pump-and-treat operations constrained plume migration to managed areas. By comparison, hydraulic conductivity variability in the Ringold units had only a secondary influence, modifying spreading behavior without altering the dominant migration pathways governed by source configuration and hydraulic controls. Overall, the analysis highlights that uncertainty in degradation rate and initial plume configuration are the primary drivers of variability in plume predictions, while conductivity heterogeneity plays a limited role. These findings underscore the need for improved site-specific data on degradation processes and source characterization to enhance the reliability of long-term performance assessments and to better inform remedial decision-making at the Central Plateau.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Development and application of two-step uncertainty propagation and sensitivity analysis methodology for fast reactor safety analysis

Uncertainty quantification (UQ) in nuclear reactors for transients is directly linked with safety assessment through the cross-sections uncertainties, provided as a covariance matrix, which are propagated through the reactor system to output of interest pertaining to reactor safety, such as peak temperatures in fuel/clad/coolant. Using a two-step approach, uncertainties are first quantified and propagated from basic input variables (such as reaction cross-sections) to intermediate quantities (such as reactivity feedback coefficients) through lattice level calculations. Uncertainties of intermediate quantities (from the first step) are then propagated through the system transient calculations, in the second step, to obtain uncertainties on reactor safety output parameters of interest. The scope of this work consists of Uncertainty Quantification & Propagation of nuclear data uncertainties that are highly correlated through unprotected transient overpower and unprotected loss of flow to assess their impact on core safety parameters. This two-step approach in the presence of covariance renders the sensitivity analysis very challenging. In fact, usually the sensitivity analysis is restricted to each step, which limits its application since the sensitivities between the system output quantities and the basic input variables are difficult to obtain. Here, in this work, we address this issue by proposing a simple, general methodology to combine the sensitivity indices obtained in each step by assuming the model behavior being linear. For the first step Generalized Perturbation theory based indices are used while in the second step the recently studied Johnson indices. The uncertainty quantification and sensitivity methodologies discussed here are demonstrated on a generic LFR design which is based on the 500 MWth demonstration Lead-cooled fast reactor (DLFR) using oxide fuel, developed by Westinghouse Electric Company (WEC).

42 - ENGINEERING↗
DOE OSTI2026

Probability of Hydrogen Ignition: A Landscape Review and Gaps Assessment

The primary hazard of a leak from a hydrogen system is due to the immediate or delayed ignition of the fuel leading to a jet flame or explosion. Therefore, understanding the hydrogen ignition probability is critical for analyzing the risk of hydrogen systems. This report reviews the current understanding of hydrogen ignition mechanisms and methods for modeling their probability. The stoichiometry, ignition strength, and ignition source temperature are all important characteristics that can affect both the probability of ignition and the outcome of the subsequent combustion event. A brief review of diffusion ignition demonstrates that ignition probability models must account for seemingly spontaneous ignition of hydrogen in addition to scenarios where the ignition source is readily identified. State-of-the art models for both immediate and delayed ignition probabilities are presented, including different physical aspects of the scenarios (e.g., flow rate, ignition source characteristics) that are considered in the different modeling approaches. Current models often fail to account for the unique properties of hydrogen compared to other fuels, and most lack rigorous validation with hydrogen as a fuel. A fault tree framework is proposed to systematically evaluate the probability of ignition by integrating various ignition mechanisms and their uncertainties. Furthermore, this type of framework could enable additional insights into the most important mechanisms and would enable uncertainty quantification in risk assessment modeling. Recommendations for future research include the need for experimental validation of ignition models and the development of comprehensive methodologies that incorporate the specifics of hydrogen behavior in real-world scenarios.

hydrogen↗
DOE OSTI2022

Uncertainty quantification in elastic constants of SiC f /SiC m tubular composites using global sensitivity analysis

Silicon carbide fiber and silicon carbide matrix (SiC f /SiC m ) tubes produced through the chemical vapor infiltration process have become a candidate cladding material in nuclear applications. The performance of this composite is influenced by many variables such as braiding angle, porosity, material properties, etc., which vary over a range of values due to the inherent fluctuations in the manufacturing process. In this study, the variability in elastic constants of SiC f /SiC m composite has been quantified through multiscale finite element (FE) simulations, variable screening, and high-fidelity surrogate modeling. The key variables dominantly affecting the elastic constants of SiC f /SiC m tubes were identified using global sensitivity analysis. A surrogate to the high-fidelity FE-based model was used in Monte Carlo simulations to generate a hundred thousand samples from which the uncertainty in elastic constants was assessed. It turned out that the coefficient of variation was less than 10%.

Materials Science↗
DOE OSTI2026

Statistical Uncertainty of Inhalation Dose Coefficients in Consequence Management: Propagated Dose Uncertainty in ICRP 66 Human Respiratory Tract Model

Reference inhalation dose models rely on deterministic biokinetics and reference computational phantoms, limiting their applicability to the variability present in population-specific exposures encountered in emergency response scenarios. Here, this study introduces REDCAL, a Python-based computational framework developed to propagate uncertainty in inhalation dose coefficients using the International Commission on Radiological Protection (ICRP) Publication 66 Human Respiratory Tract Model. REDCAL integrates ICRP deposition and clearance models, systemic biokinetics, and governing physics principles, and leverages Sandia National Laboratories’ Dakota toolkit for uncertainty quantification via Latin Hypercube Sampling. REDCAL was validated against DCAL, with biokinetic retention results differing by less than 1% and effective dose coefficients by less than 2% across all tested radionuclides. Stochastic sampling introduced variability in dose coefficients, with geometric standard deviations (GSD) in committed effective dose coefficients (CEDC) ranging from 1.0 to 1.5, based on lognormal distribution fits. Analysis demonstrated that variations in the activity median aerodynamic diameter (AMAD) notably influenced the computed CEDC values. Smaller particles (<1 µm) increased doses by 20–30% due to deeper lung deposition and prolonged retention for alpha emitting radionuclides, such as 241 Am and 239 Pu. Radionuclides with fast clearance, such as 133 I, demonstrated a dose reduction exceeding 50%, as AMAD increased beyond 5 µm due to upper airway deposition and rapid mucociliary clearance. The greatest GSD among the radionuclides reported in this study was for 241 Am. In most cases, the largest GSDs in the CEDC were associated with larger particle sizes, an expected outcome, as ICRP Publication 66 defines GSD in particle size as a function of AMAD, resulting in an extended tail of the lognormal distribution. The findings support improved inhalation dose assessments and enhance consequence management strategies for the U.S. Federal Radiological Monitoring and Assessment Center by quantifying uncertainty in dose coefficients and strengthening decision-making for emergency response scenarios.

Biokinetic Modeling↗
DOE OSTI2025

Electric Grid Reliability in an Era of Unprecedented Uncertainty: A Review of Advances in Electric Sector Resource Adequacy Assessment and Planning

Recent changes to the principal causes of energy shortage events on the electric grid have necessitated are thinking of paradigms for resource adequacy (RA) assessment and the related topic of procurement of a reliable portfolio. Prior studies have laid out elements of a modern paradigm for these planning activities, but there does not exist a comprehensive overview of the topic spanning academic and gray literature, and the relationship of these suggested paradigms to methods used in industry has also not been surveyed. In this paper we review recent literature establishing best practices for RA assessment and reliable portfolio procurement, and survey current practices used in industry in relation to these best practices. We establish seven key best practices for RA assessment, cover a modern methodology for capacity accreditation, and find that industry practices are not far behind the identified best practices, though some key gaps remain. We also present a suggested agenda for both academic research on the topic and opportunities for advancement in the industry.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Value of abstraction in performance assessment – When is a higher level of detail necessary?

In this study, different approaches in performance assessment (PA) of the long-term safety of a repository for radioactive waste were examined. This investigation was carried out as part of the DECOVALEX-2023 project, an international collaborative effort for research and model comparison. One specific task of the DECOVALEX-2023 project was the Salt Performance Assessment Modelling task (Salt PA), which aimed at comparing various models and methods employed in the performance assessment of deep geological repositories in salt. In the context of the Salt PA task, three distinct teams from SNL (United States), Quintessa Ltd (United Kingdom), and GRS (Germany) examined the consequences of employing different levels of abstractions when modelling the repository's geometry and implementing various features and processes, using the example of a simple hypothetical repository structure in domal salt. Each team applied their own tools: PFLOTRAN (SNL), QPAC (Quintessa) and LOPOS (GRS). These differ essentially regarding numerical concept and degree of detail in the representation of the underlying physical processes. The discussion focused on when simplifications can be appropriately applied and what consequences result from them. Furthermore, it was explored when and if a higher level of fidelity in geometry or physical processes is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Preliminary investigation of an uncertainty budget for uranium isotope ratio analysis using a liquid sampling—atmospheric pressure glow discharge—orbitrap mass spectrometer system

The liquid sampling-atmospheric pressure glow discharge (LS-APGD) ionization source has proven to be an effective analysis tool for making uranium isotope ratio measurements when coupled to high-resolution mass spectrometers, such as the Orbitrap. While previous studies have shown the capabilities of the LS-APGD for isotope ratio determination, a systematic evaluation of the measurement uncertainty of the technique has not been conducted. To this end, the International Standards Organizations (ISO) guidelines to the expression of uncertainty in measurement (GUM analysis) have been applied to generate an uncertainty budget. For this work, a preliminary assessment derived from the GUM analysis was performed. The uncertainty in the instrument blank determination has been identified as a primary factor contributing to measurement uncertainty for the LS-APGD-Orbitrap method. These findings for the specific test case of uranium isotopic analysis will be invaluable in applications across the breadth of isotope ratio mass spectrometry performed on this unique instrumental platform.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2022

A Hierarchical Framework for CO2 Storage Capacity in Deep Saline Aquifer Formations

Carbon dioxide (CO 2 ) storage in deep saline aquifers is a vital option for CO 2 mitigation at a large scale. Determining storage capacity is one of the crucial steps toward large-scale deployment of CO 2 storage. Results of capacity assessments tend toward a consensus that sufficient resources are available in saline aquifers in many parts of the world. However, current CO 2 capacity assessments involve significant inconsistencies and uncertainties caused by various technical assumptions, storage mechanisms considered, algorithms, and data types and resolutions. Furthermore, other constraint factors (such as techno-economic features, site suitability, risk, regulation, social-economic situation, and policies) significantly affect the storage capacity assessment results. Consequently, a consensus capacity classification system and assessment method should be capable of classifying the capacity type or even more related uncertainties. We present a hierarchical framework of CO 2 capacity to define the capacity types based on the various factors, algorithms, and datasets. Finally, a review of onshore CO 2 aquifer storage capacity assessments in China is presented as examples to illustrate the feasibility of the proposed hierarchical framework.

58 GEOSCIENCES↗