Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Quantification and Sensitivity Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Advanced surrogate model for electron-scale turbulence in tokamak pedestals

We derive an advanced surrogate model for predicting turbulent transport at the edge of tokamaks driven by electron temperature gradient (ETG) modes. Our derivation is based on a recently developed sensitivity-driven sparse grid interpolation approach for uncertainty quantification and sensitivity analysis at scale, which informs the set of parameters that define the surrogate model as a scaling law. Our model reveals that ETG-driven electron heat flux is influenced by the safety factor q, electron beta β e and normalized electron Debye length λ D , in addition to well-established parameters such as the electron temperature and density gradients. To assess the trustworthiness of our model's predictions beyond training, we compute prediction intervals using bootstrapping. The surrogate model's predictive power is tested across a wide range of parameter values, including within-distribution testing parameters (to verify our model) as well as out-of-bounds and out-of-distribution testing (to validate the proposed model). Overall, validation efforts show that our model competes well with, or can even outperform, existing scaling laws in predicting ETG-driven transport.

fusion plasma↗
DOE OSTI2024

Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

Abstract Large‐scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub‐surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have successfully been used in several engineering applications, estimates of output quantities of interest (QoI) — such as breakthrough time of particles reaching the edge of the system — suffer from two distinct types of uncertainty. A run of a DFN simulator requires several parameters to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameters will lead to uncertainty in the QoI, called epistemic uncertainty. Furthermore, since these input settings to DFN simulators control the stochastic processes which place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e., different seeds) of the same random process (i.e., identical input parameters) leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. Beyond the specific takeaways on which input variables influence uncertainty in the QoI the most, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.

58 GEOSCIENCES↗
DOE OSTI2024

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

An open source analysis framework for large-scale building energy modeling

Full integration of building energy modelling into the design and retrofit process has long been a goal of building scientists and practitioners. However, significant barriers still exist. Among them are the lack of available: (1) configurable technology stacks for performing both small- and large-scale analyses, (2) different classes of algorithms compatible with common design workflows, and (3) analysis tools for effectively visualizing large-scale simulation results. This article discusses the OpenStudio® Analysis Framework: a scalable analysis framework for building energy modelling that was developed to overcome the three barriers listed above. The framework is open-source and scalable to facilitate wider adoption and has a clearly defined application programming interface upon which other applications can be built. It runs on high-performance computing systems, within cloud infrastructure, and on laptops, and uses a common workflow to enable different classes of algorithms. Lessons learned from previous development efforts are also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning

Various modeling techniques are used to predict the capacity fade of Li-ion batteries. Algebraic reduced-order models, which are inherently interpretable and computationally fast, are ideal for use in battery controllers, technoeconomic models, and multi-objective optimizations. For Li-ion batteries with graphite anodes, solid-electrolyte-interphase (SEI) growth on the graphite surface dominates fade. This fade is often modeled using physically informed equations, such as square-root of time for predicting solvent-diffusion limited SEI growth, and Arrhenius and Tafel-like equations predicting the temperature and state-of-charge rate dependencies. In some cases, completely empirical relationships are proposed. However, statistical validation is rarely conducted to evaluate model optimality, and only a handful of possible models are usually investigated. This article demonstrates a novel procedure for automatically identifying reduced-order degradation models from millions of algorithmically generated equations via bi-level optimization and symbolic regression. Identified models are statistically validated using cross-validation, sensitivity analysis, and uncertainty quantification via bootstrapping. On a LiFePO 4 /Graphite cell calendar aging data set, automatically identified models utilizing square-root, power law, stretched exponential, and sigmoidal functions result in greater accuracy and lower uncertainty than models identified by human experts, and demonstrate that previously known physical relationships can be empirically "rediscovered" using machine learning.

25 ENERGY STORAGE↗
DOE OSTI2021

AI-Batt (Autonomous Identification of Battery Life Models) [SWR 21-36]

Autonomous Identification of Battery Life Models (AI-Batt) AI-Batt is a MATLAB code base for developing lifetime models for batteries from accelerated aging data. The code base provides many functions for processing, visualizing, and modeling battery aging data, making the data processing, exploration, and modeling workflow substantially faster. These tools are tailored for working with battery aging data sets, which usually consist of many separate time-series for each cell, with many test conditions and possible replicates at each condition, which makes it difficult to simply process or visualize the data set. Complex modeling tasks, such as cross-validation, sensitivity analysis, and uncertainty quantification have been implemented to enable thorough statistical investigation of model predictions. Additionally, several machine-learning algorithms are implemented to autonomously identify suitable models via symbolic regression. Data processing functions automatically cast data from the struct data type, which is commonly used to store experimental data, but is not an acceptable input for most algorithms, to the table data type, which can be easily used as input to any optimization algorithm. Also, the data can be separated into time-invariant and time-variant data tables, which is helpful for exploring the data set as well as developing separate models for time-variant and time-invariant aging mechanisms. For example, in aging tests with constant temperature, temperature is a time-invariant experimental condition. Visualization tools enable plotting of data, model fits, and model simulations possible with single-line function calls, empowering data exploration of complex data sets with both time-varying and time-invariant trends. Plots can be automatically generated for the whole data set, or separated by data group (groups of test replicates) or individual data series. Data points or data series can be automatically colored by the value of a variable with a variety of color maps, and model predictions can also be colored by the value of a fit statistic. Comparisons between data sets and the predictions/simulations of different models on the same data set can be easily plotted as well. Distributions of parameter values from bootstrap resampling can be plotted to visualize the reliability of parameter estimation, or determine any correlations between parameters. Modeling tools handle the complex task of creating and parsing symbolic equations for modeling battery lifetime. Equations are parsed to grab relevant data variables, parameter values, or specified sub-models for input into optimization, evaluation, or simulation functions. Models can be optimized locally (one set of parameters for each data series), bi-level (some parameters shared across the data set), or globally (single set of parameters for all data). Functions implementing symbolic regression algorithms help users to discover effective model equations, even in poorly sampled, high-dimensional data.

Smith, Kandler↗
DOE OSTI2026

FLOW BATTERY COST AND COMMERCIALIZATION TOOL (FlowBaCC) v.1.0

The Flow Battery Cost and Commercialization Tool (FlowBaCC) is a python-based framework used to project the costs and commercialization timelines for redox flow batteries. FlowBaCC combines learning curves for component costs and performance with adoption curves for market diffusion to project future system costs. The tool uses the bottom-up, spreadsheet-based Battery Performance and Cost Model for Flow Batteries (BatPaC-Flow) as the engine to translate learning curve inputs into full system costs. FlowBaCC provides capital costs and levelized costs of energy storage. The tool enables scenario analysis, sensitivity analysis, and uncertainty quantification (via grid and Monte Carlo methods).

Fu, Xiaoxu [Argonne National Laboratory (ANL), Arg↗
DOE OSTI2021

Process-based Neural Network to Forecast Vegetation Dynamics

This white paper calls for an AI-based emulator of DOE’s dynamic vegetation model that is computationally efficient and accommodates/parameterizes the governing processes built in the model. This AI-based emulator is needed for model calibration, sensitivity analysis, prediction, uncertainty quantification, and decision making. This AI-based emulator will incorporate physics and biological information in the form of conservation laws and constitutive relationships.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

FY22 Status Report on the ART-GCR CMVB and CNWG International Collaborations

This work presents the numerical model for the high temperature test reactor (HTTR) loss of forced cooling (LOFC) experiment with the INL codes Griffin, BISON, and RELAP-7, based on the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Promising results were obtained, with the overall behavior of the reactor successfully captured. Changes in the heat transfer coupling, as compared to the fiscal year (FY)-21 model, enabled drastic improvement of the steady-state solution, both in terms of computational time and global energy discrepancies. The former was reduced by a factor of roughly 60, whereas the latter decreased from 11% to less than 2%. Furthermore, the discrepancy in the steady-state multiplication factor was improved from +2,300 and +2,900 pcm (for the 30 and 9 MW cases) to -700 and +1,200 pcm, respectively, and now falls well within the large measurement uncertainties stemming from graphite impurities. Validation of the Monte Carlo model used to generate cross sections was also performed against available measurements. Though significant, the discrepancies remain acceptable overall in light of the large uncertainty. Numerous improvements are still needed to better compare with the experiment involving the 9 MW case and to instill greater confidence in the model’s ability to accurately predict the 30 MW behavior. Specifically, the power levels predicted by the 9 MW transient simulation following re-criticality remain low, pointing to an underestimation of the passive cooling of the core. A key aspect of future work will be to better understand the flow pattern during the LOFC event, particularly to determine if natural or forced convection is occurring inside the reactor pressure vessel (RPV). More generally, additional validation data would be immensely useful for further enhancing the numerical model and better matching the experiments. In addition, a more sophisticated thermal-hydraulics model that simulates all the channels as a single system model should be considered to take into account the rest of the primary loop. Finally, even if the results are in better agreement with the experiments, sensitivity analysis and uncertainty quantification will be necessary to evaluate the model uncertainty.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Performance Assessment for the E-Area Low-Level Radioactive Waste Disposal Facility at the Savannah River Site: Chapter 4

This chapter describes the GW flow and transport conceptual models in the VZ for both generic and special waste forms in STs, ETs, LAWV, ILV, and NRCDAs. The development and implementation of the GoldSim® system model for trenches is also introduced. The Trench System Model is used for sensitivity analysis and uncertainty quantification as reported in Chapter 6.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Sensitivity and uncertainty of the IFR-1 BISON benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered for adoption by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This paper summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment.For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. Here, the resulting variations in benchmark predictions were normalized to calculate sensitivities. These sensitivities were then used to inform input selections for the UQ.The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of the benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because the confidence intervals associated with benchmark predictions were wide. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Multi-Fidelity Active Subspaces for Wind Farm Uncertainty Quantification

Wind plants operate in stochastic environments characterized by complex turbulent flow dynamics and high-dimensional random variables. A key step in uncertainty quantification studies is sensitivity analysis and dimension reduction that can facilitate the development of surrogate models to be used for forward and inverse propagation or optimization under uncertainty. Prior work has shown active subspaces are an effective tool for identifying important directions in the space of stochastic inputs; however, they have only been applied to single-fidelity wind plant models. In this study, we investigate the efficacy of a multi-fidelity active subspace method for analyzing the uncertainty in wind plant power output. The multi-fidelity active subspace estimator offers the promise of increased accuracy in identifying active subspaces as compared to a single-fidelity estimator for the same computational cost, or a reduction in cost for the same accuracy. This makes the study of uncertainty in larger wind plants and with higher fidelity physics tractable. The multi-fidelity active subspace method is applied to gridded and existing wind plant layouts with single and multiple inflow conditions and its performance for surrogate modeling and uncertainty propagation is compared against a single-fidelity active subspace method. This multi-fidelity approach yields substantial computational speedups of 2x - 3.4x across the test cases along with acceptable accuracy in surrogate modeling and computing statistical moments.

active subspace↗
DOE OSTI2023

PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Sensitivity and Uncertainty of the IFR-1 BISON Benchmark

The fuel performance code BISON is being used to evaluate metallic fuel for a new fast-spectrum test reactor called the Versatile Test Reactor, which is being considered by the US Department of Energy. To quantify the accuracy of BISON predictions, researchers at Oak Ridge National Laboratory have been developing a series of benchmarks based on legacy metallic fuel experiments. As part of this effort, the sensitivity of BISON predictions to variations in model inputs and the uncertainties associated with BISON predictions must be established. This report summarizes efforts to perform a comprehensive sensitivity analysis (SA) and uncertainty quantification (UQ) on a benchmark based on the IFR-1 experiment. For the SA, at least one input was chosen from every BISON model and physics module used in the benchmark. The inputs were varied individually in a series of BISON simulations. The resulting variations in benchmark predictions were normalized to calculate sensitivities. The strongest sensitivities were identified and used to inform input selections for the UQ. The UQ was performed using the Monte Carlo UQ method. A literature review was conducted to estimate uncertainty distributions for the selected inputs, and values were sampled randomly from each distribution in a series of BISON simulations. Variations in the benchmark predictions were used to estimate uncertainty distributions and confidence intervals. It was found that nearly 100% of benchmark predictions matched the corresponding legacy values within the confidence intervals. However, this is at least partially because of the wide confidence intervals associated with the benchmark predictions. The uncertainty contributions of assumptions in the benchmark, experimental uncertainties, and BISON models were quantified. Some analysis was performed to identify inputs that contributed to the uncertainties. Finally, recommendations are made for future benchmark development and future BISON development.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Improvement of the $\mathrm{BISON U_3Si_2}$ modeling capabilities based on multiscale developments to modeling fission gas behavior

Uranium silicide (U 3 Si 2 ) is a concept explored as a potential alternative to UO 2 fuel used in light water reactors (LWRs) since it may improve accident tolerance and economics due to its higher thermal conductivity and increased uranium density. U 3 Si 2 has been previously used in research reactors in the form of dispersion fuel, but operated at lower temperatures than commercial LWRs. The research reactor data illustrated that significant gaseous swelling occurs as the fuel burnup increases. Therefore, it is imperative to understand the fission gas behavior of U 3 Si 2 under higher temperature LWR operating conditions. In this work, molecular dynamics and phase-field modeling techniques are used to reduce the uncertainty in select modeling assumptions made in developing the fission gas behavior model for U 3 Si 2 in the BISON fuel performance code. These lower length scale informed models are then utilized in the validation of BISON U 3 Si 2 modeling capabilities to simulate the ATF-1 experiments irradiated in the Advanced Test Reactor (ATR). Sensitivity analysis (SA) and uncertainty quantification (UQ) are included as part of the validation process to identify where further experiments and lower length scale modeling would be beneficial. Here, the multiscale modeling approach utilized in this work can be applied to new fuel concepts being explored for both LWRs and advanced reactors (e.g., uranium nitride, uranium carbide).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Calibration of reactive burn and Jones-Wilkins-Lee parameters for simulations of a detonation-driven flow experiment with uncertainty quantification

Here, uncertainties in the explosive-specific parameters of the Jones-Wilkins-Lee (JWL) equation of state (EOS) are carefully considered in hydrodynamic simulations of an explosive experiment to minimize the error in the flow prediction. Experimental data of the leading shock position in the transverse direction over time serves as the prediction metric for quantifying simulation prediction error. The uncertainty quantification technique, global sensitivity analysis, is utilized to determine the JWL parameters to which the transverse shock propagation is most sensitive. A polynomial response surface (PRS) is constructed in the space of the most influential JWL parameters, and the point of minimum error between the experimental data and the PRS yields calibrated JWL parameters for the experimental flow. The simulation results following the parameter calibration show good agreement with the experimental data. It was found that two significant parameters, the heat release per unit mass of reactant Q and JWL model exponent R 1 are strongly related, which makes it difficult to identify accurate values.

36 MATERIALS SCIENCE↗
DOE OSTI2020

(U) Radiation Transport Sensitivity Capabilities Applicable to INRAD

Intrinsic radiation (INRAD) calculations involve calculating the neutron and gamma-ray source rate densities from given compositions and densities of materials and the subsequent transport of the neutrons and gamma rays to detectors that may be stood off or internal. Related problems deal with measures of subcritical multiplication, such as the k eff eigenvalue. Realistic estimates of the uncertainties in calculated INRAD results are desired. One approach to uncertainty quantification begins with sensitivity analysis. This report describes the present capabilities that XCP-7 can apply to compute sensitivities in INRAD problems and areas where work is needed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗