Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Quantification and Sensitivity Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

SCALE HTR-PROTEUS Benchmark Model

This dataset contains input and result files of computational simulations of HTR-PROTEUS benchmark with the latest version of SCALE code system. The simulations cover criticality control rod worth calculations as well as sensitivity analysis and uncertainty quantification. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A general framework for quantifying uncertainty at scale

Abstract In many fields of science, comprehensive and realistic computational models are available nowadays. Often, the respective numerical calculations call for the use of powerful supercomputers, and therefore only a limited number of cases can be investigated explicitly. This prevents straightforward approaches to important tasks like uncertainty quantification and sensitivity analysis. This challenge can be overcome via our recently developed sensitivity-driven dimension-adaptive sparse grid interpolation strategy. The method exploits, via adaptivity, the structure of the underlying model (such as lower intrinsic dimensionality and anisotropic coupling of the uncertain inputs) to enable efficient and accurate uncertainty quantification and sensitivity analysis at scale. Here, we demonstrate the efficiency of this adaptive approach in the context of fusion research, in a realistic, computationally expensive scenario of turbulent transport in a magnetic confinement tokamak device with eight uncertain parameters, reducing the effort by at least two orders of magnitude. In addition, we show that this refinement method intrinsically provides an accurate surrogate model that is nine orders of magnitude cheaper than the high-fidelity model.

Farcaş, Ionuţ-Gabriel (ORCID:0000000238841580)↗

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗

Surrogate-driven Variance-based Sensitivity Analysis of Thermal Storage Tanks in Integrated Energy Systems

Sensitivity analysis and uncertainty quantification are essential steps for enhancing the accuracy of computational models by identifying and mitigating uncertainties. This study focuses on these steps for the Thermal Energy Delivery System at Idaho National Laboratory, specifically targeting the thermocline tank. Using a Modelica/Dymola simulation model, the study perturbed various design parameters and boundary conditions, including shape factor, porosity, outlet temperature, inlet mass flow rate, and system pressure, to predict and quantify uncertainty in the tank’s ax- ial temperature. A dataset of over 1,000 simulations was generated, and surrogate models were developed using the pyMAISE (Michigan Artificial Intelligence Standard Environment) library, which is an Automatic Machine Learning library for nuclear engineering applications. The optimal model, a feedforward neural network with two hidden layers, achieved an R2 score above 0.99 and a mean absolute error below 1 Kelvin. Sensitivity analyses using Sobol indices and Fourier amplitude sensitivity testing methods on this surrogate model revealed that the inlet mass flow rate at initial timestamps and porosity significantly impacts predicted temperatures across all sensors and time steps.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Hypercomplex Automatic Differentiation in the Eulerian Hydrocode PAGOSA

Enabling the computation of partial derivatives or sensitivities in production hydrocodes is beneficial for design, optimization, sensitivity analysis, and uncertainty quantification. Traditional finite difference approximations of these sensitivities are inefficient since convergence studies of the step size is required for each parameter of interest. For these reasons, HYPercomplex Automatic Differentiation (HYPAD) was implemented in the Eulerian hydrocode PAGOSA. HYPAD is analogous to forward-mode automatic differentiation except hypercomplex numbers (numbers with multiple imaginary parts) are used instead of dual numbers. Accurate partial derivatives can be computed of all state variables with respect to multiple input variables in a single run. The method was implemented using operator overloading to handle hypercomplex algebra. HYPAD was demonstrated and verified on Sod’s shock tube problem to compute derivatives of the state variables with respect to a material parameter, initial conditions, and geometry.

97 MATHEMATICS AND COMPUTING↗

PSUADE

PSUADE (Problem Solving testbed for Uncertainty Analysis and Design Exploration) is a mathematical software useful for performing uncertainty quantification and sensitivity analysis.

Tong, CharlesH↗

Demonstration of TOFFEE: A Response Uncertainty Quantification Tool

A key characteristic in neutron transport is nuclear data. Cross-section uncertainty is not used in MCNP6.3 to propagate response uncertainty without external analysis. Here, the TOol For Fast Error Estimation (TOFFEE) is a Python-based code developed to automate the propagation of cross-section uncertainty for MCNP evaluations. TOFFEE implements the sandwich rule to calculate the uncertainty from cross sections with sensitivity coefficients from MCNP6.3 and ENDF/B covariance data. In this paper, TOFFEE has been tested with benchmark experiments, and it has been compared to the uncertainty quantification capabilities of Sampler and TSUNAMI, within SCALE, to verify the application’s capabilities.

97 MATHEMATICS AND COMPUTING↗

Development and application of two-step uncertainty propagation and sensitivity analysis methodology for fast reactor safety analysis

Uncertainty quantification (UQ) in nuclear reactors for transients is directly linked with safety assessment through the cross-sections uncertainties, provided as a covariance matrix, which are propagated through the reactor system to output of interest pertaining to reactor safety, such as peak temperatures in fuel/clad/coolant. Using a two-step approach, uncertainties are first quantified and propagated from basic input variables (such as reaction cross-sections) to intermediate quantities (such as reactivity feedback coefficients) through lattice level calculations. Uncertainties of intermediate quantities (from the first step) are then propagated through the system transient calculations, in the second step, to obtain uncertainties on reactor safety output parameters of interest. The scope of this work consists of Uncertainty Quantification & Propagation of nuclear data uncertainties that are highly correlated through unprotected transient overpower and unprotected loss of flow to assess their impact on core safety parameters. This two-step approach in the presence of covariance renders the sensitivity analysis very challenging. In fact, usually the sensitivity analysis is restricted to each step, which limits its application since the sensitivities between the system output quantities and the basic input variables are difficult to obtain. Here, in this work, we address this issue by proposing a simple, general methodology to combine the sensitivity indices obtained in each step by assuming the model behavior being linear. For the first step Generalized Perturbation theory based indices are used while in the second step the recently studied Johnson indices. The uncertainty quantification and sensitivity methodologies discussed here are demonstrated on a generic LFR design which is based on the 500 MWth demonstration Lead-cooled fast reactor (DLFR) using oxide fuel, developed by Westinghouse Electric Company (WEC).

42 - ENGINEERING↗

Sensitivity Analysis of Irradiated Fueled Experiments using the MOOSE Framework [Slides]

Modeling and simulation (M&S) methods are able to predict uncertainties in experimental parameters (e.g., power and fission density) during irradiation. A shortfall exists in predicting how sensitive some of the parameters will behave during the experimental process. Sensitivity and Uncertainty Quantification (SUQ) is critical in support of qualification and licensing reactor fuels. The application of a method to quantify the uncertainty in these experiments is critical to the prediction of their performance. In this work, we propose the use of a polynomial chaos expansion (PCE) method to quantify the sensitive parameters in these simulations and, in an extension, their experimental surrogates. We propose to perform M&S using PCE uncertainty quantification on a previously irradiated fueled experiment in order to provide a validation case for Griffin and expand its use as a verification and validation (V&V) tool for experiments with a neutronics component. Griffin is an advanced, deterministic neutronics analysis code built using the MOOSE (multiphysics object-oriented simulation environment) framework which can provide state-of-the-art neutronic analysis on M&S of experiments. We will use the stochastic tools module (STM) in MOOSE to provide PCE uncertainty quantification on the proposed experimental setup. Idaho National Laboratory (INL) does not yet have an in-house developed code with V&V approval for experiments performed on-site; this work would provide a necessary addition of support for experiments performed at INL. The Nuclear Regulatory Commission (NRC) has explicitly requested uncertainties in calculated values such as fuel power and burnup, and the development of this capability would benefit the relationship between INL and the NRC.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Sensitivity Coefficients Calculated for the Prompt Neutron Decay Constant At or Near Delayed Critical

The derivation of a non-invasive prompt neutron decay constant sensitivity coefficient is provided in this work. The computation of the sensitivity coefficient derived in this work does not require modification of Monte Carlo source code and is based on capabilities available in Monte Carlo N-Particle R© Code Version 6.2. The prompt neutron decay constant sensitivity coefficients are calculated for 44-group and 252-group energy structures for specific nuclide-reaction pairs in the Jezebel benchmark experiment. The nuclide-reaction pairs investigated in this work include Pu- 239(n,f), Pu-240(n,f), and Pu-241(n,f). Physical explanations of the sensitivity profiles exhibited by the 252-group energy structure are investigated for the prompt neutron multiplication factor, mean neutron lifetime, and prompt neutron decay constant. The prompt neutron decay constant sensitivity coefficients calculated for the 44-group and 252-group energy structure of Pu-239(n,f) are compared. Lastly, the 44-group energy structure sensitivity coefficients calculated are used for nuclear-data induced uncertainty quantification of the neutron multiplication factor. This work shows that a reduction in the nuclear data-induced uncertainty of the neutron multiplication factor is possible for all nuclide-reaction pairs investigated when prompt neutron decay constant sensitivity coefficients are utilized. This is important for new critical experiment design optimization studies of measurement configurations. This work provides a basis for more detailed sensitivity analysis and uncertainty quantification of nuclide, reaction, and energy-specific cross section data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

From Machine Learning to Nuclear Digital Twins

This presentation provides multiple case studies of Machine Learning, Uncertainty Quantification, Reduced Order Modeling, to achieve digital transformation and provide the components for nuclear digital twinning. The presentation is for an international virtual event titled: Consultancy Meeting on Applications of AI and Pattern Recognition Techniques for Uncertainty Quantification in Nuclear Power Modelling and Simulation held Oct 21-22, 2021.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Effects of Photovoltaic Module Materials and Design on Module Deformation Under Load

Quasi-static structural finite-element models of an aluminum-framed crystalline silicon photovoltaic module and a glass-glass thin-film module were constructed and validated against experimental measurements of deflection under uniform pressure loading. Specific practices in the computational representation of module assembly were identified as influential to matching experimental deflection observations. Additionally, parametric analyses using Latin hypercube sampling were performed to propagate input uncertainties related to module materials, dimensions, and tolerances into uncertainties in simulated deflection. Sensitivity analyses were performed on the uncertainty quantification datasets using linear correlation coefficients and variance-based sensitivity indices to elucidate key parameters influencing module deformation. Results identified edge tape and adhesive material properties as being strongly correlated to module deflection, suggesting that optimization of these materials could yield module stiffness gains at par with the conventionally structural parameters, such as glass thickness. This exercise verifies the applicability of finite-element models for accurately predicting mechanical behavior of solar modules and demonstrates a workflow for model-based parametric uncertainty quantification and sensitivity analysis. Finally, applications of this capability include the assessment of field environment loads, derivation of representative loading conditions for reduced-scale testing, and module design optimization, among others.

42 ENGINEERING↗

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗

Developing Uncertainty Quantification Strategies in Electromagnetic Problems Involving Highly Resonant Cavities

High-quality factor resonant cavities are challenging structures to model in electromagnetics owing to their large sensitivity to minute parameter changes. Therefore, uncertainty quantification (UQ) strategies are pivotal to understanding key parameters affecting the cavity response. Furthermore, we discuss here some of these strategies focusing on shielding effectiveness (SE) properties of a canonical slotted cylindrical cavity that will be used to develop credibility evidence in support of predictions made using computational simulations for this application.

47 OTHER INSTRUMENTATION↗

Effect of Nuclear Data Covariances on Integral Experiment Design with Sensitivity and Uncertainty Analysis

Washington River Protection Solutions (WRPS) uses MCNP6.2 and the Whisper code for criticality safety analyses of the Hanford Tank Farm. Together the codes derive baseline upper subcritical limits (USLs) for the waste models using experimental benchmarks. Whisper returns higher USLs, i.e. , has less of a conservative penalty, when the neutronic similarity of the experimental benchmarks to the application is high. Unfortunately, few critical benchmarks have high similarity to the Hanford tanks. The waste in the tanks is highly dilute in plutonium and contains large masses of weakly neutron-absorbing elements like iron and manganese. Experimental benchmarks typically have low sensitivity to these absorbers because they are present as structural materials. Lacking similar benchmarks, new Thermal Epithermal eXperiment (TEX) configurations with high Pu content and interstitial iron absorbers have been designed for the criticality safety validation. The features of the design have been iterated upon to maximize the similarity between the experiment and different Hanford waste models. The similarity is quantified with sensitivity analysis and uncertainty quantification using the representativity coefficient, or c k . The representativity calculation requires nuclear data covariances, which may differ between nuclear data libraries and between library versions. Because of these variations, the optimal design may depend on the nuclear data covariances library. A scenario can be envisioned where an experiment is designed, and c k is maximized, with one set of covariance data. However, when the covariance data is changed, say from ENDF/B-VII.1 to ENDF/B-VIII.0, and the benchmark is used in a criticality safety evaluation, the experiment becomes suboptimal with respect to c k . In this paper, we present how the optimal design of the new TEX experiments varied depending on the nuclear data covariances used to calculate c k . We compare ENDF/B-VII.1 and ENDF/B-VIII.0, as if the library had been updated since the design of the experiment. Additionally, we use JEFF3.3 to simulate if the covariance data of a different library had been used. The results show that the covariances do have an important effect on the designs, less so for thermal systems (where the data are more consistent between evaluations) and more so for epithermal systems where more differences exist.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models

This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.

36 MATERIALS SCIENCE↗

COVID-19 dynamics across the US: A deep learning study of human mobility and social behavior

This paper presents a deep learning framework for epidemiology system identification from noisy and sparse observations with quantified uncertainty. The proposed approach employs an ensemble of deep neural networks to infer the time-dependent reproduction number of an infectious disease by formulating a tensor-based multi-step loss function that allows us to efficiently calibrate the model on multiple observed trajectories. The method is applied to a mobility and social behavior-based SEIR model of COVID-19 spread. The model is trained on Google and Unacast mobility data spanning a period of 66 days, and is able to yield accurate future forecasts of COVID-19 spread in 203 US counties within a time-window of 15 days. Interestingly, a sensitivity analysis that assesses the importance of different mobility and social behavior parameters reveals that attendance of close places, including workplaces, residential, and retail and recreational locations, has the largest impact on the effective reproduction number. Furthermore, the model enables us to rapidly probe and quantify the effects of government interventions, such as lock-down and re-opening strategies. Taken together, the proposed framework provides a robust workflow for data-driven epidemiology model discovery under uncertainty and produces probabilistic forecasts for the evolution of a pandemic that can judiciously provide information for policy and decision making. All codes and data accompanying this manuscript are available at https://github.com/PredictiveIntelligenceLab/DeepCOVID19.

60 APPLIED LIFE SCIENCES↗