Search NASA⌕ Search

SEARCH · Search NASA

Results for “parametric uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Data for "Quantifying the Propagation of Parametric Uncertainty on Flux Balance Analysis"

In the repository are example scripts that perform uncertainty injection and propagation to flux balance analysis with outputs for a small sample size (for demonstration purpose only). For proper analysis, user should download the scripts and run for a large sample size (e.g., 10,000 samples). If you use the scripts, please cite the following Metabolic Engineering article: “Quantifying the propagation of parametric uncertainty on flux balance analysis” (https://doi.org/10.1016/j.ymben.2021.10.012) There are two subdirectories: /uncFBA/uncBiom: injection of normally distributed noise to biomass precursor coeffcients and ATP maintenance (growth-associated ATP maintenance (GAM) and non-growth associated ATP maintenance (NGAM)) /uncFBA/uncRHS: departure from steady-state by adding noise drawn from normal distribution to the RHS terms of mass balance constraints

Metabolomics↗

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗

Bayesian uncertainty quantification of tristructural isotropic particle fuel silver release: Decomposing model inadequacy plus experimental noise and parametric uncertainties

Tristructural isotropic (TRISO) particle fuel is one of the most promising fuel concepts enabling high temperature and high burnup reactor operation. One dominant source of radioactivity released from the TRISO particles is silver (Ag), which is subject to a high release fraction and long decay life compared to other fission products. Previous modeling efforts using the fuel performance code BISON indicated nonnegligible uncertainties in modeling the diffusion process of fission products in TRISO compared to the Advanced Gas Reactor experiments. The overall uncertainties observed when modeling the fission product diffusion can result from uncertainties in model parameters, noisy experimental measurements, and deficiencies in the developed models. The three types of underlying uncertainties have not yet been properly quantified in open literature. Here, this paper presents the Bayesian uncertainty quantification (UQ) using massively parallelizable Markov chain Monte Carlo samplers. The uncertainties due to model parameters, model inadequacy, and experimental measurement noise are quantified, with the σ term used to represent the sum of the model inadequacy and measurement noise uncertainties. It is worth noting that this is the first time the σ term is inferred for nuclear fuel experiments, as compared to using prescribed values for uncertainty quantification in previous work. The parallelizable Markov chain Monte Carlo samplers efficiently infer the model parameters and the σ term, giving insight into physical parameters like diffusion coefficients and the combined model discrepancy and measurement noise. A subsequent forward uncertainty quantification (UQ) is also performed based on the calibration results to generate more accurate predictions of the Ag release. The model inadequacy plus experimental noise is the most dominant source of uncertainty compared to the parametric uncertainty. All the UQ analyses presented in this work are based on the second series of the irradiation experiments in the Advanced Gas Reactor program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Assessing boundary condition and parametric uncertainty in numerical-weather-prediction-modeled, long-term offshore wind speed through machine learning and analog ensemble

To accurately plan and manage wind power plants, not only does the time-varying wind resource at the site of interest need to be assessed but also the uncertainty connected to this estimate. Numerical weather prediction (NWP) models at the mesoscale represent a valuable way to characterize the wind resource offshore, given the challenges connected with measuring hub-height wind speed. The boundary condition and parametric uncertainty associated with modeled wind speed is often estimated by running a model ensemble. However, creating an NWP ensemble of long-term wind resource data over a large region represents a computational challenge. Here, we propose two approaches to temporally extrapolate wind speed boundary condition and parametric uncertainty using a more convenient setup in which a mesoscale ensemble is run over a short-term period (1 year), and only a single model covers the desired long-term period (20 year). We quantify hub-height wind speed boundary condition and parametric uncertainty from the short-term model ensemble as its normalized across-ensemble standard deviation. Then, we develop and apply a gradient-boosting model and an analog ensemble approach to temporally extrapolate such uncertainty to the full 20-year period, for which only a single model run is available. As a test case, we consider offshore wind resource characterization in the California Outer Continental Shelf. Both of the proposed approaches provide accurate estimates of the long-term wind speed boundary condition and parametric uncertainty across the region (R 2 >0.75), with the gradient-boosting model slightly outperforming the analog ensemble in terms of bias and centered root-mean-square error. At the three offshore wind energy lease areas in the region, we find a long-term median hourly uncertainty between 10 % and 14 % of the mean hub-height wind speed values. Finally, we assess the physical variability in the uncertainty estimates. In general, we find that the wind speed uncertainty increases closer to land. Also, neutral conditions have smaller uncertainty than the stable and unstable cases, and the modeled wind speed in winter has less boundary condition and parametric sensitivity than summer.

17 WIND ENERGY↗

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Complete quantification of parametric uncertainties in ( d , p ) transfer reactions

Deuteron-induced transfer reactions are a popular probe in nuclear structure and nuclear astro physics studies. The interpretation of these transfer measurements relies on reaction theory that takes as input effective interactions between the nucleons and the target nucleus. Previous work quantified the uncertainty associated with the optical potentials between the nucleons and the target. In this study, we extend that work by also including the parameters of the mean field associated with the overlap function of the final bound state, thus obtaining the full parametric uncertainty on transfer observables. We use Bayesian Markov Chain Monte Carlo simulations to obtain parameter posterior distributions. We use elastic-scattering cross sections to constrain the optical potential parameters and use the asymptotic normalization coefficient of the final state to constrain the bound state interaction. We then propagate these posteriors to the transfer angular distributions and obtain confidence intervals for this observable. We study (d,p) reactions on 14 C, 16 O, and 48 Ca at energies in the range $E$ $d$ = 7 - 24 MeV. Our results show a strong reduction in uncertainty by using the asymptotic normalization coefficient as a constraint, particularly for those reactions most sensitive to ambiguities in the mean field. For those reactions, the importance of constraining the bound state interaction is equal to that of constraining the optical potentials. Furthermore, the case of 14 C is an outlier because the cross section is less sensitive to the nuclear interior. When minimal constraints are used on the parameters of the nucleon-target interaction, the 1σ uncertainties on the differential cross sections are large (~ 500-100%). However, if elastic-scattering data and the asymptotic normalization coefficient are used in the analysis, with an error of 10% (5%), this uncertainty reduces to ~ 30% (~ 15%).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A new multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential processes under process model and parametric uncertainty

Process-based models have been widely used for hydrologic modeling, and it is a common practice to use sensitivity analysis methods for excluding non-influential hydrologic processes from further investigation and/or model improvement. This study develops a new method called multi-model absolute difference-based sensitivity (MMADS) analysis method to screen non-influential system processes and parameters. MMADS is conceptually similar to the Morris method for addressing parametric uncertainty, but has a unique feature to address both process model uncertainty (i.e., a process may be represented by multiple process models) and process model parameter uncertainty (i.e., parameters associated with a process model are random). MMADS first evaluates absolute differences of a quantity of interest (i.e., a system model output) by varying process models and/or process model parameter values, and then calculates the mean and variance of the differences for investigating process influence. The mean measures overall influence of the process on the quantity of interest, and the variance estimates influence of nonlinear effects of the process and/or its interactions with other processes. MMADS is an extension of the Morris method from a parameter space to a joint parameter-model space for explicitly addressing both process model uncertainty and model parameter uncertainty. The performance of MMADS is evaluated by using two numerical experiments. One experiment is based on Sobol’s G*-function with ten product elements, and has analytical solutions of the MMADS mean and variance of absolute differences. The other experiment is for groundwater flow modeling which considers three processes (i.e., recharge, geology, and snowmelt) that interact with each other. Finally, results indicate that MMADS is computationally efficient and can identify non-influential processes of complex hydrological systems.

54 ENVIRONMENTAL SCIENCES↗

Neglecting Model Parametric Uncertainty Can Drastically Underestimate Flood Risks

Abstract Floods drive dynamic and deeply uncertain risks for people and infrastructures. Uncertainty characterization is a crucial step in improving the predictive understanding of multi‐sector dynamics and the design of risk‐management strategies. Current approaches to estimate flood hazards often sample only a relatively small subset of the known unknowns, for example, the uncertainties surrounding the model parameters. This approach neglects the impacts of key uncertainties on hazards and system dynamics. Here we mainstream a recently developed method for Bayesian inference to calibrate a computationally expensive distributed hydrologic model. We compare three different calibration approaches: (a) stepwise line search, (b) precalibration or screening, and (c) the Fast Model Calibrations (FaMoS) approach. FaMoS deploys a particle‐based approach that takes advantage of the massive parallelization afforded by modern high‐performance computing systems. We quantify how neglecting parametric uncertainty and data discrepancy can drastically underestimate extreme flood events and risks. Precalibration improves prediction skill score over a stepwise line search. The Bayesian calibration improves the uncertainty characterization of model parameters and flood risk projections.

54 ENVIRONMENTAL SCIENCES↗

Parametrized uncertainties in the spectral function model of neutrino charged-current quasielastic interactions for oscillation analyses

A substantial fraction of systematic uncertainties in neutrino oscillation experiments stem from the lack of precision in modeling the nuclear target in neutrino-nucleus interactions. Whilst this has driven significant progress in the development of improved nuclear models for neutrino scattering, it is crucial that the models used in neutrino data analyses be accompanied by parameters and associated uncertainties that allow the coverage of plausible nuclear physics. Based on constraints from electron scattering data, we propose such a set of parameters, which can be applied to nuclear shell models, and test their application to the Benhar [] spectral function model. The parametrization is validated through a series of maximum likelihood fits to cross section measurements made by the T2K and MINERvA experiments, which also permit an exploration of the power of near-detector data to provide constraints on the parameters in neutrino oscillation analyses. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantifying the propagation of parametric uncertainty on flux balance analysis

Flux balance analysis (FBA) and associated techniques operating on stoichiometric genome-scale metabolic models play a central role in quantifying metabolic flows and constraining feasible phenotypes. At the heart of these methods lie two important assumptions: (i) the biomass precursors and energy requirements neither change in response to growth conditions nor environmental/genetic perturbations, and (ii) metabolite production and consumption rates are equal at all times (i.e., steady-state). Despite the stringency of these two assumptions, FBA has been shown to be surprisingly robust at predicting cellular phenotypes. In this paper, we formally assess the impact of these two assumptions on FBA results by quantifying how uncertainty in biomass reaction coefficients, and departures from steady-state due to temporal fluctuations could propagate to FBA results. In the first case, conditional sampling of parameter space is required to re-weigh the biomass reaction so as the molecular weight remains equal to 1 g mmol –1 , and in the second case, metabolite (and elemental) pool conservation must be imposed under temporally varying conditions. Results confirm the importance of enforcing the aforementioned constraints and explain the robustness of FBA biomass yield predictions.

59 BASIC BIOLOGICAL SCIENCES↗

Process Interactions Can Change Process Ranking in a Coupled Complex System Under Process Model and Parametric Uncertainty

For a complex hydrologic system with multiple processes and process interactions, global sensitivity analysis is often used to identify important or influential parameters for model development and improvement. The identification is complicated by process model uncertainty, when a system process can be represented by multiple process models. This study develops a new total-effect process sensitivity index to identify influential processes under model uncertainty. This is done by extending Sobol's total-effect parameter sensitivity index for one system model to total-effect process sensitivity index for multiple system models to account for uncertainty in process models and model parameters. The total-effect process sensitivity index includes not only the first-order process sensitivity index for measuring the importance of individual processes but also higher-order indices that account for process interactions. The total-effect process sensitivity index can identify an influential process that itself and its interactions with other processes influence a model output. Here, the total-effect process sensitivity index is applied to two numerical examples: (a) Sobol's G*-functions with analytical solutions of first-order and total-effect process sensitivity indices, and (b) groundwater flow models with interactions between recharge, geology, and snowmelt processes. The second evaluation shows that, due to second-order and higher-order process interactions, the first-order and total-effect process sensitivity indices give different process ranking. It is thus necessary to estimate both first-order and total-effect process sensitivity indices to appreciate the difference between the first-order impact of a process alone and the overall total-effect impact of the process itself and its interactions with other processes on a model output.

54 ENVIRONMENTAL SCIENCES↗

Dose Exceedance Distance Sensitivity Based on Parametric Uncertainty

Sandia National Laboratories (SNL) collaborated with the US Nuclear Regulatory Commission's (NRC) Office of Nuclear Security and Incident Response (NSIR) and Office of Nuclear Regulatory Research (RES) to investigate the reasonable variability in the estimation of dose exceedance distances. SNL performed calculations using the MACCS code to elucidate the sensitivity of dose exceedance distances to variations in user input parameters.

61 RADIATION PROTECTION AND DOSIMETRY↗

Quantifying structural errors in cloud condensation nuclei activity from reduced representation of aerosol size distributions

Aerosol effects on clouds and radiation are the dominant contribution to uncertainty in radiative forcing relative to the pre-industrial atmosphere. While previous studies have assessed the impact of parametric uncertainty on modeled forcing, structural errors from the numerical representation of particle distributions have not been well quantified. Here we present a framework for quantifying error in aerosol size distributions and cloud condensation nuclei activity, which we apply to the widely used 4-mode version of the Modal Aerosol Module (MAM4). Box model predictions from the MAM4 are evaluated against the Particle Monte Carlo Model for Simulating Aerosol Interactions and Chemistry (PartMC-MOSAIC), a benchmark model that tracks the evolution of individual particles. We show that size distributions simulated by MAM4 diverge from those simulated by PartMC-MOSAIC after only a few hours of aging by condensation and coagulation in polluted conditions, which leads to large errors in modeled cloud condensation nuclei concentrations. We find that differences between MAM4 and PartMC-MOSAIC are largest under polluted conditions, where the size distribution evolves rapidly though aging by condensation of semi-volatile substances and coagulation among particles. These findings suggest that structural error in modeled aerosol properties contributes to the large inter-model variability in aerosol radiative forcing.

Fierce, Laura M.↗