Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Uncertainty in Thermal Modeling of Spent Nuclear Fuel Casks

Uncertainty is a key metric in computational modeling that must be evaluated for results to have wide ranging applicability. A well characterized uncertainty range is ideal with clear error bars on results that can be presented to stakeholders. In the field of spent fuel cask modeling, this ideal has been historically difficult to achieve in practice because of the computationally intensive nature of the models used and the difficulty assigning reasonable uncertainties to quantities in as-built systems. The work in this report has been conducted to evaluate the overall state of uncertainty and sensitivity in spent fuel cask models and develop methodologies for evaluating these uncertainties. These methodologies must be practical for engineering applications. They should not require excessive computational resources or calendar time to achieve results. In engineering, the model must be on a scale such that it can be changed and adapted throughout a project as new information is discovered and project goals evolve. This report covers three major modeling task areas that provide an overview of the types of sensitivity and uncertainty present in a spent fuel storage and transportation system. Section 3 discusses sensitivity and uncertainty analysis in the effective thermal conductivity model for the fuel region and applies these results to a single assembly model. Section 4 shows sensitivity analysis of a full cask model in the TN-32B and Section 5 demonstrates the overall uncertainty workflow using Coolant Boiling in Rod Arrays – Spent Fuel Storage and STAR-CCM+ developed from the sensitivity work in the preceding sections.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Accelerated Carbon and Water Cycles in the Amazon and Congo Basins Revealed From TRENDY Models and Remote Sensing Products

Tropical forests play a vital role in the global carbon cycle and land–atmosphere interactions. Estimating tropical forest carbon–water dynamics is challenging due to observational and modeling uncertainties. This study leverages the “Trends and drivers of the regional scale terrestrial sources and sinks of carbon dioxide” (TRENDY) project models and satellite observations to assess changes (2003–2021) in vegetation carbon, gross primary production (GPP), evapotranspiration (ET), and net biosphere production (NBP) in the Amazon and Congo. Atmospheric CO 2 , climate variability, and land use and land cover changes constrain these variables between 1700 and 2021 with the overall increasing trends of carbon stock and fluxes. The models overestimate vegetation carbon and GPP, while ET and NBP are consistent with observations. Fire-activated models predict lower values for vegetation carbon and GPP, ET, and NBP, aligning more closely with observations. The higher ET from fire-activated models may result from enhanced soil evaporation due to increased canopy openings. Fire-inactivated models could well estimate the magnitudes of NBP. The high vegetation carbon in nitrogen-enabled models points to simulation uncertainties and imbalance in model numbers regarding the nitrogen cycle. Although the nitrogen cycle enhances water use efficiency in both the Amazon and Congo, the models show a higher sensitivity to the nitrogen cycle in the Congo. This study highlights the challenges in accurately representing tropical biogeochemical cycles and the values of satellite products in model evaluations, underscoring the need for standard modeling protocols that address biogeochemical components (e.g., nutrient cycles) to better resolve process-based representations.

Shi, Mingjie [Pacific Northwest National Laborator↗
DOE OSTI2017

Uncertainty quantification for optical model parameters

Although uncertainty quantification has been making its way into nuclear theory, these methods have yet to be explored in the context of reaction theory. For example, it is well known that different parameterizations of the optical potential can result in different cross sections, but these differences have not been systematically studied and quantified. The purpose of our work is to investigate the uncertainties in nuclear reactions that result from fitting a given model to elastic-scattering data, as well as to study how these uncertainties propagate to the inelastic and transfer channels. We use statistical methods to determine a best fit and create corresponding 95% confidence bands. A simple model of the process is fit to elastic-scattering data and used to predict either inelastic or transfer cross sections. In this initial work, we assume that our model is correct, and the only uncertainties come from the variation of the fit parameters. Here, we study a number of reactions involving neutron and deuteron projectiles with energies in the range of 5–25 MeV/u, on targets with mass A=12–208. We investigate the correlations between the parameters in the fit. The case of deuterons on 12 C is discussed in detail: the elastic-scattering fit and the prediction of 12 C(d,p) 13 C transfer angular distributions, using both uncorrelated and correlated χ 2 minimization functions. The general features for all cases are compiled in a systematic manner to identify trends. This work shows that, in many cases, the correlated χ 2 functions (in comparison to the uncorrelated χ 2 functions) provide a more natural parameterization of the process. These correlated functions do, however, produce broader confidence bands. Further optimization may require improvement in the models themselves and/or more information included in the fit.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Benchmarking FFTF LOFWOS Test# 13 using SAM code: Baseline model development and uncertainty quantification

The development and deployment of advanced reactors, such as the sodium-cooled fast reactor (SFR), relies on sophisticated modeling tools to ensure the safety of the design under various transients. The predictive capability of these advanced modeling tools requires validation to garner trust in supporting the licensing of the advanced reactors. For this reason, the International Atomic Energy Agency (IAEA) initiated a coordinated research project (CRP) in 2018 for the analysis of the Fast Flux Test Facility (FFTF) Loss of Flow Without Scram (LOFWOS) Test #13.In this study, we present and discuss the benchmarking efforts of the modern system code SAM on the FFTF LOFWOS Test #13. Further, the SAM baseline model was developed according to the benchmark specification, which included a detailed core model with reactivity feedback. Generally, good agreement was observed between the baseline results and benchmark measurements; however, discrepancies persisted, particularly in predicted fuel assembly coolant outlet temperatures. Utilizing the baseline model, uncertainty quantification (UQ) and sensitivity analysis (SA) were conducted with the assistance of various statistical learning and machine learning methods, including kernel density estimation, Gaussian processes, and Sobol indices. Following the baseline model prediction and UQ and SA results, we discuss the reasons for the simulation discrepancies and propose further improvements to the model. This benchmarking effort adheres to the best-estimate plus uncertainty approach and can serve as a valuable example for supporting risk-informed licensing of advanced reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2017

The Global Aerosol Synthesis and Science Project (GASSP): Measurements and Modeling to Reduce Uncertainty

The largest uncertainty in the historical radiative forcing of climate is caused by changes in aerosol particles due to anthropogenic activity. Sophisticated aerosol microphysics processes have been included in many climate models in an effort to reduce the uncertainty. However, the models are very challenging to evaluate and constrain because they require extensive in situ measurements of the particle size distribution, number concentration, and chemical composition that are not available from global satellite observations. The Global Aerosol Synthesis and Science Project (GASSP) aims to improve the robustness of global aerosol models by combining new methodologies for quantifying model uncertainty, to create an extensive global dataset of aerosol in situ microphysical and chemical measurements, and to develop new ways to assess the uncertainty associated with comparing sparse point measurements with low-resolution models. GASSP has assembled over 45,000 hours of measurements from ships and aircraft as well as data from over 350 ground stations. The measurements have been harmonized into a standardized format that is easily used by modelers and nonspecialist users. Available measurements are extensive, but they are biased to polluted regions of the Northern Hemisphere, leaving large pristine regions and many continental areas poorly sampled. The aerosol radiative forcing uncertainty can be reduced using a rigorous model–data synthesis approach. Nevertheless, our research highlights significant remaining challenges because of the difficulty of constraining many interwoven model uncertainties simultaneously. Although the physical realism of global aerosol models still needs to be improved, the uncertainty in aerosol radiative forcing will be reduced most effectively by systematically and rigorously constraining the models using extensive syntheses of measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Automatic Selection of High-Fidelity Models and Surrogates for Uncertainty Analysis

Surrogate models (SMs) with distinct features developed in the last decade provide an efficient substitute to the high-fidelity physical simulations. However, it is generally challenging to quantify the accuracy of surrogate models in a region of interest and examine reliability in the overall domain without additional system evaluations. This paper introduces a new scheme, automated adaptive model selection, to adaptively construct and quantify a set of surrogate models and automatically switch between the surrogates and a high-fidelity code. Cross-validation approaches, such as KFold, Leave One Out (LOO) and Leave P Out (LPO), are employed to assess the global accuracy of the surrogates. The switching strategy is based on local validation metrics, crowding distance, that are able to provide an assessment on the goodness of the prediction made by the surrogates. This decision metric decides whether the surrogates are good enough for a certain realization or whether the high-fidelity code needs to be executed. This new scheme has been implemented in Risk Analysis in Virtual ENvironment (RAVEN) software, which can be employed to accelerate the Probabilistic Risk Assessment (PRA) and Uncertainty Quantification (UQ) processes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

HIERARCHICAL PROBABILISTIC INFERENCE OF COSMIC SHEAR

Point estimators for the shearing of galaxy images induced by gravitational lensing involve a complex inverse problem in the presence of noise, pixelization, and model uncertainties. We present a probabilistic forward modeling approach to gravitational lensing inference that has the potential to mitigate the biased inferences in most common point estimators and is practical for upcoming lensing surveys. The first part of our statistical framework requires specification of a likelihood function for the pixel data in an imaging survey given parameterized models for the galaxies in the images. We derive the lensing shear posterior by marginalizing over all intrinsic galaxy properties that contribute to the pixel data (i.e., not limited to galaxy ellipticities) and learn the distributions for the intrinsic galaxy properties via hierarchical inference with a suitably flexible conditional probabilitiy distribution specification. We use importance sampling to separate the modeling of small imaging areas from the global shear inference, thereby rendering our algorithm computationally tractable for large surveys. With simple numerical examples we demonstrate the improvements in accuracy from our importance sampling approach, as well as the significance of the conditional distribution specification for the intrinsic galaxy properties when the data are generated from an unknown number of distinct galaxy populations with different morphological characteristics.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Cherenkov Telescope Array sensitivity to the putative millisecond pulsar population responsible for the Galactic Centre excess

ABSTRACT The leading explanation of the Fermi Galactic Centre γ-ray excess is the extended emission from an unresolved population of millisecond pulsars (MSPs) in the Galactic bulge. Such a population would, along with the prompt γ-rays, also inject large quantities of electrons/positrons (e±) into the interstellar medium. These e± could potentially inverse-Compton (IC) scatter ambient photons into γ-rays that fall within the sensitivity range of the upcoming Cherenkov Telescope Array (CTA). In this article, we examine the detection potential of CTA to this signature by making a realistic estimation of the systematic uncertainties on the Galactic diffuse emission model at TeV-scale γ-ray energies. We forecast that, in the event that e± injection spectra are harder than E−2, CTA has the potential to robustly discover the IC signature of a putative Galactic bulge MSP population sufficient to explain the Galactic Centre excess for e± injection efficiencies in the range of ≈2.9–74.1 per cent, or higher, depending on the level of mismodelling of the Galactic diffuse emission components. On the other hand, for spectra softer than E−2.5, a reliable CTA detection would require an unphysically large e± injection efficiency of ${\gtrsim} 158{{\ \rm per\ cent}}$. However, even this pessimistic conclusion may be avoided in the plausible event that MSP observational and/or modelling uncertainties can be reduced. We further find that, in the event that an IC signal were detected, CTA can successfully discriminate between an MSP and a dark matter origin for the radiating e±.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Cosmology from weak lensing, galaxy clustering, CMB lensing, and tSZ – I. 10 × 2pt modelling methodology

ABSTRACT The overlap of galaxy surveys and cosmic microwave background (CMB) experiments presents an ideal opportunity for joint cosmological data set analyses. In this paper we develop a halo model-based method for the first joint analysis combining these two experiments using 10 correlated two-point functions (10 × 2pt) derived from galaxy position, galaxy shear, CMB lensing convergence, and Compton-y fields. We explore this method using the Vera Rubin Observatory Legacy Survey of Space and Time (LSST) and the Simons Observatory (SO) as examples. We find such LSS × CMB joint analyses lead to significant improvement in Figure-of-Merit of Ωm and S8 over the constraints from using LSS-only probes within Λ cold dark matter (ΛCDM) model. We identify that the shear–y and y–y correlations are the most valuable additions when thermal Sunyaev–Zel’dolvich (tSZ) is included. We further identify the dominant sources of halo model uncertainties in the small-scale modelling, and investigate the impact of halo self-calibration due to the inclusion of small-scale tSZ information.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

A Research Roadmap for Computation-Based Human Reliability Analysis

The United States (U.S.) Department of Energy (DOE) is sponsoring research through the Light Water Reactor Sustainability (LWRS) program to extend the life of the currently operating fleet of commercial nuclear power plants. The Risk Informed Safety Margin Characterization (RISMC) research pathway within LWRS looks at ways to maintain and improve the safety margins of these plants. The RISMC pathway includes significant developments in the area of thermalhydraulics code modeling and the development of tools to facilitate dynamic probabilistic risk assessment (PRA). PRA is primarily concerned with the risk of hardware systems at the plant; yet, hardware reliability is often secondary in overall risk significance to human errors that can trigger or compound undesirable events at the plant. This report highlights ongoing efforts to develop a computation-based approach to human reliability analysis (HRA). This computation-based approach differs from existing static and dynamic HRA approaches in that it: (i) interfaces with a dynamic computation engine that includes a full scope plant model, and (ii) interfaces with a PRA software toolset. The computation-based HRA approach presented in this report is called the Human Unimodels for Nuclear Technology to Enhance Reliability (HUNTER) and incorporates in a hybrid fashion elements of existing HRA methods to interface with new computational tools developed under the RISMC pathway. The goal of this research effort is to model human performance more accurately than existing approaches, thereby minimizing modeling uncertainty found in current plant risk models.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Front-end engineering design (FEED) studies: a quantitative analysis

NETL has devised a methodology for normalizing FEED study metrics of interest and allowing cautious quantitative comparison across FEED studies. This presentation introduces the novel quantitative comparison methodology and presents results from utilizing this methodology to examine data presented in recent FEED study reports. The quantitative methodology developed for the examination of FEED study performance and cost also allows comparison of real-world performance and costs against NETL TEA model predicted performance and cost. Learnings from examining NETL model predicted performance and cost versus real world reported values are highlighted. These learnings provide insight into NETL TEA model uncertainty and highlight opportunities for further model development.

FEED Studies↗
NASA NTRS1999

Substructure Synthesis: A Controls Approach

Substructure synthesis from a controls perspective is considered. An efficient and computationally robust method for synthesis of substructures is developed. The method considers the interface forces/moments as control inputs and redefines the synthesis problem in terms of obtaining a constant gain compensator which would ensure the connectivity requirements of the combined structure. Orthogonal similarity transformations are used to provide simplified synthesized dynamics of the combined system. The simplicity of form in transformed coordinates are exploited to effectively deal with modeling parametric and non-parametric uncertainties at substructure level. Uncertainty models of reasonable size and complexity are derived for the combined structure from those in the substructure models.

Maghami, Peiman G.↗
NASA NTRS2011

Uncertainty Analysis via Failure Domain Characterization: Unrestricted Requirement Functions

This paper proposes an uncertainty analysis framework based on the characterization of the uncertain parameter space. This characterization enables the identification of worst-case uncertainty combinations and the approximation of the failure and safe domains with a high level of accuracy. Because these approximations are comprised of subsets of readily computable probability, they enable the calculation of arbitrarily tight upper and lower bounds to the failure probability. The methods developed herein, which are based on nonlinear constrained optimization, are applicable to requirement functions whose functional dependency on the uncertainty is arbitrary and whose explicit form may even be unknown. Some of the most prominent features of the methodology are the substantial desensitization of the calculations from the assumed uncertainty model (i.e., the probability distribution describing the uncertainty) as well as the accommodation for changes in such a model with a practically insignificant amount of computational effort.

Crespo, Luis G.↗
NASA NTRS2023

Sensitivity of the MAR Regional Climate Model Snowpack to the Parameterization of the Assimilation of Satellite-Derived Wet-Snow Masks on the Antarctic Peninsula

Both regional climate models (RCMs) and remote sensing (RS) data are essential tools in understanding the response of polar regions to climate change. RCMs can simulate how certain climate variables, such as surface melt, runoff and snowfall, are likely to change in response to different climate scenarios but are subject to biases and errors. RS data can assist in reducing and quantifying model uncertainties by providing indirect observations of the modeled variables on the present climate. In this work, we improve on an existing scheme to assimilate RS wet snow occurrence data with the “Modèle Atmosphérique Régional” (MAR) RCM and investigate the sensitivity of the RCM to the parameters of the scheme. The assimilation is performed by nudging the MAR snowpack temperature to match the presence of liquid water observed by satellites. The sensitivity of the assimilation method is tested by modifying parameters such as the depth to which the MAR snowpack is warmed or cooled, the quantity of water required to qualify a MAR pixel as “wet” (0.1 % or 0.2 % of the snowpack mass being water), and assimilating different RS datasets. Data assimilation is carried out on the Antarctic Peninsula for the 2019–2021 period. The results show an increase in meltwater production (+66.7 % on average, or +95 Gt), along with a small decrease in surface mass balance (SMB) (−4.5 % on average, or −20 Gt) for the 2019–2020 melt season after assimilation. The model is sensitive to the tested parameters, albeit with varying orders of magnitude. The prescribed warming depth has a larger impact on the resulting surface melt production than the liquid water content (LWC) threshold due to strong refreezing occurring within the top layers of the snowpack. The values tested for the LWC threshold are lower than the LWC for typical melt days (approximately 1.2 %) and impact results mainly at the beginning and end of the melting period. The assimilation method will allow for the estimation of uncertainty in MAR meltwater production and will enable the identification of potential issues in modeling near-surface snowpack processes, paving the way for more accurate simulations of snow processes in model projections.

regional climate models↗
DOE OSTI2023

Parameter estimation with maximal updated densities

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of “true” parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs “selective regularization” only in the parameter directions not informed by data. Further, the solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters. The first problem utilizes spatial data from a stationary partial differential equation to produce a MUD estimate of an uncertain boundary condition. The second problem utilizes temporal data obtained from the state-of-the-art ADvanced CIRCulation (ADCIRC) model to obtain a MUD estimate of uncertain wind drag coefficients for a simulated extreme weather event near the Shinnecock Inlet located in the Outer Barrier of Long Island, NY, USA.

42 ENGINEERING↗
DOE OSTI2016

Uncertainty Quantification in Climate Modeling and Projection

The projection of future climate is one of the most complex problems undertaken by the scientific community. Although scientists have been striving to better understand the physical basis of the climate system and to improve climate models, the overall uncertainty in projections of future climate has not been significantly reduced (e.g., from the IPCC AR4 to AR5). With the rapid increase of complexity in Earth system models, reducing uncertainties in climate projections becomes extremely challenging. Since uncertainties always exist in climate models, interpreting the strengths and limitations of future climate projections is key to evaluating risks, and climate change information for use in Vulnerability, Impact, and Adaptation (VIA) studies should be provided with both well-characterized and well-quantified uncertainty. The workshop reported herein aimed at providing participants, many of them from developing countries, information on strategies to quantify the uncertainty in climate model projections and assess the reliability of climate change information for decision-making. The program included a mixture of lectures on fundamental concepts in Bayesian inference and sampling, applications, and hands-on computer laboratory exercises employing software packages for Bayesian inference, Markov Chain Monte Carlo methods, and global sensitivity analyses. The lectures covered a range of scientific issues underlying the evaluation of uncertainties in climate projections, such as the effects of uncertain initial and boundary conditions, uncertain physics, and limitations of observational records. Progress in quantitatively estimating uncertainties in hydrologic, land surface, and atmospheric models at both regional and global scales was also reviewed. The application of Uncertainty Quantification (UQ) concepts to coupled climate system models is still in its infancy. The Coupled Model Intercomparison Project (CMIP) multi-model ensemble currently represents the primary data for assessing reliability and uncertainties of climate change information. An alternative approach is to generate similar ensembles by perturbing parameters within a single-model framework. One of workshop’s objectives was to give participants a deeper understanding of these approaches within a Bayesian statistical framework. However, there remain significant challenges still to be resolved before UQ can be applied in a convincing way to climate models and their projections.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2011

Space Radiation Cancer Risk Projections and Uncertainties - 2010

Uncertainties in estimating health risks from galactic cosmic rays greatly limit space mission lengths and potential risk mitigation evaluations. NASA limits astronaut exposures to a 3% risk of exposure-induced death and protects against uncertainties using an assessment of 95% confidence intervals in the projection model. Revisions to this model for lifetime cancer risks from space radiation and new estimates of model uncertainties are described here. We review models of space environments and transport code predictions of organ exposures, and characterize uncertainties in these descriptions. We summarize recent analysis of low linear energy transfer radio-epidemiology data, including revision to Japanese A-bomb survivor dosimetry, longer follow-up of exposed cohorts, and reassessments of dose and dose-rate reduction effectiveness factors. We compare these projections and uncertainties with earlier estimates. Current understanding of radiation quality effects and recent data on factors of relative biological effectiveness and particle track structure are reviewed. Recent radiobiology experiment results provide new information on solid cancer and leukemia risks from heavy ions. We also consider deviations from the paradigm of linearity at low doses of heavy ions motivated by non-targeted effects models. New findings and knowledge are used to revise the NASA risk projection model for space radiation cancer risks.

Cucinotta, Francis A.↗
NASA NTRS1972

Derivation of mission fluences from flux models: Propagation of uncertainties

The calculation of fluences from the flux models for spacecraft designers, and the propagation of uncertainties in the flux models to larger uncertainties in the final answer are discussed. Ionization and displacement damage in silicon, fluence, and a fluence of an equivalent energy are considered. Data in graph form are presented on stopping power and range curves for electrons and protons in silicon, relative electron and proton damage in silicon, and electron fluences expressed as 3 MeV equivalent and proton fluences expressed as 20 MeV equivalent for flybys in Jupiter's magnetic equatorial plane. It is concluded that the problem includes the uncertainty in peak flux, which has an immediate linear effect; uncertainty in the spatial distribution of the flux which gives great divergency between the upper-limit model and the nominal model and in the case of protons, may preclude any mission planning in order to make the situation better; and the uncertainty in the energy spectrum both in shape and energy location of the peak, if any, and which has little importance for mission planning if the spectrum is fairly constant.

Barengoltz, J.↗