Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

The NASA Langley Multidisciplinary Uncertainty Quantification Challenge

This paper presents the formulation of an uncertainty quantification challenge problem consisting of five subproblems. These problems focus on key aspects of uncertainty characterization, sensitivity analysis, uncertainty propagation, extreme-case analysis, and robust design.

Crespo, Luis G.↗

The dissolution behavior of borosilicate glasses in far-from equilibrium conditions

In far-from-equilibrium conditions, the dissolution of borosilicate glasses used to immobilize nuclear waste is known to be a function of both temperature and pH. The aim of this paper is to study effects of these variables on three model waste glasses (SON68, ISG, AFCI). To do this, experiments were conducted at temperatures of 23, 40, 70, and 90 °C and pH(RT) values of 9, 10, 11, and 12 with the single-pass flow-through (SPFT) test method. The results from these tests were then used to parameterize a kinetic rate model based on transition state theory. Both the absolute dissolution rates and the rate model parameters are compared with previous results. Discrepancies in the absolute dissolution rates as compared to those obtained using other test methods are discussed. Rate model parameters for the three glasses studied here are nearly equivalent within error and in relative agreement with previous studies. The results were analyzed with a linear multivariate regression (LMR) and a nonlinear multivariate regression performed with the use of the Glass Corrosion Modeling Tool (GCMT), which is capable of providing a robust uncertainty analysis. This robust analysis highlights the high degree of correlation of various parameters in the kinetic rate model. As more data are obtained on borosilicate glasses with varying compositions, the effect of glass composition on the rate parameter values could possibly be obtained. This would allow for the possibility of predicting the forward dissolution rate of glass based solely on composition

Neeway, James J.↗

Monte Carlo analysis of uncertainty propagation in a stratospheric model. 2: Uncertainties due to reaction rates

A concise stratospheric model was used in a Monte-Carlo analysis of the propagation of reaction rate uncertainties through the calculation of an ozone perturbation due to the addition of chlorine. Two thousand Monte-Carlo cases were run with 55 reaction rates being varied. Excellent convergence was obtained in the output distributions because the model is sensitive to the uncertainties in only about 10 reactions. For a 1 ppby chlorine perturbation added to a 1.5 ppby chlorine background, the resultant 1 sigma uncertainty on the ozone perturbation is a factor of 1.69 on the high side and 1.80 on the low side. The corresponding 2 sigma factors are 2.86 and 3.23. Results are also given for the uncertainties, due to reaction rates, in the ambient concentrations of stratospheric species.

Stolarski, R. S.↗

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Report on INL Activities for Uncertainty Reduction Analysis of FY11

This report presents the status of activities performed at INL under the ARC Work Package on "Uncertainty Reduction Analyses" that has a main goal the reduction of uncertainties associated with nuclear data on neutronic integral parameters of interest for the design of advanced fast reactors under consideration by the ARC program. First, an analysis of experiments was carried out. For both JOYO (the first Japanese fast reactor) and ZPPR-9 (a large size zero power plutonium fueled experiment performed at ANL-W in Idaho) the performance of ENDF/B-VII.0 is quite satisfying except for the sodium void configurations of ZPPR-9, but for which one has to take into account the approximation of the modeling. In fact, when one uses a more detailed model (calculations performed at ANL in a companion WP) more reasonable results are obtained. A large effort was devoted to the analysis of the irradiation experiments, PROFIL-1 and -2 and TRAPU, performed at the French fast reactor PHENIX. For these experiments a pre-release of the ENDF/B-VII.1 cross section files was also used, in order to provide validation feedback to the CSWEG nuclear data evaluation community. In the PROFIL experiments improvements can be observed for the ENDF/B-VII.1 capture data in 238 Pu, 241 Am, 244 Cm, 97 Mo, 151 Sm, 153 Eu, and for 240 Pu(n,2n). On the other hand, 240,242 Pu, 95 Mo, 133 Cs and 145 Nd capture C/E results are worse. For the major actinides 235 U and especially 239 Pu capture C/E's are underestimated. For fission products, 105,106 Pd, 143,144 Nd and 147,149 Sm are significantly underestimated, while 101 Ru and 151 Sm are overestimated. Other C/E deviations from unity are within the combined experimental and calculated statistical uncertainty. From the TRAPU analysis, the major improvement is in the predicted 243 Cm build-up, presumably due to an improved 242 Cm capture evaluation. The COSMO experiment was also analyzed in order to provide useful feedback on fission cross sections. It was found out that ENDF/B-VII.1 238,240 Pu fission cross sections have improved with respect to VII.0 files while 242 Pu's fission cross section has not.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Propagation Analysis of Computational Models in Laser Powder Bed Fusion Additive Manufacturing Using Polynomial Chaos Expansions

Computational models for simulating physical phenomena during laser-based powder bed fusion additive manufacturing (L-PBF AM) processes are critical for enhancing our understanding of these phenomena, enable process optimization, and accelerate qualification and certification of AM materials and parts. It is a well-known fact that such models typically involve multiple sources of uncertainty that originate from different sources such as model parameters uncertainty, or model/code inadequacy, among many others. Uncertainty quantification (UQ) is a broad field that focuses on characterizing such uncertainties in order to maximize the benefit of these models. Although UQ has been a center theme in computational models associated with diverse fields such as computational fluid dynamics and macro-economics, it has not yet been fully exploited with computational models for advanced manufacturing. The current study introduces one among the first efforts to conduct uncertainty propagation (UP) analysis in the context of L-PBF AM. More specifically, we present a generalized polynomial chaos expansions (gPCE) framework to assess the distributions of melt pool dimensions due to uncertainty in input model parameters. We develop the methodology and then employ it to validate model predictions, both through benchmarking them against Monte Carlo (MC) methods and against experimental data acquired from an experimental testbed.

36 MATERIALS SCIENCE↗

THERMAL MODELING OF HANFORD LEAD CANISTER’S HEATER BENCH TESTS

A computational fluid dynamics (CFD) model was built to simulate planned testing of heater assemblies for the Hanford Lead Canister (HLC) project. The HLC is a canister storage system that will contain heaters to simulate the decay heat of nuclear material and provide the canister storage system with environmental conditions equivalent to the operating conditions on a dry storage pad. The HLC will be equipped with long-term data collection and monitoring systems to provide an early warning of corrosion, pitting, cracking, or other signs of canister degradation that might threaten the integrity of the containment boundary over the potentially long term of dry storage. An important part of the HLC development is to confirm the function and ability of the electric heater assemblies that were specially designed to provide heating similar to the decay heat of nuclear material contained within the canister storage system. Heater bench testing is planned for early 2022 in a test configuration that does not include the canister. The goal of the bench testing is to verify that the heaters can replicate the decay heat of a canister with nuclear material and to validate the thermal models, which are critical to understanding the HLC’s thermal environment, including the local air flow within the canister storage system. Testing of the heater assemblies inside the canister system are planned in the future to validate canister level thermal models, and rigorous pre-deployment testing of the complete HLC cask and canister system is intended to be completed before the HLC is deployed in the 2025-2026 timeframe. This study presents the pre-test temperature predictions of the bench testing. A description of the heater assemblies and planned bench testing is presented. The model was developed with the commercial CFD code STAR-CCM+. An uncertainty analysis was run with the CFD model to determine the uncertainty in the temperature predictions and provide a range over which the predicted temperatures are expected to vary. The uncertainty analysis was performed by coupling STAR-CCM+ with the software Dakota, which provides advanced parametric analyses, including quantification of margins and uncertainty with computational models. This work is expected to provide insight into SNF canister behavior.

Suffield, Sarah R.↗

THERMAL MODELING OF HANFORD CESIUM AND STRONTIUM CANISTERS DURING SIMULATED LOADING

A computational fluid dynamics (CFD) model was built to simulate planned testing of heater assemblies within a canister and overpack for the Hanford Lead Canister (HLC) project. The HLC is a canister storage system that will contain heaters to simulate the decay heat of nuclear material and provide the canister storage system with environmental conditions equivalent to the operating conditions on a dry storage pad. The HLC will be equipped with long-term data collection and monitoring systems to provide an early warning of corrosion, pitting, cracking, or other signs of canister degradation that might threaten the integrity of the containment boundary over the potentially long term of dry storage. An important part of the HLC development is to make pretest numerical predictions for the behavior of the heated canister during the simulated radiolytic decay heat testing, which simulates the dry storage system during loading operations. The simulated radiolytic decay heat test is planned for mid-2024 in a configuration that includes the heater assembly, overpack, and canister, but with the lids removed to allow loading cesium and strontium capsules into the canister. One of the goals of the test is to evaluate the thermal behavior of the canister and overpack assembly in the ambient air of the test facility, which will provide data critical to validating the thermal models and understanding how the HLC will perform as a system once deployed. To best approximate real-world conditions, the CFD model includes the full air volume of the mock-up truck bay the heated canister test will be performed in, enabling detailed investigation of how the heated canister affects airflow around it. Rigorous pre-deployment testing of the complete HLC cask and canister system is intended to be completed before the HLC is deployed in the 2028 timeframe. This study presents the pre-test temperature predictions of the simulated radiolytic decay heat test. A description of the heater assembly, canister, and overpack system is presented. The model was developed with the commercial CFD software STAR-CCM+. An uncertainty analysis was run with the CFD model to determine the uncertainty in the temperature predictions and provide a range over which the predicted temperatures are expected to vary. The uncertainty analysis was preformed by coupling STAR-CCM+ with the software Dakota, which provides advanced parametric analyses, including quantification of margins and uncertainty with computational models. This work is expected to provide insight into SNF canister behavior.

Carpenter-Graffy, Dina E.↗

Considering Risk and Resilience in Decision-Making

This paper examines the concepts of decision-making, risk analysis, uncertainty and resilience analysis. The relation between risk, vulnerability, and resilience is analyzed. The paper describes how complexity, uncertainty, and ambiguity are the most critical factors in the definition of the approach and criteria for decision-making. Uncertainty in its various forms is what limits our ability to offer definitive answers to questions about the outcomes of alternatives in a decision-making process. It is shown that, although resilience-informed decision-making would seem fundamentally different from risk-informed decision-making, this is not the case as resilience-analysis can be easily incorporated within existing analytic-deliberative decision-making frameworks.

Torres-Pomales, Wilfredo↗

A compact x-ray spectrometer for measurements of electron temperature distributions in inertial confinement fusion implosions at OMEGA

The Wedge Range Filter (WRF), commonly used for proton spectroscopy at the OMEGA Laser Facility and National Ignition Facility, is adapted to measure the x-ray continuum spectrum through transmission measurement using a continuous-gradient filter. Continuum x rays emitted from the hotspot of an implosion contain information about the plasma composition and electron temperature. The WRF data are leveraged to probe this distribution, specifically the electron temperature distribution. In this work, the data recorded with the WRF are forward modeled using a temperature distribution model folded with the WRF response function. An uncertainty analysis is conducted through a Bayesian regression algorithm using a Hamiltonian Monte Carlo sampler. This analysis enables the uncertainties in the instrument response to be folded into the uncertainty estimation of the electron temperature and absolute x-ray emission. Data analysis for a series of OMEGA implosions is presented and compared with radiation hydrodynamic simulations.

Lasers↗

Extended Forward Sensitivity Analysis for Uncertainty Quantification

Verification and validation (V&V) are playing more important roles to quantify uncertainties and realize high fidelity simulations in engineering system analyses, such as transients happened in a complex nuclear reactor system. Traditional V&V in the reactor system analysis focused more on the validation part or did not differentiate verification and validation. The traditional approach to uncertainty quantification is based on a 'black box' approach. The simulation tool is treated as an unknown signal generator, a distribution of inputs according to assumed probability density functions is sent in and the distribution of the outputs is measured and correlated back to the original input distribution. The 'black box' method mixes numerical errors with all other uncertainties. It is also not efficient to perform sensitivity analysis. Contrary to the 'black box' method, a more efficient sensitivity approach can take advantage of intimate knowledge of the simulation code. In these types of approaches equations for the propagation of uncertainty are constructed and the sensitivities are directly solved for as variables in the simulation. This paper presents the forward sensitivity analysis as a method to help uncertainty qualification. By including time step and potentially spatial step as special sensitivity parameters, the forward sensitivity method is extended as one method to quantify numerical errors. Note that by integrating local truncation errors over the whole system through the forward sensitivity analysis process, the generated time step and spatial step sensitivity information reflect global numerical errors. The discretization errors can be systematically compared against uncertainties due to other physical parameters. This extension makes the forward sensitivity method a much more powerful tool to help uncertainty qualification. By knowing the relative sensitivity of time and space steps with other interested physical parameters, the simulation is allowed to run at optimized time and space steps without affecting the confidence of the physical parameter sensitivity results. The time and space steps forward sensitivity analysis method can also replace the traditional time step and grid convergence study with much less computational cost. Several well defined benchmark problems with manufactured solutions are utilized to demonstrate the extended forward sensitivity analysis method. All the physical solutions, parameter sensitivity solutions, even the time step sensitivity in one case, have analytical forms, which allows the verification to be performed in the strictest sense.

97 MATHEMATICS AND COMPUTING↗

Uncertainty, Sensitivity Analysis, and Causal Identification in the Arctic using a Perturbed Parameter Ensemble of the HiLAT Climate Model

Coupled climate models have a large number of input parameters that can affect output uncertainty. We conducted a sensitivity analysis of sea ice proper:es and Arc:c related climate variables to 5 parameters in the HiLAT climate model: air-ocean turbulent exchange parameter (C), conversion of water vapor to clouds (cldfrc_rhminl) and of ice crystals to snow (micro_mg_dcs), snow thermal conduc:vity (ksno), and maximum snow grain size (rsnw_mlt). We used an elementary effect (EE) approach to rank their importance for output uncertainty. EE is an extension of one-at-a-time sensitivity analyses, but it is more efficient in sampling multi-dimensional parameter spaces. We looked for emerging relationships among climate variables across the model ensemble, and used causal discovery algorithms to establish potential pathways for those relationships.

54 ENVIRONMENTAL SCIENCES↗

Karhunen-Loeve expansion analysis of uncertainties in cloud microphysical property retrievals

Here, this study proposes a methodology of quantifying uncertainties for cloud retrievals on model resolution to facilitate the comparison with model outputs. Primary component analysis is applied to reduce the dimension of random variables (up to a factor of 50) and reveal the cross correlations in the input data, making large sampling computationally feasible and uncertainty quantification accurate and reliable. Our approach has the capability of parameterizing input uncertainties and attributing the uncertainties in the retrieval output to each individual source, which allows sensitivity analysis of cloud retrieval algorithms and provides directions for improving observation instruments as well as strategies. We applied the method to characterize uncertainties in cloud ice water content (IWC) retrieved from the DOE Atmospheric Radiation Measurement (ARM) programs baseline cloud microphysical retrieval algorithm (MICROBASE). We test it with a selected ice cloud case observed on 9 March 2000 at the ARM Southern Great Plains site during its 2000 cloud intensive observing period. The test results indicate that (1) uncertainties in the output retrieved by MICROBASE are comparable amongst different retrievals; (2) The mean values obtained by our UQ method are closer to the aircraft data with less errors compared to the direct ensemble average; (3) Ice water path (IWP) generally incurred larger uncertainty in optically thin ice clouds and there was more variability in vertical in the retrieved IWC; and (4) Uncertainties in the output are mainly due to the interactions among different modes of ARM radar pro files.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Analysis of Uncertainty in Medical Reporting: Creation of User and Context-Specific Uncertainty Profiles

While uncertainty is ubiquitous in medical practice, minimal work to date has been performed to analyze the cause and effect relationship between uncertainty and patient outcomes. In medical imaging practice, uncertainty in the radiology report has been well documented to be a source of clinician dissatisfaction. Before one can effectively create intervention strategies aimed at reducing uncertainty, it must first be better understood through context- and user-specific analysis. One strategy for accomplishing this task is to characterize the source of uncertainty and create user-specific uncertainty profiles which take into account a number of provider-specific variables which may contribute to report uncertainty. The resulting data can in turn be used to create real-time report uncertainty metrics aimed at providing uncertainty analytics at the point of care, for the combined purposes of decision support, improved communication, and enhanced clinical/economic outcomes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

TH-A-19A-04: Latent Uncertainties and Performance of a GPU-Implemented Pre-Calculated Track Monte Carlo Method

Purpose: Assessing the performance and uncertainty of a pre-calculated Monte Carlo (PMC) algorithm for proton and electron transport running on graphics processing units (GPU). While PMC methods have been described in the past, an explicit quantification of the latent uncertainty arising from recycling a limited number of tracks in the pre-generated track bank is missing from the literature. With a proper uncertainty analysis, an optimal pre-generated track bank size can be selected for a desired dose calculation uncertainty. Methods: Particle tracks were pre-generated for electrons and protons using EGSnrc and GEANT4, respectively. The PMC algorithm for track transport was implemented on the CUDA programming framework. GPU-PMC dose distributions were compared to benchmark dose distributions simulated using general-purpose MC codes in the same conditions. A latent uncertainty analysis was performed by comparing GPUPMC dose values to a “ground truth” benchmark while varying the track bank size and primary particle histories. Results: GPU-PMC dose distributions and benchmark doses were within 1% of each other in voxels with dose greater than 50% of Dmax. In proton calculations, a submillimeter distance-to-agreement error was observed at the Bragg Peak. Latent uncertainty followed a Poisson distribution with the number of tracks per energy (TPE) and a track bank of 20,000 TPE produced a latent uncertainty of approximately 1%. Efficiency analysis showed a 937× and 508× gain over a single processor core running DOSXYZnrc for 16 MeV electrons in water and bone, respectively. Conclusion: The GPU-PMC method can calculate dose distributions for electrons and protons to a statistical uncertainty below 1%. The track bank size necessary to achieve an optimal efficiency can be tuned based on the desired uncertainty. Coupled with a model to calculate dose contributions from uncharged particles, GPU-PMC is a candidate for inverse planning of modulated electron radiotherapy and scanned proton beams. This work was supported in part by FRSQ-MSSS (Grant No. 22090), NSERC RG (Grant No. 432290) and CIHR MOP (Grant No. MOP-211360)

07 ISOTOPE AND RADIATION SOURCES↗

Modeling the Effect of Surface Platinum–Tin Alloys on Propane Dehydrogenation on Platinum–Tin Catalysts

Uncertainty analysis, reported experimental literature data, and density functional theory were synthesized to model the effect of surface tin coverage on platinum-based catalysts for nonoxidative propane dehydrogenation to propylene. Here, this study tests four different platinum–tin skin surface models as potential catalytic sites, Pt 3 Sn/Pt(100), PtSn/Pt(100), Pt 3 Sn/Pt(111), and Pt 2 Sn/Pt(211), and compares them to the corresponding pure Pt surface sites using an uncertainty analysis methodology that uses BEEF-vdW with its ensembles (BMwE) to generate the uncertainty for the energies of the intermediates and transition states. One experimental data set with two experimental observations, selectivity to propylene and turnover frequency of propylene, was used as a calibration data set to evaluate the impact of the experimental data on informing the models. This study finds that the prior model for Pt 3 Sn/Pt(100) is the most active and Pt 2 Sn/Pt(211) is the most selective toward propylene. Active sites on the (100) facet have the highest probability of being responsible for C 1 and C 2 product formations (C–C bond cleavage). Increasing the Sn coverage on the (100) surface facet to a PtSn/Pt(100) active site leads to a significantly reduced rate and might explain the experimentally observed higher selectivity of Sn-doped catalysts relative to pure Pt catalysts. Next, this study finds that for all surfaces, except PtSn/Pt(100), the rate-controlling steps are the initial dehydrogenation steps alongside some partially rate-controlling second dehydrogenation steps. For PtSn/Pt(100), only the initial terminal dehydrogenation step to CH 3 CH 2 CH 2 * and second dehydrogenation steps are rate-controlling. Next, the calibrated models for all surfaces were found to be selective toward propylene production and model the reported turnover frequency successfully. Nevertheless, Pt 2 Sn/Pt(211) emerges as the active site with some (minor) evidence as the main active site based on Jeffreys’ scale interpretation of Bayes factors. This observation agrees with prior studies that also found step sites to be most likely the most relevant active sites for pure Pt catalysts. Overall, the results indicate that tin, in addition to affecting the binding strength of the adsorbed species, prevents deeper dehydrogenation (reducing coking) and cracking reactions through increasing activation barriers for unwanted side reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling Riverine Dissolved and Particulate Organic Carbon Fluxes from Two Small Watersheds in the Northeastern United States

The coupled carbon (C) cycle across terrestrial and aquatic environments at the watershed scale has been identified as an important, but poorly constrained component of the global carbon budget. Here, we extended Soil and Water Assessment Tool (SWAT) with coupled riverine particulate organic carbon (POC) and dissolved organic carbon (DOC) modules (referred to as SWAT-C hereafter). Results show that SWAT-C reproduced daily POC and DOC fluxes well in two watersheds in the Northeastern United States. We found that SWAT-C tended to underestimate high flows and peak DOC and POC fluxes. Uncertainty analysis indicated flux uncertainties associated with POC and DOC simulation were larger than those for flow simulation. Sensitive parameters controlling POC and DOC biogeochemical processes were identified along with how these parameters influence mechanisms underlying C cycling. We anticipate that the tool developed and applied here will inform C related ecosystem services in watershed assessment and planning.

Dissolved organic carbon, Particulate organic carb↗

Combined Meteorological and Hydrologic Uncertainties Shape Projections of Future Soil Moisture in the Eastern United States

Physical hazards pose risks to many critical systems. Designing adaptive measures to mitigate these risks is challenging due to large uncertainties in modeling future hazards and the associated sectoral responses. Here, we help address this challenge in a hydrologic context by examining the combined role of meteorological forcing and hydrologic parameter uncertainties in shaping projections of future soil moisture. By encoding a simple conceptual water balance model in a differentiable programming framework, we facilitate fast runtimes and an efficient calibration, enabling an improved uncertainty analysis. We characterize uncertainty in model parameters by calibrating against different target data sets and by using several loss functions. We then convolve the resulting parameter ensemble with a set of Earth system model projections to produce a large ensemble (2,340 members) of daily soil moisture simulations. Focusing on the eastern United States, we find that most ensemble members project a drying of soils across the region, although some simulate wetter conditions throughout this century. Our ensemble shows an increase in the frequency and intensity of dry extremes while there is less agreement for wet extremes. We conduct sensitivity analyses on several soil moisture signatures to measure the relative influence of meteorological and hydrologic uncertainties across space and time. Both meteorological and hydrologic factors contribute consistently to uncertainty surrounding long-term trends, while changes to both wet and dry soil extremes are typically more sensitive to hydrologic parameter uncertainty. Our results underscore the need to account for varied sources of uncertainty when developing long-term hydrometeorological projections.

Lafferty, David C. [University of Illinois Urbana‐↗