Search NASA⌕ Search

SEARCH · Search NASA

Results for “input uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗

HFIR Steady State Heat Transfer Code (HSSHTC) Statistical Uncertainty Analysis

HSSHTC, the safety basis steady state TH code for HFIR, uses a highly conservative approach in which all input and calculation uncertainties are resolved simultaneously at their most limiting setting. This results in excessive conservatism which does not account for the high unlikelihood of such simultaneous worst-case conditions. The present study explores an alternative approach, BEPU, in which reasonable working assumptions for the probability distribution of each input uncertainty are used to determine a relationship between burnout power margin and core fuel failure probability. This was performed under a philosophy of perturbing uncertainty parameters already defined within the HSSHTC methodology while preserving the HSSHTC calculation approach and solution methodology itself. Based on the assumptions employed in this study, the BEPU approach resulted in a 0.29 increase in burnout power ratio (25 MW increase in burnout power) compared to the latest HSSHTC calculations of C-HFIR-2026-004. The study can be refined in the future by employing fuel fabrication data to provide more realistic input distributions. Future changes to the HSSHTC methodology would potentially allow a more comprehensive treatment of uncertainties which may further increase the burnout power ratio.

Wysocki, Aaron [ORNL] (ORCID:0000000222043779)↗

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗

Multi-modelling predictions show high uncertainty of required carbon input changes to reach a 4‰ target

Soils store vast amounts of carbon (C) on land, and increasing soil organic carbon (SOC) stocks in already managed soils such as croplands may be one way to remove C from the atmosphere, thereby limiting subsequent warming. The main objective of this study was to estimate the amount of additional C input needed to annually increase SOC stocks by 4‰ at 16 long-term agricultural experiments in Europe, including exogenous organic matter (EOM) additions. We used an ensemble of six SOC models and ran them under two configurations: (1) with default parametrization and (2) with parameters calibrated site-by-site to fit the evolution of SOC stocks in the control treatments (without EOM). We compared model simulations and analysed the factors generating variability across models. The calibrated ensemble was able to reproduce the SOC stock evolution in the unfertilised control treatments. We found that, on average, the experimental sites needed an additional 1.5 ± 1.2 Mg C ha -1 year -1 to increase SOC stocks by 4‰ per year over 30 years, compared to the C input in the control treatments (multi-model median ± median standard deviation across sites). That is, a 119% increase compared to the control. While mean annual temperature, initial SOC stocks and initial C input had a significant effect on the variability of the predicted C input in the default configuration (i.e., the relative standard deviation of the predicted C input from the mean), only water-related variables (i.e., mean annual precipitation and potential evapotranspiration) explained the divergence between models when calibrated. Here, our work highlights the challenge of increasing SOC stocks in agriculture and accentuates the need to increasingly lean on multi-model ensembles when predicting SOC stock trends and related processes. To increase the reliability of SOC models under future climate change, we suggest model developers to better constrain the effect of water-related variables on SOC decomposition.

4 per 1000 initiative↗

A Review and Comparison of Different Sensitivity Analysis Techniques in Practice

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question – How do sources of uncertainty or changes in the model inputs relate to uncertainty in the output? – different methods are associated with different assumptions, constraints, and required resources, leading to conclusions that may vary in interpretability and level of detail. Thus, it is crucial that the practitioner selects the desired sensitivity analysis method judiciously, making sure to match the selected approach to the specifics of their problem and to their desired objectives. In this chapter, we provide a practical overview of a collection of widely used, widely available sensitivity analysis methods. We focus on global sensitivity approaches, which seek to characterize how uncertainty in the model output may be allocated to sources of uncertainty in model inputs across the entire input space. Generally, this will require the practitioner to specify a probability distribution over the input space. On the other hand, methods for local sensitivity analysis do not require this specification but they have more limited utility, providing insight into sources of uncertainty associated only with a particular, specified location in the input space. Our hope is that this chapter may serve as a decision-making tool for practitioners, helping to guide the selection of a sensitivity analysis approach that will best fit their needs. To support this goal, we have selected a suite of approaches to cover, which, while not exhaustive, we believe provides a flexible and robust sensitivity analysis toolkit. All methods included are widely used and available in standard software packages.

97 MATHEMATICS AND COMPUTING↗

Sensitive parameter identification and uncertainty quantification for the stability of pipeline conveying fluid

In this study, several uncertainty quantification and sensitivity analysis methods are used to determine the most sensitive geometric and material input parameters of a cantilevered pipeline conveying fluid when uncertainty is introduced to the system at the onset of instability. The full nonlinear equations of motion are modeled using the extended Hamilton’s principle and then discretized using Galerkin’s method. A parametric study is first performed, and the Morris elementary effects are calculated to obtain a preliminary understanding of how the onset speed changes when each parameter is introduced to a ± 5% uncertainty. Then, four different input uncertainty distributions, mainly, uniform and Gaussian distribution, are chosen to investigate how input distributions affect uncertainty in the output. A convergence analysis is used to determine the number of samples needed to maintain simulation accuracy while saving the most computational time. Then, Monte Carlo simulations are run, and the output distributions for each input distribution at ± 1%, ± 3% and ± 5% input uncertainty range are found and discussed. Additionally, the Pearson correlation coefficients are evaluated for different uncertainty ranges. A final Monte Carlo study is performed in which single parameters are held constant while all others still have uncertainty. Overall, the flow speed at the onset of instability is the most sensitive to changes in the outer diameter of the pipe.

36 MATERIALS SCIENCE↗

Emulators for Scarce and Noisy Data: Application to Auxiliary-Field Diffusion Monte Carlo for Neutron Matter

Understanding the equation of state (EOS) of pure neutron matter is necessary for interpreting multimessenger observations of neutron stars. Reliable data analyses of these observations require well-quantified uncertainties for the EOS input, ideally propagating uncertainties from nuclear interactions directly to the EOS. This, however, requires calculations of the EOS for a prohibitively larger number of nuclear Hamiltonians, solving the nuclear many-body problem for each one. Quantum Monte Carlo methods, such as auxiliary-field diffusion Monte Carlo (AFDMC), provide precise and accurate results for the neutron matter EOS, but they are very computationally expensive, making them unsuitable for the fast evaluations necessary for uncertainty propagation. Here, we employ parametric matrix models to develop fast emulators for AFDMC calculations of neutron matter and use them to directly propagate uncertainties of coupling constants in the Hamiltonian to the EOS. As these uncertainties include estimates of the effective field theory truncation uncertainty, this approach provides robust uncertainty estimates for use in astrophysical data analyses. In conclusion, this Letter will enable novel applications such as using astrophysical observations to put constraints on coupling constants for nuclear interactions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Isomeric yield ratios of fission products: A missing piece in reactor antineutrino summation calculations

The calculation of the spectrum of antineutrinos ($\bar{v}_e$) from a reactor is a complicated problem requiring several nuclear data and physics inputs. Many of these have been investigated thoroughly to improve calculations and properly account for uncertainties. One input which has heretofore escaped consideration is the fission-yield distribution between ground and isomeric states. Here, in this work, we explore the effect of incorporating newly evaluated isomeric yield ratios (IYR) for 43 fission products into summation calculations and identify the disproportionate importance of certain isotopes, particularly at higher energies. Our analysis indicates that updated IYRs contribute to a significant increase in the $\bar{v}_e$ spectrum around and above 7 MeV, with increases of more than 50% at higher energies. Through a detailed sensitivity study, we highlight a number of isotopes for which the IYR has a substantial effect on the $\bar{v}_e$ spectrum. This work stresses the critical role of isomeric yields in calculations of reactor $\bar{v}_e$ spectra and points to the necessity for their accurate experimental determination, especially for key fission products, in order to refine our understanding and address the observed anomalies between measured and calculated $\bar{v}_e$ spectra.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Isomeric Yield Ratios of fission products: a missing piece in reactor antineutrino summation calculations

The calculation of the spectrum of antineutrinos ( $\overline{V}$ e ) from a reactor is a complicated problem requiring several nuclear data and physics inputs. Many of these have been investigated thoroughly to improve calculations and properly account for uncertainties. One input which has heretofore escaped consideration is the fission yield distribution between ground and isomeric states. In this work, we explore the effect of incorporating newly evaluated isomeric yield ratios (IYR) for 43 fission products into summation calculations and identify the disproportionate importance of certain isotopes, particularly at higher energies. Our analysis indicates that updated IYRs contribute to a significant increase in the $\overline{V}$ e spectrum around and above 7 MeV, with increases of more than 50% at higher energies. Through a detailed sensitivity study, we highlight a number of isotopes for which the IYR has a substantial effect on the $\overline{V}$ e spectrum. This work stresses the critical role of isomeric yields in calculations of reactor $\overline{V}$ e spectra and points to the necessity for their accurate experimental determination, especially for key fission products, in order to refine our understanding and address the observed anomalies between measured and calculated $\overline{V}$ e spectra.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty propagation in pore water chemical composition calculation using surrogate models

Performance assessment in deep geological nuclear waste repository systems necessitates an extended knowledge of the pore water chemical conditions prevailing in host-rock formations. In the last two decades, important progress has been made in the experimental characterization and thermodynamic modeling of pore water speciation, but the influence of experimental artifacts and uncertainties of thermodynamic input parameters are seldom evaluated. In this respect, we conducted an uncertainty propagation study in a reference geochemical model describing the pore water chemistry of the Callovian-Oxfordian clay formation. Nineteen model input parameters were perturbed, including those associated to experimental characterization (leached anions, exchanged cations, cation exchange selectivity coefficients) and those associated to generic thermodynamic databases (solubilities). A set of 13 quantities of interest were studied by the use of polynomial chaos expansions built non-intrusively with a least-squares forward stepwise regression approach. Training and validation sets of simulations were carried out using the geochemical speciation code PHREEQC. The statistical results explored the marginal distribution of each quantity of interest, their bivariate correlations as well as their global sensitivity indices. The influence of the assumed distributions for input parameters uncertainties was evaluated by considering two parametric domain sizes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest (QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate r. We characterized two input data uncertainty sources from the experiment (the distortion from the camera U c and the non-zero-angle fuel placement U Y ), the prediction and model form uncertainty from the deep neural network (U m ), as well as the variability from the manually segmented images used for training it (U s ). Here, we conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.

42 ENGINEERING↗

Uncertainty Quantification of Calculated Temperatures for the AGR 5/6/7 Experiment

This report documents the quantification of uncertainty of the calculated temperature data for the Advanced Gas Reactor (AGR) 5/6/7 fuel irradiation experiment conducted in the Advanced Test Reactor at Idaho National Laboratory in support of the Advanced Reactor Technologies? research and development program. Recognizing uncertainties inherent in physics and thermal simulations of the AGR 5/6/7 capsules, the results of the numerical simulations are used in combination with statistical analysis methods to improve qualification of measured data. The calculated fuel temperatures for AGR tests are also used for validation of the fission product transport and fuel performance simulation models. These crucial roles of the calculated fuel temperatures in ensuring achievement of the AGR experimental program objectives require accurate determination of the model temperature uncertainties. This report covers temperature uncertainty results for each of the five AGR 5/6/7 capsules. To quantify the uncertainty of calculated temperatures determined using the ABAQUS finite element heat transfer code, this study identifies and analyzes model parameters of potential importance to the calculated temperatures of fuel compacts and thermocouples. The selection of input parameters for uncertainty quantification is based on the ranking of their influences upon temperature predictions. Thus, selected input parameters include those with high sensitivity and those with the largest uncertainty. Propagation of model parameter uncertainty and sensitivity is then used to quantify the overall uncertainty of calculated temperatures. Measurement uncertainty, analysis of modeling assumptions, and expert judgment are used as the basis to quantify the uncertainty range for selected input parameters. The input uncertainties are dynamic, accounting for the effect of unplanned events and changes in thermal properties of capsule components over extended exposure to high temperatures and fast neutron irradiation. The sensitivity analysis performed in this work went beyond the traditional local sensitivity. Using experimental design, analysis of pairwise interactions of model parameters was performed to establish sufficiency of the time dependent first order (linear) expansion terms in constructing the temperature response surface. To achieve completeness, uncertainty propagation made use of pairwise noise correlations of model parameters. Furthermore, using an interpolation scheme over the input parameter domain, the analysis obtains time dependent sensitivity over the test campaign duration. This allows computation of uncertainty for the calculated fuel temperatures and the calculated graphite temperatures at thermocouple locations during the entire irradiation period.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Uncertainty Quantification and Sensitivity Analysis of Low-Dimensional Manifold via Co-Kurtosis PCA in Combustion Modeling

For multi-scale multi-physics applications e.g., the turbulent combustion code Pele, robust and accurate dimensionality reduction is crucial to solving problems at exascale and beyond. A recently developed technique, Co-Kurtosis based Principal Component Analysis (CoK-PCA) which leverages principal vectors of co-kurtosis, is a promising alternative to traditional PCA for complex chemical systems. To improve the effectiveness of this approach, we employ Artificial Neural Networks for reconstructing thermo-chemical scalars, species production rates, and overall heat release rates corresponding to the full state space. Our focus is on bolstering confidence in this deep learning based non-linear reconstruction through Uncertainty Quantification (UQ) and Sensitivity Analysis (SA). UQ involves quantifying uncertainties in inputs and outputs, while SA identifies influential inputs. One of the noteworthy challenges is the computational expense inherent in both endeavors. To address this, we employ the Monte Carlo methods to effectively quantify and propagate uncertainties in our reduced spaces while managing computational demands. Our research carries profound implications not only for the realm of combustion modeling but also for a broader audience in UQ. By showcasing the reliability and robustness of CoK-PCA in dimensionality reduction and deep learning predictions, we empower researchers and decision-makers to navigate complex combustion systems with greater confidence.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Extension of SCALE/Sampler’s sensitivity index for the assessment of cross section, fission yield, and decay data uncertainties

Accurate prediction of nuclide compositions and neutron and gamma sources and spectra for fresh and spent nuclear fuel through computational modeling and simulations is the basis for safeguards instruments design, optimization, and calibration, and for validation of the measured responses. The accuracy of these simulations can be significantly impacted by uncertainties in input parameters to the applied computer code. Input parameters are, for example, dimensions, material compositions, and temperatures of the model. Additionally, important but sometimes neglected input parameters for simulations of nuclear systems are the nuclear data that include nuclear reaction cross sections, fission product yields, and decay data. It has been shown that uncertainties of calculated results are dominated by uncertainties of these nuclear data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The inclusion of uncertainty in circularity transition modeling: A case study on wind turbine blade end-of-life management

The transition to a more circular economy (CE) is complex and hard to predict, including in sustainable energy technologies. Many sources of uncertainty make it challenging to model CE scenarios and their potential benefits. As an example, the high variability in costs and revenues of different recycling options makes future wind turbine blade recycling highly uncertain. To better understand this challenge, the circular economy, life cycle assessment and visualization (CELAVI) framework - a discrete event simulation and life cycle assessment framework - is modified to incorporate uncertainty analysis capabilities. Moreover, a 3-step procedure that covers different aspects of uncertainty in CE studies and includes a Monte-Carlo analysis is proposed. The procedure is tested in a case study on wind turbine blade recycling using CELAVI. Results highlight that grinding and landfilling costs are the most influential parameters for wind power circularity. The model's output coefficients of variation (when input parameter uncertainties are propagated) are between 92% and 384% depending on the indicator. The approach developed in this study may help researchers and decision-makers who study circularity prioritize their data collection effort. Finally, our method contributes to a mounting yet critical body of research: the measurement of uncertainty in circularity transitions.

17 WIND ENERGY↗

System Model Calculations for the Active Trenches of the Low-Level Burial Grounds, Hanford Site, Washington

Two lined trenches (Trench 31 and 34) located within the 200 West Low-Level Burial Ground (LLBG) area of the U.S. Department of Energy’s (DOE) Hanford Site are designated for permanent disposal of low-level radioactive waste (LLW) and mixed low-level radioactive waste (MLLW). In accordance with DOE O 435.1, Radioactive Waste Management, radioactive waste shall be managed and disposed in a manner that is protective of worker, public health and safety, and the environment. DOE O 435.1 requires a site-specific radiological performance assessment (PA) that includes calculations of potential releases and subsequent doses to members of the public for a period of 1,000 years after closure of a low-level waste (LLW) disposal facility. The purpose of this environmental calculation file (ECF) is to document the various dose calculations performed to support DOE’s LLBG PA. The dose assessments are performed to evaluate the potential exposure of an all-pathway representative person to radionuclide contaminants of potential concern (COPCs) that may be released from the LLBG Trenches 31 and 34 to the point of calculation (POC) located at the outer edge of a 100 m buffer zone surrounding the trench boundary. This ECF uses inputs from other ECFs and their associated model package reports (MPRs) supporting the LLBG PA. The five major objectives of this ECF are to present the results of the following: (1) Deterministic dose assessments for both groundwater and atmospheric exposure scenarios; (2) Radon-222 (Rn-222) flux emanating at the surface from the disposed wastes; (3) Uncertainty analyses of the groundwater pathway annual dose due to uncertainty in input parameters; (4) Sensitivity analyses of the input parameters that could potentially impact the fate and transport of the contaminants and doses; (5) Doses arising from inadvertent intruder exposure scenarios.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The AME 2020 atomic mass evaluation (I). Evaluation of input data, and adjustment procedures*

Abstract This is the first of two articles (Part I and Part II) that presents the results of the new atomic mass evaluation, AME2020. It includes complete information on the experimental input data that were used to derive the tables of recommended values which are given in Part II. This article describes the evaluation philosophy and procedures that were implemented in the selection of specific nuclear reaction, decay and mass-spectrometric data which were used in a least-squares fit adjustment in order to determine the recommended mass values and their uncertainties. All input data, including both the accepted and rejected ones, are tabulated and compared with the adjusted values obtained from the least-squares fit analysis. Differences with the previous AME2016 evaluation are discussed and specific examples are presented for several nuclides that may be of interest to AME users.

74 ATOMIC AND MOLECULAR PHYSICS↗