Uncertainty Quantification and Global Sensitivity Analysis Methods for Monte Carlo Radiation Transport Solvers
Explore the source record for details and available documents.
Clements, Kayla [Oregon State University]↗
SEARCH · Search NASA
Results for “Uncertainty Analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
NE-COST plug-in: Expanding ACCERT's Capabilities for Life-Cycle Cost Modeling
The Algorithm for the Capital Cost Estimation of Reactor Technologies (ACCERT) is a structured methodology and software tool designed to simplify and standardize cost estimation for nuclear reactor technologies [1]. By utilizing a relational database structure and modular cost estimation algorithms, ACCERT delivers a robust, flexible, and scalable framework for evaluating costs across various reactor types and configurations [2]. The recent integration of the NE-COST plugin further expands ACCERT’s scope by introducing detailed life-cycle cost modeling and probabilistic analysis of uncertainties. This addition enables users to evaluate costs across front-end processes such as uranium enrichment and fabrication, as well as back-end activities including waste disposal and geologic storage. Through Monte Carlo statistical cost simulations, the plugin provides probabilistic insights into cost ranges, offering critical decision-making support for stakeholders including reactor developers, policymakers, and researchers.
Zhou, Jia↗
RAVEN Introduction_Workshop Material
This is a presentation material, introducing RAVEN in general.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for Composite Analysis.
The purpose of this environmental calculation file (ECF) is to provide a summary of methodology, inputs, assumptions, and results of a Special Analysis (SA) titled “Method Development and Implementation for Characterizing Uncertainties in Tank Leak Volumes for the Updated Composite Analysis.” This SA is one of the three SAs conducted in Fiscal Year (FY) 2024 for the Composite Analysis (CA) for the Hanford Site (DOE/RL-2019-52, Composite Analysis for Low-Level Waste Disposal in the Hanford Site Central Plateau (FY 2020)), and it is performed following the Unreviewed Composite Analysis Question Evaluation procedure, UCAQ-24-01-E (UCAQ-24-01-E, Rev. 0).
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
A Rat Body Phantom for Radiation Analysis
To reduce the uncertainties associated with estimating the biological effects of ionizing radiation in tissue, researchers rely on laboratory experiments in which mono-energetic, single specie beams are applied to cell cultures, insects, and small animals. To estimate the radiation effects on astronauts in deep space or low Earth orbit, who are exposed to mixed field broad spectrum radiation, these experimental results are extrapolated and combined with other data to produce radiation quality factors, radiation weighting factors, and other risk related quantities for humans. One way to reduce the uncertainty associated with such extrapolations is to utilize analysis tools that are applicable to both laboratory and space environments. The use of physical and computational body phantoms to predict radiation exposure and its effects is well established and a wide range of human and non-human phantoms are in use today. In this paper, a computational rat phantom is presented, as well as a description of the process through which that phantom has been coupled to existing radiation analysis tools. Sample results are presented for two space radiation environments.
Qualls, Garry D.↗
Probabilistic Fatigue Damage Prognosis Using a Surrogate Model Trained Via 3D Finite Element Analysis
Utilizing inverse uncertainty quantification techniques, structural health monitoring can be integrated with damage progression models to form probabilistic predictions of a structure's remaining useful life. However, damage evolution in realistic structures is physically complex. Accurately representing this behavior requires high-fidelity models which are typically computationally prohibitive. In the present work, a high-fidelity finite element model is represented by a surrogate model, reducing computation times. The new approach is used with damage diagnosis data to form a probabilistic prediction of remaining useful life for a test specimen under mixed-mode conditions.
Leser, Patrick E.↗
Impact of environmental attributes on the uncertainty in MAIAC/MODIS AOD retrievals: A comparative analysis
This work examines the impact of different environmental attributes on the uncertainty in satellite-based Aerosol Optical Depth (AOD) retrieval against the benchmark Aerosol Robotic Network (AERONET) AOD measurements at 21 sites across North Africa, California and Germany, in the years 2007–2017. As a first step, we studied the effects of spatial averaging the Multi-Angle Implementation of Atmospheric Correction (MAIAC) AOD retrievals, and of temporal averaging the AERONET AOD around the satellite (Aqua) overpass, on the agreement between the two products. AERONET AOD averaging over a time-window of ±15 min around the satellite overpass and the 1 ×1 km2 spatial grid of MAIAC were found to provide the best AOD retrieval performance. Next, MAIAC AOD were stratified according to different co-measured environmental attributes (aerosol loading, dominant particle size, vegetation cover, and prevailing particle type) and analyzed against the AERONET AOD. The envelope of the expected retrieval error varied considerably among different environmental attributes categories, with more accurate AOD retrievals obtained over highly vegetated areas (i.e. less surface reflectance) than over arid areas. Moreover, the retrieval accuracy was found to be sensitive to the aerosol loading and particle size, with a large bias between the MAIAC and AERONET AOD during high aerosol loading of coarse particles. In addition, the retrieval accuracy of MAIAC AOD was found to depend on the aerosol type due to the aerosol model assumptions regarding their optical properties.
AOD RETRIEVAL↗
Variance Decomposition of MEDLI2 Reconstructed Heating Using Neural Networks
The Mars Entry, Descent, and Landing Instrumentation (MEDLI2) sensor suite collected data during entry of the Mars 2020 Perseverance rover into Mars’ atmosphere. This suite included a network of MEDLI2 Instrumented Sensor Plugs (MISPs). Each MISP was comprised of a cylinder made of Thermal Protection System (TPS) material with 1-3 embedded thermocouples (TCs), and it was flush mounted into the heatshield or backshell. Data from these in-depth TCs were used to reconstruct the aeroheating environment of the vehicle throughout entry. Surface heating was posed as an inverse problem, with the goal of estimating the surface heating by minimizing an objective function of the difference between MISP temperature measurements during flight and the temperature predictions derived from the Fully Implicit Ablation and Thermal response (FIAT) program. Given an aerothermal environment, FIAT calculates the material response and provides in-depth temperatures throughout the TPS material. To achieve the reverse, an internal tool called FIAT_Opt runs through multiple different environments until the output temperature at the TC depth closely matches the flight data. 95% confidence intervals on the reconstructed surface heating were obtained using Monte Carlo analysis, in which uncertainties in the thermocouple depth and the TPS material properties (e.g., density, thermal conductivity, heat capacity, emissivity) based on flight-lot material testing were included. A variance decomposition method using Sobol indices was employed to assess the sensitivity of the reconstructed peak heating to the TC placement and material property uncertainties. Variance decomposition was found to require tens of thousands of FIAT_Opt runs in order for the Sobol indices to converge. With a single FIAT_Opt run taking on the order of 40 minutes, the required number of computations would take months to complete, even if using multiple CPUs. To mitigate this problem, three machine learning models (ridge regression with cross-validation, random forest regression, and a deep neural network) were trained and tested using the 2000 Monte Carlo runs that were already completed. A subset of 1600 runs were used to train the model (i.e., training set), while the remaining 400 runs were used as the test set. The predictions from the deep neural network (DNN) on the test set showed nearly perfect agreement to the actual values computed with FIAT_Opt (R2 > 0.99). Using the DNN as a surrogate model, the variance decomposition using 50,000 runs was completed within minutes. The resulting Sobol indices showed that the reconstructed peak surface heating was most sensitive to the uncertainties in the thermal conductivity (ST = 0.37) and heat capacity (ST = 0.26). This method can be leveraged to provide requirements for material property measurements needed to improve the accuracy of surface heating prediction and ultimately lead to the reduction of design margins in the future. This presentation will include background on the MEDLI2 suite; the method used for inverse heating estimation; the way that material property uncertainties were accounted for using Monte Carlo analysis; a brief background on variance decomposition; the motivation for using machine learning in this context; how a neural network was trained on the data to enable variance decomposition in a fraction of the time; and the variance decomposition results for one of the MISPs.
Hannah Alpert↗
STAT7 v1.2 User Guide: The STAT7 Code for Statistical Propagation of Uncertainties in Steady-State Thermal Hydraulics Analysis of Plate-Fueled Reactors
The STAT7 software was developed to perform steady-state, single-phase thermal hydraulics analysis of plate-fueled reactors based on statistical propagation of uncertainties. Application of the software is for non-power research and test reactors, including conversion to low-enriched uranium fuel of U.S. High-Performance Research Reactors such as Massachusetts Institute of Technology Research Reactor. Since it can be necessary to repeat analysis during fuel reloading, STAT7 accommodates flexibility in analyzing many realistic aspects of reactor fuel management. STAT7 uses a Monte Carlo approach to model uncertainty in common fuel fabrication parameters and other key reactor operating parameters required for thermal hydraulics analyses of research and test reactors. These safety calculations are ultimately intended to protect against high fuel plate temperatures due to critical heat flux, or onset of flow instability. STAT7 supports water properties based on the IAPWS-IF97 functions (The International Association for the Properties of Water and Steam Industrial Formulation 1997 for the Thermodynamic Properties of Water and Steam) in addition to the fit functions. STAT7 predicts axial profiles of fuel, cladding, and coolant temperature along a lateral stripe that runs the full length of the fuel plate from the bottom to the top. STAT7 can simultaneously analyze all of the axial nodes of all of the fuel plates and all of the coolant channels for one latera stripe of a fuel element. Power splits are calculated for each axial node of each plate to determine how much of the power goes out each face of the plate. By running STAT7 multiple times, full core analysis can be performed by analyzing the margin to onset of nucleate boiling and onset of flow instability for each axial node of each stripe of each plate of each fuel element in the core.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Robustness Analysis of Integrated LPV-FDI Filters and LTI-FTC System for a Transport Aircraft
This paper proposes an analysis framework for robustness analysis of a nonlinear dynamics system that can be represented by a polynomial linear parameter varying (PLPV) system with constant bounded uncertainty. The proposed analysis framework contains three key tools: 1) a function substitution method which can convert a nonlinear system in polynomial form into a PLPV system, 2) a matrix-based linear fractional transformation (LFT) modeling approach, which can convert a PLPV system into an LFT system with the delta block that includes key uncertainty and scheduling parameters, 3) micro-analysis, which is a well known robust analysis tool for linear systems. The proposed analysis framework is applied to evaluating the performance of the LPV-fault detection and isolation (FDI) filters of the closed-loop system of a transport aircraft in the presence of unmodeled actuator dynamics and sensor gain uncertainty. The robustness analysis results are compared with nonlinear time simulations.
Khong, Thuan H.↗
Uncertainty Optimization Applied to the Monte Carlo Analysis of Planetary Entry Trajectories
Recently, strong evidence of liquid water under the surface of Mars and a meteorite that might contain ancient microbes have renewed interest in Mars exploration. With this renewed interest, NASA plans to send spacecraft to Mars approx. every 26 months. These future spacecraft will return higher-resolution images, make precision landings, engage in longer-ranging surface maneuvers, and even return Martian soil and rock samples to Earth. Future robotic missions and any human missions to Mars will require precise entries to ensure safe landings near science objective and pre-employed assets. Potential sources of water and other interesting geographic features are often located near hazards, such as within craters or along canyon walls. In order for more accurate landings to be made, spacecraft entering the Martian atmosphere need to use lift to actively control the entry. This active guidance results in much smaller landing footprints. Planning for these missions will depend heavily on Monte Carlo analysis. Monte Carlo trajectory simulations have been used with a high degree of success in recent planetary exploration missions. These analyses ascertain the impact of off-nominal conditions during a flight and account for uncertainty. Uncertainties generally stem from limitations in manufacturing tolerances, measurement capabilities, analysis accuracies, and environmental unknowns. Thousands of off-nominal trajectories are simulated by randomly dispersing uncertainty variables and collecting statistics on forecast variables. The dependability of Monte Carlo forecasts, however, is limited by the accuracy and completeness of the assumed uncertainties. This is because Monte Carlo analysis is a forward driven problem; beginning with the input uncertainties and proceeding to the forecasts outputs. It lacks a mechanism to affect or alter the uncertainties based on the forecast results. If the results are unacceptable, the current practice is to use an iterative, trial-and-error approach to reconcile discrepancies. Therefore, an improvement to the Monte Carlo analysis is needed that will allow the problem to be worked in reverse. In this way, the largest allowable dispersions that achieve the required mission objectives can be determined quantitatively.
Olds, John↗
Uncertainties in greenhouse gas emission factors: A comprehensive analysis of switchgrass‐based biofuel production
Abstract This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass‐based biofuel production in Michigan. Using three life cycle assessment (LCA) databases—US lifecycle inventory (USLCI) database, GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI. The convergence of results across our previous study, static calculations, and Monte Carlo simulations enhances the credibility of estimated GWI values. Static calculations, validated by Monte Carlo simulations, offer reasonable central tendencies, providing a robust foundation for policy considerations. However, the wider range observed in Monte Carlo simulations underscores the importance of potential variations and uncertainties in real‐world applications. Sensitivity analyses identify biofuel yield, GHG emissions of electricity, and soil organic carbon (SOC) change as pivotal parameters influencing GWI. Decreasing uncertainties in GWI may be achieved by making greater efforts to acquire more precise data on these parameters. Our study emphasizes the significance of considering diverse GHG factors and databases in GWI assessments and stresses the need for accurate electricity fuel mixes, crucial information for refining GWI assessments and informing strategies for sustainable biofuel production.
Kim, Seungdo↗
Reliability Analysis in the Presence of Aleatory Uncertainty
This paper proposes a method for modeling a system’s response using data. In contrast to approaches that identify a limit state function, we focus on the case in which not all uncertain parameters affecting the response are observable and the measured response is corrupted by noise. To this end, the system response is not characterized by a limit state function but instead by a Random Predictor Model (RPM) having a nonparametric structure. Consequently, the resulting failure probability is not a scalar but a random variable. This variable accounts for the aleatory contributions of the model-form uncertainty and the measurement noise into the response. Furthermore, we propose a framework that enables trading off the predicted range of failure probabilities resulting from such an analysis with a measure of risk. In this context, risk is the percentage of all predicted outcomes the analyst is willing to ignore. The reliability analysis of an aeroelastic structure subject to flutter is used to illustrate the ideas proposed.
Crespo, L. G.↗
Antarctic Sea Ice Thickness and Snow-to-Ice Conversion from Atmospheric Reanalysis and Passive Microwave Snow Depth
Passive microwave snow depth, ice concentration, and ice motion estimates are combined with snowfall from the European Centre for Medium Range Weather Forecasting (ECMWF) reanalysis (ERA-40) from 1979-200 1 to estimate the prevalence of snow-to-ice conversion (snow-ice formation) on level sea ice in the Antarctic for April-October. Snow ice is ubiquitous in all regions throughout the growth season. Calculated snow- ice thicknesses fall within the range of estimates from ice core analysis for most regions. However, uncertainties in both this analysis and in situ data limit the usefulness of snow depth and snow-ice production to evaluate the accuracy of ERA-40 snowfall. The East Antarctic is an exception, where calculated snow-ice production exceeds observed ice thickness over wide areas, suggesting that ERA-40 precipitation is too high there. Snow-ice thickness variability is strongly controlled not just by snow accumulation rates, but also by ice divergence. Surprisingly, snow-ice production is largely independent of snow depth, indicating that the latter may be a poor indicator of total snow accumulation. Using the presence of snow-ice formation as a proxy indicator for near-zero freeboard, we examine the possibility of estimating level ice thickness from satellite snow depths. A best estimate for the mean level ice thickness in September is 53 cm, comparing well with 51 cm from ship-based observations. The error is estimated to be 10-20 cm, which is similar to the observed interannual and regional variability. Nevertheless, this is comparable to expected errors for ice thickness determined by satellite altimeters. Improvement in satellite snow depth retrievals would benefit both of these methods.
Markus, Thorsten↗
Implementing Superresolution of Nonstationary Tides with Wavelets: An Introduction to CWT_Multi
Abstract Tides are often nonstationary due to nonastronomical influences. Investigating variable tidal properties implies a trade-off between separating adjacent frequencies (using long analysis windows) and resolving their time variations (short analysis windows). Previous continuous wavelet transform (CWT) tidal methods resolved tidal species. Here, we present CWT_Multi, a MATLAB code that 1) uses CWT linearity (via the “response coefficient method”) to implement superresolution, i.e., resolving tidal constituents beyond the Rayleigh criterion; 2) provides a Munk–Hasselmann constituent selection criterion appropriate for superresolution; and 3) introduces an objective, time-variable form of inference (“dynamic inference”) based on time-varying data properties. CWT_Multi resolves tidal species on time scales of days, and multiple constituents per species with fortnightly filters. It outputs astronomical phase lags and admittances, analyzes multiple records, and provides power spectra of the signal(s), residual(s), and reconstruction(s); confidence limits; and signal-to-noise ratios. Artificial data and water levels from the Lower Columbia River Estuary (LCRE) and San Francisco Bay Delta (SFBD) are used to test CWT_Multi and compare it to harmonic analysis programs NS_Tide and UTide. CWT_Multi provides superior reconstruction, detiding, dynamic analysis utility, and time resolution of constituents (but with broader confidence limits). Dynamic inference resolves closely spaced constituents (like K 1 , S 1 , and P 1 ) on fortnightly time scales, quantifying impacts of diel power peaking (with a 24-h period, like S 1 ) on water levels in the LCRE. CWT_Multi also helps quantify the impacts of high flows and a salt barrier closing on tidal properties in the SFBD. On the other hand, CWT_Multi does not excel at prediction, and results depend on analysis details, as for any method applied to nonstationary data. Significance Statement Ocean tides, especially in coastal and estuarine systems, are often nonstationary, in the sense that the mean and standard deviation of tidal properties vary over time, usually in response to some nontidal process. We introduce here a MATLAB code, CWT_Multi, that uses wavelet transforms to resolve both tidal species and constituents on time scales from a few days to months. Our code accommodates multiple scalar time series and has typical tidal analysis features like constituent selection and inference, plus two forms of uncertainty analyses. It is flexible, allowing the user to adapt analysis properties to diverse datasets. CWT_Multi is applicable to many problems involving time-variable tides, including sea level rise, compound flooding, sediment transport, and wetland habitat analyses. Application to vector data is a straightforward extension, but further development of our uncertainty analysis is merited. Because nonstationary tidal analysis is rapidly advancing, we also define the features of a “well-formed” analysis code.
Lobo, Matthew↗
Atmospheric moisture measurements - A microwave radiometer-radiosonde comparison
Measurements of the thermal emission of the sky at three frequencies (20.7, 22.2, and 31.4 GHz) with the NASA/Goddard Space Flight Center Crustal Dynamics Project MW Water Vapor Radiometer are reported. These measurements are compared with brightness temperatures inferred from measurements from VAISALA radiosonde packages launched every 3 hr during the experiment period. An error analysis for the radiosonde-inferred brightness temperatures is performed under the assumption of reasonable random uncertainties for the pressure, temperature, and humidity measurements and propagation of these uncertainties through the analysis algorithm. For the assumed uncertainties, the dominant contribution to the total uncertainty comes from the temperature measurement (66-88 percent), whereas the relative humidity measurement contributes only 2-8 percent, except in the vicinity of the water vapor line, where the contribution is 10-20 percent.
England, Martin N.↗
Development Strategies for Uncertainty Quantification to Enable Aircraft Certification by Analysis
Aircraft Certification by Analysis (CbA) is a broad term that describes the process by which engineering analysis tools are used to supplement flight testing to demonstrate compliance with regulatory requirements. For each requirement that is to be met through this process, the analysis tools must be sufficiently accurate to ensure that an equivalent level of safety is obtained as if the aircraft to be certified had been flight tested for the requirement. In recent decades, the ability of analysis tools to accurately predict aircraft performance has improved dramatically, leading to increasing interest and limited early adoption of Certification by Analysis across the aerospace industry. However, rigorously demonstrating the credibility of analysis tools remains a challenge for many types of certification requirements, yet is necessary for widespread adoption of CbA approaches in the future. The field of uncertainty quantification is well-suited to address this problem, but will require substantial advances in order to achieve the ambitious industry goals for Certification by Analysis. The objective of this position paper is to highlight gaps in the current technical and programmatic state of uncertainty quantification. Four main categories – Mindset & Awareness, Tools & Capabilities, Data and Benchmarks for V&V, and Applied Research & Established Processes – will be introduced. Each of these categories contains several shortcomings and impediments which, if overcome, will enable more widespread possibilities for Certification by Analysis in the 2040-2050 timeframe.
Uncertainty Quantification↗
Characterizing Interaction Uncertainty in Human-Machine Teams
With the increasing use and adoption of artificial intelligence (AI), the reliability of modern data systems will be driven by a tighter teaming between human experts and intelligent machine teammates. As in the case of human-human teams, the success of human-machine teams will also rely on clear communication about mutual goals and actions. In this paper, we combine related literature from cognitive psychology, human-machine teaming, uncertainty in data analysis, and multi-agent systems to propose a new form of uncertainty: interaction uncertainty for characterizing bidirectional communication in human-machine teams. We map the causes and effects of interaction uncertainty and outline potential ways to mitigate uncertainty for mutual trust in a high-consequence real-world scenario.
uncertainty, data analytics, interaction, trust, h↗