Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Quantification and Sensitivity Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Interlaboratory Study of Digital Volume Correlation Error Due to X-Ray Computed Tomography Equipment and Scan Parameters: an Update from the DVC Challenge

Background: The quality of Digital Volume Correlation (DVC) full-field displacement measurements depends directly on the characteristics of the X-ray Computed Tomography (XCT) equipment, and scan procedures used to acquire the tomographic images. Objective: In this work, we seek to experimentally study the effects of XCT equipment and tomographic scan procedures on the quality of these images for DVC analysis, and to survey the level of DVC error that may be achieved using standard XCT operating procedures. Methods: Six participants in an interlaboratory study acquired high-quality XCT scans of a syntactic foam before and after rigid body motion. The resulting images were correlated using commercial DVC software to quantify error sources due to random image noise, reconstruction artifacts, as well as systematic spatial or temporal distortion. Results: In the absence of rigid body motion, the standard deviation of the displacement measurements ranged from 0.012 to 0.043 voxels using a moderate subvolume size, indicating that subvoxel measurement resolution could readily be achieved with a variety of XCT equipment and scan recipes. Comparison of consecutive scans without rigid body motion showed transient dilatational displacement gradients due to self-heating of the X-ray source and/or thermal expansion of the foam. Evaluation of the scans after rigid body motion showed significant, machine-specific spatial distortion in the displacement fields of up to 0.5 voxels; new approaches to remove this error need to be developed. Conclusions: Analysis of the scan protocols used in the interlaboratory study, as well as a complementary parametric sensitivity study, showed that the DVC error was strongly influenced by the XCT equipment, but could be mitigated by adjusting the total scan duration.

47 OTHER INSTRUMENTATION↗

Interpretable Data-Driven Probabilistic Power System Load Margin Assessment with Uncertain Renewable Energy and Loads

The increasing uncertainties caused by the high-penetration of stochastic renewable generation resources poses a significant threat to the power system voltage stability. To address this issue, this paper proposes a probabilistic deep kernel learning enabled surrogate model to extract the hidden relationship between uncertain sources, i.e., wind power and loads, and load margin for probabilistic load margin assessment (PLMA). Unlike other deep learning approaches, a kernel SHAP provides the sensitivity analysis as well as interpretability of the inputs to outputs influences. This allows identifying the critical factors that affect load margin so that corrective control can be initiated for stability enhancement. Numerical results carried out on the IEEE 118-bus power system demonstrate the accuracy and efficiency of the proposed data-driven PLMA scheme.

deep kernel learning↗

Uncertainty Quantification in High-Low Dynamic System Coupling using RAVEN and TRANSFORM

This work demonstrates new functionality and applications stemming from the development of high-fidelity to low-fidelity (high-low) coupling for system simulations and to further explore the capabilities of the Risk Analysis Virtual Environment (RAVEN) in the performance of uncertainty quantification in this kind of high-low coupled system models. The work builds from previous work on high-low coupling that utilized COBRA-TF (CTF), the high-fidelity subchannel analysis code, with a low fidelity model built in ORNL’s TRANSFORM, the system analysis code, utilizing the Functional Mock-Up Interface (FMI). Steady-state and transient analysis examples using the high/low coupled models generated from CTF and TRANSFORM/FMI are investigated. The workflows for both steady-state and transient coupled simulations are described. A steady-state parameter sweep and uncertainty analysis of the primary flow rates and reactor power are demonstrated. Likewise, a transient pump trip and power ramp sensitivity studies are also demonstrated. This work elucidates some of the potential benefits and future needs of using RAVEN for high/low system coupling analysis of energy systems. It also shows some of the difficulties that can be encountered in coupling system simulations.

Williams, Wesley↗

Leveraging Multiple Raman Excitation Wavelength Systems for Process Monitoring of Nuclear Waste Streams

Processing nuclear waste from sites such as Hanford is a significant environmental cleanup need while being a significant logistical challenge. Integration of process monitoring tools, that can provide in situ and real-time feedback about the process, can significantly alleviate needs to collect grab samples for process control and product characterization. Raman spectroscopy paired with chemometric analysis is one process monitoring tool that can provide chemical composition information on a large number of chemical targets in nuclear waste streams. However, methods to improve limits of detection as well as drop uncertainty in quantification are needed. Optimizing instrument specifications can achieve this, here this is demonstrated by comparing limits of detection for key analytes when using Raman systems with 671 nm, 532 nm, and 405 nm excitation wavelengths. Generally, limits of detection decease (allowing the measurement of lower salt concentrations) with decreasing wavelength. Similarly, data collection times and averaging were optimized. Finally, multiple chemometric modeling approaches were leveraged, including multiblock methods that combined data from all three Raman systems to simultaneously quantify targets with improved sensitivity.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Uncertainty Quantification Methodology for Sonic Boom Loudness of a Low-Boom Supersonic Concept

This paper presents a comprehensive analysis of uncertainty quantification for sonic boom loudness metrics associated with the X-59 aircraft during its acoustic validation phase. The study focuses on employing advanced methodologies to characterize uncertainties in key sonic boom parameters predicted from a database derived from a computational fluid dynamics (CFD) solver. These methodologies include creating a polynomial chaos expansion (PCE) surrogate model, which is then used to run a Monte Carlo analysis to obtain 95% uncertainty intervals for sonic boom loudness parameters across the full carpet. Atmospheric uncertainties are rigorously considered, leveraging weather models based on historical data near Edwards Air Force Base to simulate potential flight conditions. The findings include preliminary uncertainty results for the full carpet during the validation phase of the Quesst mission. Additionally, a sensitivity study reveals that the primary sources of uncertainty are humidity and cruise weight.

Laura M. White↗

Uncertainty Quantification of Turbulence Model Closure Coefficients for Transonic Wall-Bounded Flows

The goal of this work was to quantify the uncertainty and sensitivity of commonly used turbulence models in Reynolds-Averaged Navier-Stokes codes due to uncertainty in the values of closure coefficients for transonic, wall-bounded flows and to rank the contribution of each coefficient to uncertainty in various output flow quantities of interest. Specifically, uncertainty quantification of turbulence model closure coefficients was performed for transonic flow over an axisymmetric bump at zero degrees angle of attack and the RAE 2822 transonic airfoil at a lift coefficient of 0.744. Three turbulence models were considered: the Spalart-Allmaras Model, Wilcox (2006) k-w Model, and the Menter Shear-Stress Trans- port Model. The FUN3D code developed by NASA Langley Research Center was used as the flow solver. The uncertainty quantification analysis employed stochastic expansions based on non-intrusive polynomial chaos as an efficient means of uncertainty propagation. Several integrated and point-quantities are considered as uncertain outputs for both CFD problems. All closure coefficients were treated as epistemic uncertain variables represented with intervals. Sobol indices were used to rank the relative contributions of each closure coefficient to the total uncertainty in the output quantities of interest. This study identified a number of closure coefficients for each turbulence model for which more information will reduce the amount of uncertainty in the output significantly for transonic, wall-bounded flows.

Schaefer, John↗

Credible Computations: Standard and Uncertainty

The discipline of computational fluid dynamics (CFD) is at a crossroad. Most of the significant advances related to computational methods have taken place. The emphasis is now shifting from methods to results. Significant efforts are made in applying CFD to solve design problems. The value of CFD results in design depends on the credibility of computed results for the intended use. The process of establishing credibility requires a standard so that there is a consistency and uniformity in this process and in the interpretation of its outcome. The key element for establishing the credibility is the quantification of uncertainty. This paper presents salient features of a proposed standard and a procedure for determining the uncertainty. A customer of CFD products - computer codes and computed results - expects the following: A computer code in terms of its logic, numerics, and fluid dynamics and the results generated by this code are in compliance with specified requirements. This expectation is fulfilling by verification and validation of these requirements. The verification process assesses whether the problem is solved correctly and the validation process determines whether the right problem is solved. Standards for these processes are recommended. There is always some uncertainty, even if one uses validated models and verified computed results. The value of this uncertainty is important in the design process. This value is obtained by conducting a sensitivity-uncertainty analysis. Sensitivity analysis is generally defined as the procedure for determining the sensitivities of output parameters to input parameters. This analysis is a necessary step in the uncertainty analysis, and the results of this analysis highlight which computed quantities and integrated quantities in computations need to be determined accurately and which quantities do not require such attention. Uncertainty analysis is generally defined as the analysis of the effect of the uncertainties involved in all stages of a process on the final responses. There are two approaches for conducting the uncertainty analysis: experimental and computational. These analyses and approaches are briefly described.

Mehta, Unmeel B.↗

Probabilistic Material Strength Degradation Model for Inconel 718 Components Subjected to High Temperature, Mechanical Fatigue, Creep and Thermal Fatigue Effects

This thesis presents the on-going development of methodology for a probabilistic material strength degradation model. The probabilistic model, in the form of a postulated randomized multifactor equation, provides for quantification of uncertainty in the lifetime material strength of aerospace propulsion system components subjected to a number of diverse random effects. This model is embodied in the computer program entitled PROMISS, which can include up to eighteen different effects. Presently, the model includes four effects that typically reduce lifetime strength: high temperature, mechanical fatigue, creep, and thermal fatigue. Statistical analysis was conducted on experimental Inconel 718 data obtained from the open literature. This analysis provided regression parameters for use as the model's empirical material constants, thus calibrating the model specifically for Inconel 718. Model calibration was carried out for four variables, namely, high temperature, mechanical fatigue, creep, and thermal fatigue. Methodology to estimate standard deviations of these material constants for input into the probabilistic material strength model was developed. Using the current version of PROMISS, entitled PROMISS93, a sensitivity study for the combined effects of mechanical fatigue, creep, and thermal fatigue was performed. Results, in the form of cumulative distribution functions, illustrated the sensitivity of lifetime strength to any current value of an effect. In addition, verification studies comparing a combination of mechanical fatigue and high temperature effects by model to the combination by experiment were conducted. Thus, for Inconel 718, the basic model assumption of independence between effects was evaluated. Results from this limited verification study strongly supported this assumption.

Bast, Callie Corinne Scheidt↗

Improving Accuracy of Structural Dynamic Modification with Augmented Residual Vectors

It is often important to perform sensitivity analysis to determine how a structural model will be impacted by design changes. Often, the structural analysts will manually make changes to the finite element model (FEM) to determine the effects. But when dealing with a large FEM with millions of degrees of freedom these manual changes can be cumbersome and calculation of the effects can computationally expensive. Therefore, it is desirable to determine the effects of model changes through approximation methods. One common technique is to determine the analytical sensitivity of the FEM model with respect to the given change. These analytical sensitivities are valid when small changes are made to the structural model, but invalid if large changes need to be assessed. Another approach is to use Structural Dynamic Modification (SDM) to create a surrogate model to analyze model changes. SDM is a widely-used sensitivity method and is used in applications of model updating, uncertainty quantification, and model design studies. SMD is valid for moderate (10-20 percent) changes in the structural model, but model approximations are often needed for large parameter changes (greater than 20 percent). Structural Dynamic Modification can be improved by using residual vectors to augment the surrogate model formulation from SDM. Adding the residual modes increases the fidelity of the surrogate model while keeping the computational cost low. This paper discusses the application and limitations of the augmented residual modes method to two structures: the Integrated Spacecraft and Payload Element (ISPE) of the Space Launch System (SLS) and the full SLS as it is configured during its Integrated Modal Test (IMT).

Stewart, Eric C.↗

Real Options Analysis for Valuation of Climate Adaptation Pathways With Application to Transit Infrastructure

Climate change and sea level rise (SLR) are expected to increase the frequency and intensity of coastal flood events, posing risks to coastal communities and infrastructure. While regional climate adaptation investments can provide substantive flood protection, existing plans often neglect uncertainty in future climate conditions and adaptation performance, consequently neglecting the option value of flexibly implementing proposed projects. Addressing this gap, we develop and employ a generalizable real options analysis (ROA) valuation framework that considers how uncertainty in adaptation project costs, SLR, flood severity, and flood losses inform the full range of adaptation performance outcomes. We further propose and apply a novel, computationally efficient flood loss sampling algorithm to estimate the consequences of randomly arriving coastal flood events. We apply this ROA framework to assess the option value of flexibly timing adaptation investments over time, investigating an adaptation pathway proposed by the City of Boston from the perspective of the regional transit system manager. Our results suggest that flexible implementation can provide significant option value in the near-to mid-term(>30 years), with highest option values under low-probability, high consequence scenarios. Our results also suggest adaptation pathway performance in the latter half of the 21stcenturyis most sensitive to uncertainty in sea level rise, flood loss estimates, and flood frequency, underscoring the importance of uncertainty quantification in the long-term valuation of adaptation investments.

Michael V. Martello↗

Probabilistic material strength degradation model for Inconel 718 components subjected to high temperature, high-cycle and low-cycle mechanical fatigue, creep and thermal fatigue effects

This report presents the results of both the fifth and sixth year effort of a research program conducted for NASA-LeRC by The University of Texas at San Antonio (UTSA). The research included on-going development of methodology for a probabilistic material strength degradation model. The probabilistic model, in the form of a postulated randomized multifactor equation, provides for quantification of uncertainty in the lifetime material strength of aerospace propulsion system components subjected to a number of diverse random effects. This model is embodied in the computer program entitled PROMISS, which can include up to eighteen different effects. Presently, the model includes five effects that typically reduce lifetime strength: high temperature, high-cycle mechanical fatigue, low-cycle mechanical fatigue, creep and thermal fatigue. Statistical analysis was conducted on experimental Inconel 718 data obtained from the open literature. This analysis provided regression parameters for use as the model's empirical material constants, thus calibrating the model specifically for Inconel 718. Model calibration was carried out for five variables, namely, high temperature, high-cycle and low-cycle mechanical fatigue, creep and thermal fatigue. Methodology to estimate standard deviations of these material constants for input into the probabilistic material strength model was developed. Using an updated version of PROMISS, entitled PROMISS93, a sensitivity study for the combined effects of high-cycle mechanical fatigue, creep and thermal fatigue was performed. Then using the current version of PROMISS, entitled PROMISS94, a second sensitivity study including the effect of low-cycle mechanical fatigue, as well as, the three previous effects was performed. Results, in the form of cumulative distribution functions, illustrated the sensitivity of lifetime strength to any current value of an effect. In addition, verification studies comparing a combination of high-cycle mechanical fatigue and high temperature effects by model to the combination by experiment were conducted. Thus, for Inconel 718, the basic model assumption of independence between effects was evaluated. Results from this limited verification study strongly supported this assumption.

Bast, Callie C.↗

Reliability Quantification of the Flexure: A Critical Stirling Convertor Component

Uncertainties in the manufacturing, fabrication process, material behavior, loads, and boundary conditions results in the variation of the stresses and strains induced in the flexures and its fatigue life. Past experience and the test data at material coupon levels revealed a significant amount of scatter of the fatigue life. Owing to these facts, the design of the flexure, using conventional approaches based on safety factor or traditional reliability based on similar equipment considerations does not provide a direct measure of reliability. Additionally, it may not be feasible to run actual long term fatigue tests due to cost and time constraints. Therefore it is difficult to ascertain material fatigue strength limit. The objective of the paper is to present a methodology and quantified results of numerical simulation for the reliability of flexures used in the Stirling convertor for their structural performance. The proposed approach is based on application of finite element analysis method in combination with the random fatigue limit model, which includes uncertainties in material fatigue life. Additionally, sensitivity of fatigue life reliability to the design variables is quantified and its use to develop guidelines to improve design, manufacturing, quality control and inspection design process is described.

Shah, Ashwin R.↗

NASA's Unsteady Pressure-Sensitive Paint Research and Operational Capability Developments

In the last three years, several advancements have been made to produce a new state-of-the-art capability in the field of Aerosciences. NASA’s Aerosciences Evaluations and Test Capabilities (AETC) Portfolio Office has funded a multi-year project to produce the unsteady Pressure-Sensitive Paint (uPSP) technology as an operational capability in key ground test facilities at NASA. The research and development has primarily been conducted at NASA Ames Research Center’s (ARC) Unitary Plan Wind Tunnel (UPWT) 11-by 11-ft Transonic Wind Tunnel (TWT). The NASA ARC UPWT is one of the ground test facilities under NASA AETC’s Portfolio Office. AETC’s goals are to provide the tools to deliver the technology innovations and breakthroughs necessary to address increasingly complex research and development challenges. AETC’s integrated approach will consider the complimentary high-end compute capabilities necessary to advance analysis in conjunction with ground experimental capabilities. The uPSP Capability Challenge Project is a demonstration of several different technologies: 1) the unsteady Pressure-Sensitive Paint (uPSP) technology, and 2) Project: Red Rover, establishing a secure, reliable, fast connection between experimental and computation facilities, leveraging NASA’s computational resources within the High-End Compute Capability (HECC) Project for processing, storing, and sharing data efficiently. This project demonstrates the technical diversity and technical inclusion need to advance the field of Aerosciences. The approach to combine subject matter experts in experimental methods, optical methods, production wind tunnel testing, network engineering, high-end computing, signal processing, grid generation, and visualization while establishing the required infrastructure for subject matter experts to have access to the data while the wind tunnel test is being conducted. The most recent advancements for the uPSP technology have focused on three key areas: development of data products, robust processing pipeline, operational efficiencies and uncertainty quantification.

buffet↗

Conditional diffusion machine-learning framework for mapping valence electron distribution from convergent beam electron diffraction

Quantitative convergent beam electron diffraction (CBED) enables determination of aspherical valence electron distributions through refinement of low-order structure factors, which are highly sensitive to chemical bonding and charge density variations. However, conventional quantitative CBED (QCBED) requires solving a highly nonlinear inverse problem with many coupled parameters, and computationally intensive dynamical diffraction calculations, making it time-consuming and difficult to apply to complex systems. More broadly, reconstructing charge density and orbital electron distribution from diffraction data has long been a central challenge in both x-ray and electron crystallography. Here, in this study, we introduce an artificial-intelligence (AI)-based framework that replaces traditional refinement with a data-driven inverse solver. Using a large synthetic CBED dataset generated by Bloch-wave simulations, we train a conditional diffusion model to directly infer crystal structural parameters and multipole density formalism parameters, and hence valence electron distributions, from CBED patterns alone. By learning from forward simulations across realistic parameter space, the model effectively solves the inverse problem. Compared with direct regression approaches, the diffusion-based framework provides posterior parameter distributions for rigorous uncertainty quantification while preserving quantitative fidelity and reducing analysis time by orders of magnitude. By eliminating the need for external single-crystal x-ray diffraction data and complex nonlinear refinement, this approach enables practical, high-throughput, and in situ quantitative CBED, enabling real-time mapping of valence electron distributions and their correlation with functional responses in quantum and energy materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Tutorial on Bayesian analysis of linear shock compression data

Gas gun and other shock compression experiments often produce shock wave velocity measurements that are linearly associated with particle velocity. Traditionally, this empirical relationship is quantified with a single Hugoniot curve that is estimated using least squares regression. However, for downstream modeling and simulation tasks, it is often more useful to have multiple Hugoniot curves in the pressure–volume plane that are consistent with the data. We employ Bayesian uncertainty quantification methods as a framework for propagating measurement uncertainty through to model parameters and predictions. Specifically, this Tutorial shows how to sample multiple Hugoniot curves in the pressure–volume plane that are consistent with the shock wave-particle velocity measurements in a two-step Bayesian approach. First, we obtain an analytical expression for the posterior distribution of the linear model parameters using Bayesian linear regression. Second, we propagate samples from the posterior distribution through the Rankine–Hugoniot equations to yield Hugoniot curves in the pressure–volume plane. The procedure is demonstrated with publicly available data on argon, copper, and nickel, and compared against bootstrapping and linear regression. The Bayesian procedure is shown to be interpretable, computationally inexpensive, and less sensitive than an alternative bootstrapping approach to the removal of the point in the copper dataset that has the largest particle velocity. As a Tutorial on Bayesian methodology for the shock compression community, we provide several derivations and explanations that make this paper self-contained, and make all code and data available at github.com/llnl/BALSCD.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Gamma Equipment System Requirements by Application

This document outlines a set of requirements for gamma sensitive systems applied to three different applications: (1) homeland security (search and identification); (2) in-situ quantification; and (3) quantification in a material characterization laboratory. These three applications represent a range of activities that a country might use for locating, identifying, and quantifying radioactive material. These applications require increasing accuracy and system advancements, and skill levels. This document considers systems with various detector types and are characterized by their energy resolution: (1) low resolution (e.g., NaI(Tl) scintillation) and (2) higher resolution (e.g., high-purity germanium [HPGe] solid state) systems. The higher resolution systems also include cadmium zinc telluride (CZT) and only mechanically cooled HPGe systems are considered. These detectors and their associated acquisition hardware and analysis software afford a broad range of capabilities with corresponding ranges of complexity, maintainability, and cost. Ultimately, the equipment must meet the measurement goals of the application, and compliance with a given list of hardware specifications does not in itself guarantee meeting those goals. Examples of typical performance objectives for international safeguards applications are documented in International Target Values 2010 for Measurement Uncertainties in Safeguarding Nuclear Materials (IAEA, STR-368, November 2010). Selection of the detector type best suited to a specific application is often a compromise between “state of the art” or best available option and what is practical.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Numerical Investigation of Observational Flux Partitioning Methods for Water Vapor and Carbon Dioxide

Abstract While yearly budgets of CO 2 flux (F c ) and evapotranspiration (ET) above vegetation can be readily obtained from eddy‐covariance measurements, the separate quantification of their soil (respiration and evaporation) and canopy (photosynthesis and transpiration) components remains an elusive yet critical research objective. In this work, we investigate four methods to partition observed total fluxes into soil and plant sources: two new and two existing approaches that are based solely on analysis of conventional high frequency eddy‐covariance (EC) data. The physical validity of the assumptions of all four methods, as well as their performance under different scenarios, are tested with the aid of large‐eddy simulations, which are used to replicate eddy‐covariance field experiments. Our results indicate that canopies with large, exposed soil patches increase the mixing and correlation of scalars; this negatively impacts the performance of the partitioning methods, all of which require some degree of uncorrelatedness between CO 2 and water vapor. In addition, best performances for all partitioning methods were found when all four flux components are non‐negligible, and measurements are collected close to the canopy top. Methods relying on the water‐use efficiency (W) perform better whenWis known a priori, but are shown to be very sensitive to uncertainties in this input variable especially when canopy fluxes dominate. We conclude by showing how the correlation coefficient between CO 2 and water vapor can be used to infer the reliability of differentWparameterizations.

Environmental Sciences & Ecology↗

Deep Learning and Likelihood Approaches for Viral Phylogeography Converge on the Same Answers Whether the Inference Model Is Right or Wrong

Abstract Analysis of phylogenetic trees has become an essential tool in epidemiology. Likelihood-based methods fit models to phylogenies to draw inferences about the phylodynamics and history of viral transmission. However, these methods are often computationally expensive, which limits the complexity and realism of phylodynamic models and makes them ill-suited for informing policy decisions in real-time during rapidly developing outbreaks. Likelihood-free methods using deep learning are pushing the boundaries of inference beyond these constraints. In this paper, we extend, compare, and contrast a recently developed deep learning method for likelihood-free inference from trees. We trained multiple deep neural networks using phylogenies from simulated outbreaks that spread among 5 locations and found they achieve close to the same levels of accuracy as Bayesian inference under the true simulation model. We compared robustness to model misspecification of a trained neural network to that of a Bayesian method. We found that both models had comparable performance, converging on similar biases. We also implemented a method of uncertainty quantification called conformalized quantile regression that we demonstrate has similar patterns of sensitivity to model misspecification as Bayesian highest posterior density (HPD) and greatly overlap with HPDs, but have lower precision (more conservative). Finally, we trained and tested a neural network against phylogeographic data from a recent study of the SARS-Cov-2 pandemic in Europe and obtained similar estimates of region-specific epidemiological parameters and the location of the common ancestor in Europe. Along with being as accurate and robust as likelihood-based methods, our trained neural networks are on average over 3 orders of magnitude faster after training. Our results support the notion that neural networks can be trained with simulated data to accurately mimic the good and bad statistical properties of the likelihood functions of generative phylogenetic models.

Evolutionary Biology↗