Search NASA⌕ Search

SEARCH · Search NASA

Results for “Global sensitivity analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Evaluation of multiple reduced-order models to enhance confidence in global sensitivity analyses

Variance-based global sensitivity analysis (e.g., the Sobol' sensitivity index) can be used to identify the important parameters over the entire parameter space. However, one often cannot afford the computational costs of sampling-based approaches in combination with expensive high-fidelity forward models. Reduced-order models (ROM) can substantially accelerate calculation of these sensitivities. However, it is usually difficult to determine what type of ROM should be used and how accurately the ROM represents the high-fidelity model (HFM) results. Here in this paper, we propose to concurrently use multiple ROMs as a way to assess the robustness of the model-reduction method. Two sets of HFM simulations are needed, one set for building ROMs and the other for validating ROMs. Our goal is to keep the total number of HFM simulations to a minimum. Ideally some of the HFM simulations in the first set can be shared by different ROMs. Based on validation results, the ROMs can be combined with different schemes. We demonstrate that we can achieve the goal by using four different ROMs and still considerably save computational time compared to using traditional HFM simulation for calculating sensitivity indices. We apply the approach to an example problem of a large-scale geological carbon dioxide storage system, in which the objective is to calculate a sensitivity index to identify important parameters. For this problem, the locally best ROM provides better estimates than the weighted average from all ROMs.

54 ENVIRONMENTAL SCIENCES↗

Variance-Based Sensitivity Analysis to Support Simulation-Based Design Under Uncertainty

Sensitivity analysis plays a critical role in quantifying uncertainty in the design of engineering systems. A variance-based global sensitivity analysis is often used to rank the importance of input factors, based on their contribution to the variance of the output quantity of interest. However, this analysis assumes that all input variability can be reduced to zero, which is typically not the case in a design setting. Distributional sensitivity analysis (DSA) instead treats the uncertainty reduction in the inputs as a random variable, and defines a variance-based sensitivity index function that characterizes the relative contribution to the output variance as a function of the amount of uncertainty reduction. This paper develops a computationally efficient implementation for the DSA formulation and extends it to include distributions commonly used in engineering design under uncertainty. Application of the DSA method to the conceptual design of a commercial jetliner demonstrates how the sensitivity analysis provides valuable information to designers and decision-makers on where and how to target uncertainty reduction efforts.

42 ENGINEERING↗

Numerical modeling and sensitivity analysis of seawater intrusion in a dual-permeability coastal karst aquifer with conduit networks

Long-distance seawater intrusion has been widely observed through the subsurface conduit system in coastal karst aquifers as a source of groundwater contaminant. In this study, seawater intrusion in a dual-permeability karst aquifer with conduit networks is studied by the two-dimensional density-dependent flow and transport SEAWAT model. Local and global sensitivity analyses are used to evaluate the impacts of boundary conditions and hydrological characteristics on modeling seawater intrusion in a karst aquifer, including hydraulic conductivity, effective porosity, specific storage, and dispersivity of the conduit network and of the porous medium. The local sensitivity analysis evaluates the parameters' sensitivities for modeling seawater intrusion, specifically in the Woodville Karst Plain (WKP). A more comprehensive interpretation of parameter sensitivities, including the nonlinear relationship between simulations and parameters, and/or parameter interactions, is addressed in the global sensitivity analysis. The conduit parameters and boundary conditions are important to the simulations in the porous medium because of the dynamical exchanges between the two systems. The sensitivity study indicates that salinity and head simulations in the karst features, such as the conduit system and submarine springs, are critical for understanding seawater intrusion in a coastal karst aquifer. The evaluation of hydraulic conductivity sensitivity in the continuum SEAWAT model may be biased since the conduit flow velocity is not accurately calculated by Darcy's equation as a function of head difference and hydraulic conductivity. In addition, dispersivity is no longer an important parameter in an advection-dominated karst aquifer with a conduit system, compared to the sensitivity results in a porous medium aquifer. In the end, the extents of seawater intrusion are quantitatively evaluated and measured under different scenarios with the variabilities of important parameters identified from sensitivity results, including salinity at the submarine spring with rainfall recharge, sea level rise, and a longer simulation time under an extended low rainfall period.

58 GEOSCIENCES↗

Global, seasonal cloud variations from satellite radiance measurements. I - Sensitivity of analysis

Global, daily, visible and IR radiance measurements from the NOAA-5 Scanning Radiometer (SR) are analyzed for the months of January, April, July and October, 1977 to infer cloud and surface radiative properties. In this paper, the data and analysis method are described. A unique feature of the method is that it utilizes radiative transfer models that simulate the SR measurements using explicit parameters representing the properties of the surface, atmosphere, and clouds. The accuracy of all the results depends primarily on the proper separation of the total radiance distribution into those parts representing clear and cloudy scenes.

Rossow, William B.↗

A geostatistics-informed hierarchical sensitivity analysis method for complex groundwater flow and transport modeling

Sensitivity analysis is an important tool for development and improvement of mathematical models, especially for complex systems with a high dimension of spatially correlated parameters. Variance-based global sensitivity analysis has gained popularity because it can quantify the relative contribution of uncertainty from different sources. However, its computational cost increases dramatically with the complexity of the considered model and the dimension of model parameters. As such, in this study, we developed a new sensitivity analysis method that integrates the concept of variance-based method with a hierarchical uncertainty quantification framework. Different uncertain inputs are grouped and organized into a multilayer framework based on their characteristics and dependency relationships to reduce the dimensionality of the sensitivity analysis. A set of new sensitivity indices are defined for the grouped inputs using the variance decomposition method. Using this methodology, we identified the most important uncertainty source for a dynamic groundwater flow and solute transport model at the Department of Energy (DOE) Hanford site. The results indicate that boundary conditions and permeability field contribute the most uncertainty to the simulated head field and tracer plume, respectively. The relative contribution from each source varied spatially and temporally. By using a geostatistical approach to reduce the number of realizations needed for the sensitivity analysis, the computational cost of implementing the developed method was reduced to a practically manageable level. The developed sensitivity analysis method is generally applicable to a wide range of hydrologic and environmental problems that deal with high-dimensional spatially distributed input variables.

58 GEOSCIENCES↗

Ignoring correlation in uncertainty and sensitivity analysis in life cycle assessment: what is the risk?

Life cycle assessment (LCA) is an established tool to quantify the environmental impact of a product. A good assessment of uncertainty is important for making well-informed decisions in comparative LCA, as well as for correctly prioritising data collection efforts. Under- or overestimation of output uncertainty (e.g. output variance) will lead to incorrect decisions in such matters. The presence of correlations between input parameters during uncertainty propagation, can increase or decrease the the output variance. However, most LCA studies that include uncertainty analysis, ignore correlations between input parameters during uncertainty propagation, which may lead to incorrect conclusions. Two approaches to include correlations between input parameters during uncertainty propagation and global sensitivity analysis were studied: an analytical approach and a sampling approach. The use of both approaches is illustrated for an artificial case study of electricity production. Results demonstrate that both approaches yield approximately the same output variance and sensitivity indices for this specific case study. Furthermore, we demonstrate that the analytical approach can be used to quantify the risk of ignoring correlations between input parameters during uncertainty propagation in LCA. We demonstrate that: (1) we can predict if including correlations among input parameters in uncertainty propagation will increase or decrease output variance; (2) we can quantify the risk of ignoring correlations on the output variance and the global sensitivity indices. Moreover, this procedure requires only little data. - Highlights: • Ignoring correlation leads to under- or overestimation of the output variance. • We demonstrated that the risk of ignoring correlation can be quantified. • The procedure proposed is generally applicable in life cycle assessment. • In some cases, ignoring correlation has a minimal effect on decision-making tools.

54 ENVIRONMENTAL SCIENCES↗

Stochastic simulations of temporally and spatially variable Fe cycling within a floodplain aquifer

This data package contains model input and output files for local and global sensitivity analysis (SA) of a reactive transport model simulating redox cycling within a floodplain aquifer. The reaction network is implemented in CrunchFlow and focuses on spatially and temporally heterogeneous Fe cycling, though it contains several other species and redox pathways (37 aqueous species and 7 minerals in total). The package contains data from 600 Monte Carlo simulations (for global SA) and 104 one-at-a-time simulations (for local SA). It includes all input files required to run the CrunchFlow model, as well as limited model output – .csv files containing time series of primary species concentrations at 21 grid cells within the domain. These time series files contain the following species: H+, CO32-, SO42-, Cl-, Ca2+, Mg2+, Na+, K+, Fe(II), Fe(III), HS-, CH3COO-, O2(aq), S(aq), and Br-.These data were used to demonstrate the application of a novel form of global SA, distance-based generalized sensitivity analysis (DGSA) to a reactive transport model. The 2D model simulates the export of reduced species from pockets of fine-grained, organic-rich sediments embedded in a coarse sand aquifer. Stochastic simulations jointly varied 17 key model input parameters across several orders of magnitude, including the spatial variability of each parameter. DGSA on the model results reveal that the amplitude and variability of exported Fe(II) are most sensitive to the interaction between sand permeability and individual reaction rates. By contrast, the propagation of reducing conditions downgradient from the fine-grained lenses depends most heavily on the rate of dissolved organic carbon and sulfate release from the fines.

54 ENVIRONMENTAL SCIENCES↗

Sensitivity of Precipitation to Parameter Values in the Community Atmosphere Model Version 5

One objective of the Climate Science for a Sustainable Energy Future (CSSEF) program is to develop the capability to thoroughly test and understand the uncertainties in the overall climate model and its components as they are being developed. The focus on uncertainties involves sensitivity analysis: the capability to determine which input parameters have a major influence on the output responses of interest. This report presents some initial sensitivity analysis results performed by Lawrence Livermore National Laboratory (LNNL), Sandia National Laboratories (SNL), and Pacific Northwest National Laboratory (PNNL). In the 2011-2012 timeframe, these laboratories worked in collaboration to perform sensitivity analyses of a set of CAM5, 2° runs, where the response metrics of interest were precipitation metrics. The three labs performed their sensitivity analysis (SA) studies separately and then compared results. Overall, the results were quite consistent with each other although the methods used were different. This exercise provided a robustness check of the global sensitivity analysis metrics and identified some strongly influential parameters.

54 ENVIRONMENTAL SCIENCES↗

Sensitivity of absorption spectra to surface segregation in InGaN/GaN quantum well structures

We investigate the influence of the indium surface segregation on absorption spectra in InGaN/GaN quantum well structures having different indium amount. Results of the mathematical modeling show that such influence is more pronounced in quantum well structures with high indium amounts. The origin of this effect is related to the interplay between the indium surface segregation and internal electrostatic fields. Our theoretical analysis is performed using semiconductor Bloch equations within the Hartree-Fock approximation including into consideration excitonic effects. Results of the global sensitivity analysis evidence that the influence of the indium surface segregation is less than one order of magnitude in comparison with the impact of the quantum-well width and indium molar fraction. Also, the influence of the indium surface segregation is not the same for each interface of the quantum well.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Search for the Higgs boson in the ZH→v$\bar{v}$b$\bar{b}$ channel: Development of a b-tagging method based on soft muons

In the Standard Model of particle physics, the Higgs boson generates elementary particle masses. Current theoretical and experimental constraints lead to a Higgs boson mass between 114.4 and 158 GeV with 95% confidence level. Moreover, Tevatron has recently excluded the mass ranges between 100 and 109 GeV, 158 and 175 GeV with 95% confidence level. These results gives a clear indication to search for a Higgs boson at low mass. The D0 detector is located near Chicago, at the Tevatron, a proton-antiproton collider with an energy in the center of mass of 1.96 TeV. The topic of this thesis is the search for a Higgs boson in association with a Z boson. This channel is sensitive to low mass Higgs boson (<135 GeV) which has a branching ratio H → bb varies between 50% and 90% in this mass range. The decay channel ZH → v$\bar{v}$b$\bar{b}$ studied has in the final state 2 heavy-flavor jets and some missing transverse energy due to escaping neutrinos. The heavy-flavor jets identification ('b-tagging') is done with a new algorithm (SLTNN) developed specifically for semi-leptonic decay of b quarks. The Higgs boson search analysis was performed with 3 fb -1 of data. The use of SLTNN increases by 10% the Higgs boson signal efficiency. The global analysis sensitivity improvement, however, is rather low (<1%) after taking into account the backgrounds and systematic uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data and scripts associated with the manuscript "A Hydrogeophysical Framework to Assess Infiltration During a Simulated Ecosystem-Scale Flooding Experiment”

This package contains the data and scripts used in "A hydrogeophysical framework to assess infiltration during a simulated ecosystem-scale flooding experiment" (Adebayo et al., 2023). The Geophysics folder contains two subfolders containing Ground Penetrating Radar (GPR) and Electrical Resistivity Imaging (ERI) datasets acquired between August 23 and August 26, 2021. The GPR subfolder contains raw data (Tempest_Project.GPZ) and processed results using the Sensors and Software EKKO Project software. The ERI subfolder contains two additional subfolders named Static and Timelapse. The Static subfolder contains background resistivity datasets acquired before infiltration, both raw and inverted results using the ResIpy code. The Timelapse subfolder contains repeated resistivity datasets acquired during infiltration on two profiles, along with raw and inverted results using the ResIpy code. The Flow model folder contains ATS model simulation files. The Geophysics-informed subfolder contains simulation datasets for two profiles generated using information from the geophysics data. The National_database-informed subfolder contains simulation datasets for two profiles generated using information from a national soil database. Each subfolder contains initial simulation results, multiple ensembles, and final simulation files. The Sensitivity_analysis folder contains the observation files exported from the flow model, notebooks used in running the code, and sensitivity analysis results showing the sensitivity of different parameters over a 48-hour period. We used mutual information-based global sensitivity analysis for the sensitivity analysis, following Jiang et al., 2022. This study shows a novel approach that integrates geophysical data with hydrological modeling to understand subsurface flow during coastal flooding.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic methods for sensitivity analysis and calibration in the NASA challenge problem

In this study, a series of algorithms are proposed to address the problems in the NASA Langley Research Center Multidisciplinary Uncertainty Quantification Challenge. A Bayesian approach is employed to characterize and calibrate the epistemic parameters based on the available data, whereas a variance-based global sensitivity analysis is used to rank the epistemic and aleatory model parameters. A nested sampling of the aleatory–epistemic space is proposed to propagate uncertainties from model parameters to output quantities of interest.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Reduction using Bayesian Inference and Sensitivity Analysis: A Sequential Approach to the NASA Langley Uncertainty Quantification Challenge

This paper presents a computational framework for uncertainty characterization and propagation, and sensitivity analysis under the presence of aleatory and epistemic un- certainty, and develops a rigorous methodology for efficient refinement of epistemic un- certainty by identifying important epistemic variables that significantly affect the overall performance of an engineering system. The proposed methodology is illustrated using the NASA Langley Uncertainty Quantification Challenge (NASA-LUQC) problem that deals with uncertainty analysis of a generic transport model (GTM). First, Bayesian inference is used to infer subsystem-level epistemic quantities using the subsystem-level model and corresponding data. Second, tools of variance-based global sensitivity analysis are used to identify four important epistemic variables (this limitation specified in the NASA-LUQC is reflective of practical engineering situations where not all epistemic variables can be refined due to time/budget constraints) that significantly affect system-level performance. The most significant contribution of this paper is the development of the sequential refine- ment methodology, where epistemic variables for refinement are not identified all-at-once. Instead, only one variable is first identified, and then, Bayesian inference and global sensi- tivity calculations are repeated to identify the next important variable. This procedure is continued until all 4 variables are identified and the refinement in the system-level perfor- mance is computed. The advantages of the proposed sequential refinement methodology over the all-at-once uncertainty refinement approach are explained, and then applied to the NASA Langley Uncertainty Quantification Challenge problem.

Uncertainty↗

Sensitivity Analysis and Emulation for Functional Data using Bayesian Adaptive Splines

When a computer code is used to simulate a complex system, one of the fundamental tasks is to assess the sensitivity of the simulator to the different input parameters. In the case of computationally expensive simulators, this is often accomplished via a surrogate statistical model, a statistical output emulator. An effective emulator is one that provides good approximations to the computer code output for wide ranges of input values. In addition, an emulator should be able to handle large dimensional simulation output for a relevant number of inputs; it should flexibly capture heterogeneities in the variability of the response surface; it should be fast to evaluate for arbitrary combinations of input parameters, and it should provide an accurate quantification of the emulation uncertainty. In this paper we discuss the Bayesian approach to multivariate adaptive regression splines (BMARS) as an emulator for a computer model that outputs curves. We introduce modifications to traditional BMARS approaches that allow for fitting large amounts of data and allow for more efficient MCMC sampling. We emphasize the ease with which sensitivity analysis can be performed in this situation. We present a sensitivity analysis of a computer model of the deformation of a protective plate used in pressure-driven experiments. Our example serves as an illustration of the ability of BMARS emulators to fulfill all the necessities of computability, flexibility and reliable calculation on relevant measures of sensitivity.

97 MATHEMATICS AND COMPUTING↗

Sensitivity Analysis of Wind Plant Performance to Key Turbine Design Parameters: A Systems Engineering Approach; Preprint

This paper introduces the development of a new software framework for research, design, and development of wind energy systems which is meant to 1) represent a full wind plant including all physical and nonphysical assets and associated costs up to the point of grid interconnection, 2) allow use of interchangeable models of varying fidelity for different aspects of the system, and 3) support system level multidisciplinary analyses and optimizations. This paper describes the design of the overall software capability and applies it to a global sensitivity analysis of wind turbine and plant performance and cost. The analysis was performed using three different model configurations involving different levels of fidelity, which illustrate how increasing fidelity can preserve important system interactions that build up to overall system performance and cost. Analyses were performed for a reference wind plant based on the National Renewable Energy Laboratory's 5-MW reference turbine at a mid-Atlantic offshore location within the United States.

17 WIND ENERGY↗

Uncertainty Quantification and Sensitivity Analysis in Process-Structure-Property Simulations for Laser Powder Bed Fusion Additive Manufacturing

Process variations and process-induced defects like porosity cause significant uncertainty in the microstructure and mechanical behavior of additively manufactured metals. Establishing process-structure-property (PSP) relationships and quantifying uncertainty using experiments alone is costly, especially for structural applications where mechanical allowables must be established for qualification and certification. This work presents a PSP simulation framework for laser powder bed fusion with a focus on uncertainty quantification through probabilistic calibration and multi-fidelity uncertainty propagation. Motivated by phenomenological input parameters related to grain nucleation and growth that are difficult to characterize, a global sensitivity analysis (GSA) is completed. Through GSA, the most important input parameters are identified based on their influence on the statistical distributions of microstructural metrics that influence mechanical behavior, including grain size, morphology, and crystallographic texture. The results provide insight on what experiments are necessary to quantify and control PSP uncertainties, particularly those associated with the more challenging input parameters.

additive manufacturing↗

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗