Search NASA⌕ Search

SEARCH · Search NASA

Results for “forward sensitivity analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Dark Photon Search at BABAR

Presented is the current progress of a search for the signature of a dark photon or new particle using the BaBar data set. We search for the processes e + e - → γ ISR A', A' → e + e - and e + e - → γ ISR γ,γ → A', A' → e + e - , where γ ISR is an initial state radiated photon of energy E γ >= 1 GeV. Twenty-five sets of Monte Carlo, simulating e + e - collisions at an energy of 10.58 GeV, were produced with different values of the A' mass ranging from 100 MeV to 9.5 GeV. The mass resolution is calculated based on Monte Carlo simulations. We implement ROOT's Toolkit for Multivariate Analysis (TMVA), a machine learning tool that allows us to evaluate the signal character of events based on many of discriminating variables. TMVA training is conducted with samples of Monte Carlo as signal and a small portion of Run 6 as background. The multivariate analysis produces additional cuts to separate signal and background. The signal efficiency and sensitivity are calculated. The analysis will move forward to fit the background and scan the residuals for the narrow resonance peak of a new particle.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

54 ENVIRONMENTAL SCIENCES↗

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗

Final Report: Quantification of Uncertainty in Extreme Scale Computations (QUEST)

QUEST (\url{www.quest-scidac.org}) is a SciDAC Institute that is focused on uncertainty quantification (UQ) in large-scale scientific computations. Our goals are to (1) advance the state of the art in UQ mathematics, algorithms, and software; and (2) provide modeling, algorithmic, and general UQ expertise, together with software tools, to other SciDAC projects, thereby enabling and guiding a broad range of UQ activities in their respective contexts. QUEST is a collaboration among six institutions (Sandia National Laboratories, Los Alamos National Laboratory, the University of Southern California, Massachusetts Institute of Technology, the University of Texas at Austin, and Duke University) with a history of joint UQ research. Our vision encompasses all aspects of UQ in leadership-class computing. This includes the well-founded setup of UQ problems; characterization of the input space given available data/information; local and global sensitivity analysis; adaptive dimensionality and order reduction; forward and inverse propagation of uncertainty; handling of application code failures, missing data, and hardware/software fault tolerance; and model inadequacy, comparison, validation, selection, and averaging. The nature of the UQ problem requires the seamless combination of data, models, and information across this landscape in a manner that provides a self-consistent quantification of requisite uncertainties in predictions from computational models. Accordingly, our UQ methods and tools span an interdisciplinary space across applied math, information theory, and statistics. The MIT QUEST effort centers on statistical inference and methods for surrogate or reduced-order modeling. MIT personnel have been responsible for the development of adaptive sampling methods, methods for approximating computationally intensive models, and software for both forward uncertainty propagation and statistical inverse problems. A key software product of the MIT QUEST effort is the MIT Uncertainty Quantification library, called MUQ (\url{muq.mit.edu}).

97 MATHEMATICS AND COMPUTING↗

CXTFIT/Excel A modular adaptable code for parameter estimation, sensitivity analysis and uncertainty analysis for laboratory or field tracer experiments

We implemented the widely used CXTFIT code in Excel to provide flexibility and added sensitivity and uncertainty analysis functions to improve transport parameter estimation and to facilitate model discrimination for multi-tracer experiments on structured soils. Analytical solutions for one-dimensional equilibrium and nonequilibrium convection dispersion equations were coded as VBA functions so that they could be used as ordinary math functions in Excel for forward predictions. Macros with user-friendly interfaces were developed for optimization, sensitivity analysis, uncertainty analysis, error propagation, response surface calculation, and Monte Carlo analysis. As a result, any parameter with transformations (e.g., dimensionless, log-transformed, species-dependent reactions, etc.) could be estimated with uncertainty and sensitivity quantification for multiple tracer data at multiple locations and times. Prior information and observation errors could be incorporated into the weighted nonlinear least squares method with a penalty function. Users are able to change selected parameter values and view the results via embedded graphics, resulting in a flexible tool applicable to modeling transport processes and to teaching students about parameter estimation. The code was verified by comparing to a number of benchmarks with CXTFIT 2.0. It was applied to improve parameter estimation for four typical tracer experiment data sets in the literature using multi-model evaluation and comparison. Additional examples were included to illustrate the flexibilities and advantages of CXTFIT/Excel. The VBA macros were designed for general purpose and could be used for any parameter estimation/model calibration when the forward solution is implemented in Excel. A step-by-step tutorial, example Excel files and the code are provided as supplemental material.

54 ENVIRONMENTAL SCIENCES↗

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗

Toward reducing uncertainty quantification costs in DEM models of particulate flow: Testing simple, sensitivity-based, forward uncertainty propagation techniques

The performance of two conceptually-simple uncertainty quantification techniques are tested against the rigorous nested-loop sampling technique of Roy and Oberkampf (Comput Methods Appl Mech Eng, 200: 2131–2144, 2011) (herein called full-sampling) using two very small-scale DEM-based models of particulate flow (one gas-solid flow and one granular flow). The first simplified forward uncertainty propagation technique, reduced-sampling, uses a sensitivity analysis to eliminate uncertain inputs that have little impact on the model output prior to nested-loop sampling. The second technique, boundary-sampling, uses a sensitivity analysis to inform the selection of two bounding cases for each key model output. In conclusion, the uncertainties in the model outputs obtained via the reduced- and boundary-sampling methods agree well with those from full-sampling for both the gas-solid and granular flow models while yielding computational savings of 65–75% (reduced sampling) and 94–97% (boundary sampling).

42 ENGINEERING↗

Biological Valorization of Natural Gas for the Production of Lactic Acid: Techno-Economic Analysis and Life Cycle Assessment

Due to the availability of natural gas, shale gas, and flared gas, there is increased interest in converting methane in these gases into commodity chemicals via cost-effective and sustainable processes. Recently, we have demonstrated an efficient process concept converting methane to lactic acid (LA) by methanotrophic bacteria with high carbon flux, pivoting potentials for commercialization. Herein, we present a first-of-kind conceptual design and a techno-economic analysis (TEA) of a biorefinery process with calculated minimum selling prices. This study includes both sensitivity analysis and scenario analysis for key cost drivers and for projecting path forwards in research and development. The analyses reveal that the conversion efficiency, LA product titer, LA productivity, and gas flow rate have the most significant impacts on cost. The MSP varies from $5.83-$2.17/kg LA depending on these key process attributes. Further, a life cycle assessment of this process concept is evaluated and compared to understand the sustainable aspects. In this TEA study, the bio-upgrading process from natural gas to LA presents a potentially promising approach in terms of the feedstock versatility, economic viability, and environmental impact.

BIOMASS FUELS,NATURAL GAS↗

SCALE Sensitivity Calculations Using Contributon Theory

The SCALE TSUNAMI-3D sensitivity and uncertainty analysis sequence computes the sensitivity of k-eff to each constituent multigroup cross section using adjoint techniques with the KENO Monte Carlo codes. A new technique to simultaneously obtain the product of the forward and adjoint angular flux moments within a single Monte Carlo calculation has been developed and implemented in the SCALE TSUNAMI-3D analysis sequence. A new concept in Monte Carlo theory has been developed for this work, an eigenvalue contributon estimator, which is an extension of previously developed fixed source contributon estimators. A contributon is a particle for which the forward solution is accumulated, and its importance to the response, which is equivalent to the adjoint solution, is simultaneously accumulated. Thus, the contributon is a particle coupled with its contribution to the response, in this case keff. As implemented in SCALE, the contributon provides the importance of a particle exiting at any energy or direction for each location, energy and direction at which the forward flux solution is sampled. Although currently implemented for eigenvalue calculations in multigroup mode in KENO, this technique is directly applicable to continuous-energy calculations for many other responses such as fixed-source sensitivity analysis and quantification of reactor kinetics parameters. This paper provides the physical bases of eigenvalue contributon theory, provides details of implementation into TSUNAMI-3D, and provides results of sample calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A setup for simultaneous measurement of infrared spectra and light scattering signals: Watching amyloid fibrils grow from intact proteins

A setup for the simultaneous measurement of mid-infrared spectra and static light scattering is described that can be used for the analysis of the formation of nanoscale and microscopic aggregates from smaller molecules to biopolymers. It can be easily integrated into sample chambers of infrared spectrometers or combined with laser beams from tunable infrared lasers. Here, its use for the analysis of the formation of amyloid fibrils from intact proteins is demonstrated. The formation of amyloid fibrils or plaques from proteins is a widespread and pathogenetic relevant process, and a number of diseases are caused and correlated with the deposition of amyloid fibrils in cells and tissues. The molecular mechanisms of these transformations, however, are still unclear. We report here the simultaneous measurement of infrared spectra and static light scattering for the analysis of fibril formation from egg-white lysozyme. The transformation of the native form into non-native forms rich in β-sheet structure is measured by analysis of the amide I spectral region in the infrared spectra, which is sensitive for local structures. At the same time, light scattering signals at forward direction as well as the forward/backward ratio, which are sensitive for the number of scattering centers and their approximate sizes, respectively, are collected for the analysis of fibril growth. Thermodynamic and kinetic parameters as well as mechanistic information are deduced from the combination of the two complementary techniques.

36 MATERIALS SCIENCE↗

A search for the Higgs boson in H→WW→lvlv with 802 fb -1

This thesis documents a search for Standard Model (SM) Higgs boson to WW production in the final state of two charged leptons (e, μ) and two neutrino final state resulting from in pp collisions at √ s = 1.96 TeV. The data collected by the CDF II detector at the Tevatron collider at Fermilab, corresponds to an integrated luminosity of 8.2 fb -1 . This iteration of the analysis incorporated several improvements to increase Higgs sensitivity. We reevaluated lepton isolation values to recover signal events in which leptons mutually spoil each other’s isolation requirements. We additionally incorporated new lepton identification selections, namely likelihood based forward electrons and a better recovery of electrons passing through detector cracks. The base analysis searches for opposite-sign dilepton events. We employed three separately trained neural networks to distinguish signal from background processes for events with 0, one, or two jets. To further increase sensitivity for 0-jet events, we constructed a likelihood ratio discriminant based on Matrix Element calculations as an additional input to the neural network. For the base opposite-sign analysis, summing over all jet multiplicities, we observed 3513 events in data compared with a background expectation of 3409 ± 233 and a signal expectation of 53.6 ± 9.4 for a mass of 165 GeV/c 2 . To further increase signal acceptance, we incorporated several separate search regions in addition to the base analysis. We include subchannels searching for Higgs production in events with low dilepton invariant mass and in events having final states with either same-sign dileptons or trileptons With the combination of the separate analyses, we observed a 95% C.L. upper production limit of 0.77 times the SM expectation for a Higgs mass of 165 GeV/c 2 to be compared with the value for the median of the expected limit (0.78). We additionally present results for eighteen Higgs masses ranging from 110 GeV/c 2 to 200 GeV/c 2 . We excluded at the 95% C.L., a SM Higgs boson in the mass range between 156 and 175 GeV/c 2 .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Simulations of Brady's-Type Fault Undergoing CO2 Push-Pull: Pressure-Transient and Sensitivity Analysis

Input and output files used for fault characterization through numerical simulation using iTOUGH2. The synthetic data for the push period are generated by running a forward simulation (input parameters are provided in iTOUGH2 Brady GF6 Input Parameters.txt [InvExt6i.txt]). In general, the permeability of the fault gouge, damage zone, and matrix are assumed to be unknown. The input and output files are for the inversion scenario where only pressure transients are available at the monitoring well located 200 m above the injection well and only the fault gouge permeability is estimated. The input files are named InvExt6i, INPUT.tpl, FOFT.ins, CO2TAB, and the output files are InvExt6i.out, pest.fof, and pest.sav (names below are display names). The table graphic in the data files below summarizes the inversion results, and indicates the fault gouge permeability can be estimated even if imperfect guesses are used for matrix and damage zone permeabilities, and permeability anisotropy is not taken into account.

15 GEOTHERMAL ENERGY↗

Bayesian Framework for Bioburden Density Estimation in Planetary Protection

To comply with the international planetary protection policy set forth by the Committee on Space Research and NASA Agency level requirements, spacecraft destined to biologically sensitive planetary bodies have to minimize terrestrial biological contamination. Analysis, testing and inspection are the standard forward verification activities that are used to demonstrate compliance with the biological contamination requirements. For testing of spacecraft surface areas, a swab or wipe sample is collected from surfaces prior to last access and subsequently processed in the lab using NASA Approved Planetary Protection Methods for Culture Based Assays. Raw data resulting from this assay is then statistically treated employing a mathematical paradigm stemming from the 1970’s Viking Lander Project to generate the bioburden density and total microbial bioburden present. This standard approach arbitrarily accounts for error and provides an upper conservative bound as it reports the maximum number of spores estimated to be present on flight hardware surfaces. A bioburden density estimate factors in the following variables: the observed bioburden count, representative volume processed, sampling efficiencies. Notably, to account for error in the approach, a 0 observed count is arbitrarily changed to a count of 1 for each hardware grouping. The data generated by spacecraft bioburden verification campaigns in the past have resulted in <80% of wipes and <90% of swabs containing a bioburden count of 0. As such, having a robust and well documented statistical approach for dealing with the probability of low incident rates is necessary to be able to estimate spacecraft bioburden. Being able to statistically describe the bioburden distribution and associated confidence level is a gamechanger for the development of bioburden allocations during mission design and will allow for tighter management of risk throughout spacecraft build. Thus, Empirical Bayes statistical approach was evaluated to estimate the microbial bioburden on spacecraft to mitigate the aforementioned mathematical concerns and provide a probabilistic bioburden distribution of the flight hardware surface. For application of this approach to performing bioburden calculations, a range of non-informative prior assumptions on hardware surfaces are explored for Bayesian analyses while informative priors using posterior distributions from prior assays are utilized for Empirical Bayes analyses. Several non-informative priors are currently under investigation to assess fitness including use of these priors to serve as a foundation to build off of NASA specification values or a basis of risk to account for unknowns during the integration and testing process. Informative priors under consideration are generated using sampled bioburden values from hardware originating within like processing environments (e.g. vendor cleaning process or similar assembly process), temporal spacecraft status events as a prediction for hardware cleanliness of future samples, and heritage system bioburden actuals to predict allocation for subsequent missions. Informative priors and probabilistic bioburden distributions are then validated using data sets from the Mars Exploration Rover, Mars Science Laboratory, and InSight missions. Using Empirical Bayes approach to generate a probabilistic bioburden distribution as demonstrated through mission use cases provides a valid approach for use in the end-to-end requirements verification process.

97 - MATHEMATICS AND COMPUTING↗

iTOUGH2 v7.1

iTOUGH2 (inverse TOUGH2) provides inverse modeling capabilities for TOUGH2, a simulator for multi-dimensional, multi-phase, multi-component, non-isothermal flow and transport in fractured porous media. iTOUGH2 performs sensitivity analyses, data-worth analyses, parameter estimation, and uncertainty propagation analyses in geosciences and reservoir engineering and other application areas. iTOUGH2 supports a number of different combinations of fluids and components (equation-of-state (EOS) modules). In addition, the optimization routines implemented in iTOUGH2 can also be used for sensitivity analysis, automatic model calibration, and uncertainty quantification of any external code that uses text-based input and output files using the PEST protocol. iTOUGH2 solves the inverse problem by minimizing a non-linear objective function of the weighted differences between model output and the corresponding observations. Multiple minimization algorithms (derivative-free, gradient-based, and second-order; local and global) are available. iTOUGH2 also performs Latin Hypercube Monte Carlo simulations for uncertainty propagation analyses. A detailed residual and error analysis is provided. This upgrade includes (a) global sensitivity analysis methods, (b) dynamic memory allocation (c) additional input features and output analyses, (d) increased forward simulation capabilities, (e) parallel execution on multicore PCs and Linux clusters, and (f) bug fixes.

Finsterle, Stefan↗

Predicting Biological Cleanliness: An Empirical Bayes Approach for Spacecraft Bioburden Accounting

To comply with the international planetary protection policy set forth by the Committee on Space Research and NASA Agency level requirements, spacecraft destined to biologically sensitive planetary bodies have to minimize terrestrial biological contamination. Analysis, testing and inspection are the standard forward verification activities that are used to demonstrate compliance with the biological contamination requirements. For testing of spacecraft surface areas, a swab or wipe sample is collected from surfaces prior to last access and subsequently processed in the lab using NASA Approved Planetary Protection Methods for Culture Based Assays. Raw data resulting from this assay is then statistically treated employing a mathematical paradigm stemming from the 1970’s Viking Lander Project to generate the bioburden density and total microbial bioburden present. This standard approach arbitrarily accounts for error and provides an upper conservative bound as it reports the maximum number of spores estimated to be present on flight hardware surfaces. A bioburden density estimate factors in the following variables: the observed bioburden count, representative volume processed, sampling efficiencies. Notably, to account for error in the approach, a 0 observed count is arbitrarily changed to a count of 1 for each hardware grouping. The data generated by spacecraft bioburden verification campaigns in the past have resulted in <80% of wipes and <90% of swabs containing a bioburden count of 0. As such, having a robust and well documented statistical approach for dealing with the probability of low incident rates is necessary to be able to estimate spacecraft bioburden. Being able to statistically describe the bioburden distribution and associated confidence level is a gamechanger for the development of bioburden allocations during mission design and will allow for tighter management of risk throughout spacecraft build. Thus, Empirical Bayes statistical approach was evaluated to estimate the microbial bioburden on spacecraft to mitigate the aforementioned mathematical concerns and provide a probabilistic bioburden distribution of the flight hardware surface. For application of this approach to performing bioburden calculations, a range of non-informative prior assumptions on hardware surfaces are explored for Bayesian analyses while informative priors using posterior distributions from prior assays are utilized for Empirical Bayes analyses. Several non-informative priors are currently under investigation to assess fitness including use of these priors to serve as a foundation to build off of NASA specification values or a basis of risk to account for unknowns during the integration and testing process. Informative priors under consideration are generated using sampled bioburden values from hardware originating within like processing environments (e.g. vendor cleaning process or similar assembly process), temporal spacecraft status events as a prediction for hardware cleanliness of future samples, and heritage system bioburden actuals to predict allocation for subsequent missions. Informative priors and probabilistic bioburden distributions are then validated using data sets from the Mars Exploration Rover, Mars Science Laboratory, and InSight missions. Using Empirical Bayes approach to generate a probabilistic bioburden distribution as demonstrated through mission use cases provides a valid approach for use in the end-to-end requirements verification process.

97 MATHEMATICS AND COMPUTING↗

Automated divertor target design by adjoint shape sensitivity analysis and a one-shot method

As magnetic confinement fusion progresses towards the development of first reactor-scale devices, computational tokamak divertor design is a topic of high priority. Presently, edge plasma codes are used in a forward approach, where magnetic field and divertor geometry are manually adjusted to meet design requirements. Due to the complex edge plasma flows and large number of design variables, this method is computationally very demanding. On the other hand, efficient optimization-based design strategies have been developed in computational aerodynamics and fluid mechanics. Such an optimization approach to divertor target shape design is elaborated in the present paper. A general formulation of the design problems is given, and conditions characterizing the optimal designs are formulated. Using a continuous adjoint framework, design sensitivities can be computed at a cost of only two edge plasma simulations, independent of the number of design variables. Furthermore, by using a one-shot method the entire optimization problem can be solved at an equivalent cost of only a few forward simulations. The methodology is applied to target shape design for uniform power load, in simplified edge plasma geometry.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-Fidelity Active Subspaces for Wind Farm Uncertainty Quantification

Wind plants operate in stochastic environments characterized by complex turbulent flow dynamics and high-dimensional random variables. A key step in uncertainty quantification studies is sensitivity analysis and dimension reduction that can facilitate the development of surrogate models to be used for forward and inverse propagation or optimization under uncertainty. Prior work has shown active subspaces are an effective tool for identifying important directions in the space of stochastic inputs; however, they have only been applied to single-fidelity wind plant models. In this study, we investigate the efficacy of a multi-fidelity active subspace method for analyzing the uncertainty in wind plant power output. The multi-fidelity active subspace estimator offers the promise of increased accuracy in identifying active subspaces as compared to a single-fidelity estimator for the same computational cost, or a reduction in cost for the same accuracy. This makes the study of uncertainty in larger wind plants and with higher fidelity physics tractable. The multi-fidelity active subspace method is applied to gridded and existing wind plant layouts with single and multiple inflow conditions and its performance for surrogate modeling and uncertainty propagation is compared against a single-fidelity active subspace method. This multi-fidelity approach yields substantial computational speedups of 2x - 3.4x across the test cases along with acceptable accuracy in surrogate modeling and computing statistical moments.

active subspace↗