Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

A High Binary Fraction for the Most Massive Close-in Giant Planets and Brown Dwarf Desert Members

Stellar multiplicity is believed to influence planetary formation and evolution, although the precise nature and extent of this role remain ambiguous. We present a study aimed at testing the role of stellar multiplicity in the formation and/or evolution of the most massive, close-in planetary and substellar companions. Using past and new direct imaging observations, as well as the Gaia DR2 catalogue, we searched for wide binary companions to 38 stars hosting massive giant planets or brown dwarfs (M > 7 MJup) on orbits shorter than ∼1 au. We report the discovery of a new component in the WASP-14 system, and present an independent confirmation of a comoving companion to WASP-18. From a robust Bayesian statistical analysis, we derived a binary fraction of per cent between 20 and 10 000 au for our sample, twice as high as for field stars with a 3σ significance. This binary frequency was found to be larger than for lower-mass planets on similar orbits, and we observed a marginally higher binary rate for inner companions with periods shorter than 10 d. These results demonstrate that stellar companions greatly influence the formation and/or evolution of these systems, suggesting that the role played by binary companions becomes more important for higher-mass planets, and that this trend may be enhanced for systems with tighter orbits. Our analysis also revealed a peak in binary separation at 250 au, highlighting a shortfall of close binaries among our sample. This indicates that the mechanisms affecting planet and brown dwarf formation or evolution in binaries must operate from wide separations, although we found that the Kozai–Lidov mechanism is unlikely to be the dominant underlying process. We conclude that binarity plays a crucial role in the existence of very massive short-period giant planets and brown dwarf desert inhabitants, which are almost exclusively observed in multiple systems.

C Fontanive↗

Bayesian Poroelastic Aquifer Characterization From InSAR Surface Deformation Data. 2. Quantifying the Uncertainty

Uncertainty quantification of groundwater (GW) aquifer parameters is critical for efficient management and sustainable extraction of GW resources. These uncertainties are introduced by the data, model, and prior information on the parameters. We develop a Bayesian inversion framework that uses Interferometric Synthetic Aperture Radar (InSAR) surface deformation data to infer the laterally heterogeneous permeability of a transient linear poroelastic model of a confined GW aquifer. The Bayesian solution of this inverse problem takes the form of a posterior probability density of the permeability. Exploring this posterior using classical Markov chain Monte Carlo (MCMC) methods is computationally prohibitive due to the large dimension of the discretized permeability field and the expense of solving the poroelastic forward problem. However, in many partial differential equation (PDE)-based Bayesian inversion problems, the data are only informative in a few directions in parameter space. For the poroelasticity problem, we prove this property theoretically for a one-dimensional problem and demonstrate it numerically for a three-dimensional aquifer model. Here we design a generalized preconditioned Crank-Nicolson (gpCN) MCMC method that exploits this intrinsic low dimensionality by using a low-rank-based Laplace approximation of the posterior as a proposal, which we build scalably. The feasibility of our approach is demonstrated through a real GW aquifer test in Nevada. The inherently two-dimensional nature of InSAR surface deformation data informs a sufficient number of modes of the permeability field to allow detection of major structures within the aquifer, significantly reducing the uncertainty in the pressure and the displacement quantities of interest.

54 ENVIRONMENTAL SCIENCES↗

Towards a fully automated algorithm driven platform for biosystems design

Large-scale data acquisition and analysis are often required in the successful implementation of the design, build, test, and learn (DBTL) cycle in biosystems design. However, it has long been hindered by experimental cost, variability, biases, and missed insights from traditional analysis methods. Here, we report the application of an integrated robotic system coupled with machine learning algorithms to fully automate the DBTL process for biosystems design. As proof of concept, we have demonstrated its capacity by optimizing the lycopene biosynthetic pathway. This fully-automated robotic platform, BioAutomata, evaluates less than 1% of possible variants while outperforming random screening by 77%. A paired predictive model and Bayesian algorithm select experiments which are performed by Illinois Biological Foundry for Advanced Biomanufacturing (iBioFAB). BioAutomata excels with black-box optimization problems, where experiments are expensive and noisy and the success of the experiment is not dependent on extensive prior knowledge of biological mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

Inferring fracture dilation and shear slip from surface deformation utilising trained surrogate models

An important task in energy and CO 2 storage (sequestration) in the subsurface is to verify that the surrounding fractures and faults are not activated, acting as leakage pathways. This is achievable through effective and efficient Measurement, Monitoring and Verification (MMV) plans. In this work, two surrogate models are trained to captures dilation (opening) and shear deformation of fractures, and the associated surface deformation. The trained surrogate model, based on conditional Generative-Adversarial Networks (cGAN) receives fracture apertures from dilational fractures together with fracture slips from shear fractures and predicts the combined surface deformation. An inversion algorithm based on Bayesian framework is proposed to identify the geometry of both types of fractures, as well as volume of dilational fractures and deformation moment induced by shear fractures, all from the measured surface deformation data. The inversion algorithm utilises the Differential Evolution (DE) optimisation technique that has the superior performance in finding the global minimum of cost function. The proposed surrogate-assisted inversion successfully inferred the unknown dip, dip direction and the volume of the dilational fractures as well as the induced deformation moment in shear fractures. The model was further tested for the inversion of a field hydraulic fracturing tilt dataset applying different scenarios with varying unknowns to show the model's performance, as well as incorporating shear deformation for better match with the observed data.

Dilation and shear↗

GEOMETRIC AND DYNAMICAL MODELS OF REVERBERATION MAPPING DATA

We present a general method to analyze reverberation (or echo) mapping data that simultaneously provides estimates for the black hole mass and for the geometry and dynamics of the broad-line region (BLR) in active galactic nuclei (AGNs). While previous methods yield a typical scale size of the BLR or a reconstruction of the transfer function, our method directly infers the spatial and velocity distribution of the BLR from the data, from which a transfer function can be easily derived. Previous echo mapping analysis requires an independent estimate of a scaling factor known as the virial coefficient to infer the mass of the black hole, but this is not needed in our more direct approach. We use the formalism of Bayesian probability theory and implement a Markov Chain Monte Carlo algorithm to obtain estimates and uncertainties for the parameters of our BLR models. Fitting of models to the data requires knowledge of the continuum flux at all times, not just the measured times. We use Gaussian Processes to interpolate and extrapolate the continuum light curve data in a fully consistent probabilistic manner, taking the associated errors into account. We illustrate our method using simple models of BLR geometry and dynamics and show that we can recover the parameter values of our test systems with realistic uncertainties that depend upon the variability of the AGN and the quality of the reverberation mapping observing campaign. With a geometry model we can recover the mean radius of the BLR to within {approx}0.1 dex random uncertainty for simulated data with an integrated line flux uncertainty of 1.5%, while with a dynamical model we can recover the black hole mass and the mean radius to within {approx}0.05 dex random uncertainty, for simulated data with a line profile average signal-to-noise ratio of 4 per spectral pixel. These uncertainties do not include modeling errors, which are likely to be present in the analysis of real data, and should therefore be considered as lower limits to the accuracy of the method.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Spectral Moment Estimation and Uncertainty Quantification

We present a Bayesian spectral fitting method developed for spectroscopic data analysis, particularly (but not solely) in the context of fusion energy research. The presented techniques are particularly valuable to estimating moments and corresponding uncertainties whenever the spectra result from line-integrated measurements in nonuniform plasmas, for which the approximation of atomic line shapes being ideal Gaussians gives poor estimates. We decompose multiple, potentially overlapping spectral lines into a sum of Gauss-Hermite polynomials, whose properties allow efficient truncation and uncertainty quantification, often with only three free parameters per atomic emission line. Tests with both synthetic and experimental data demonstrate the effectiveness and robustness where more standard nonlinear fitting routines may experience difficulties. A parallelized version of our implementation is publicly released under an open source license.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Calculating system reliability with SRFYDO

SRFYDO is a process for estimating reliability of complex systems. Using information from all applicable sources, including full-system (flight) data, component test data, and expert (engineering) judgment, SRFYDO produces reliability estimates and predictions. It is appropriate for series systems with possibly several versions of the system which share some common components. It models reliability as a function of age and up to 2 other lifecycle (usage) covariates. Initial output from its Exploratory Data Analysis mode consists of plots and numerical summaries so that the user can check data entry and model assumptions, and help determine a final form for the system model. The System Reliability mode runs a complete reliability calculation using Bayesian methodology. This mode produces results that estimate reliability at the component, sub-system, and system level. The results include estimates of uncertainty, and can predict reliability at some not-too-distant time in the future. This paper presents an overview of the underlying statistical model for the analysis, discusses model assumptions, and demonstrates usage of SRFYDO.

97 MATHEMATICS AND COMPUTING↗

A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

This work develops a new multi delity ensemble Kalman lter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multi delity extensions of the EnKF, where the uncertainty in coarser delities in the hierarchy of models represent control variates for the uncertainty in ner delities. Small ensembles of high delity model runs are com- plemented by larger ensembles of cheaper, lower delity runs, to obtain much improved analyses at only small additional computational costs. We investigate the use of reduced order models as coarse delity control variates in the MFEnKF, and provide analyses to quantify the improvements over the traditional ensemble Kalman lters. We apply these ideas to perform data assimilation with a quasi-geostrophic test problem, using direct numerical simulation and a corresponding POD-Galerkin reduced order model. Numerical results show that the two- delity MFEnKF provides better analyses than existing EnKF algorithms at comparable or reduced computational costs.

97 MATHEMATICS AND COMPUTING↗

A Bayesian approach to evaluation of soil biogeochemical models

Abstract. To make predictions about the carbon cycling consequences of rising global surface temperatures, Earth system scientists rely on mathematical soil biogeochemical models (SBMs). However, it is not clear which models have better predictive accuracy, and a rigorous quantitative approach for comparing and validating the predictions has yet to be established. In this study, we present a Bayesian approach to SBM comparison that can be incorporated into a statistical model selection framework. We compared the fits of linear and nonlinear SBMs to soil respiration data compiled in a recent meta-analysis of soil warming field experiments. Fit quality was quantified using Bayesian goodness-of-fit metrics, including the widely applicable information criterion (WAIC) and leave-one-out cross validation (LOO). We found that the linear model generally outperformed the nonlinear model at fitting the meta-analysis data set. Both WAIC and LOO computed higher overfitting risk and effective numbers of parameters for the nonlinear model compared to the linear model, conditional on the data set. Goodness of fit for both models generally improved when they were initialized with lower and more realistic steady-state soil organic carbon densities. Still, testing whether linear models offer definitively superior predictive performance over nonlinear models on a global scale will require comparisons with additional site-specific data sets of suitable size and dimensionality. Such comparisons can build upon the approach defined in this study to make more rigorous statistical determinations about model accuracy while leveraging emerging data sets, such as those from long-term ecological research experiments.

54 ENVIRONMENTAL SCIENCES↗

The Langmuir probe system in the Wendelstein 7-X test divertor

Here, the design and evaluation of the Langmuir probe system used in the first divertor operation phase of Wendelstein 7-X is described. The probes are integrated into the target plates and have individually facetted surfaces to keep the angle of incidence of the magnetic field within an appropriate range for different magnetic configurations. Multiple models for the derivation of plasma parameters from current–voltage characteristics are introduced. These are analyzed with regard to their assumptions and limitations, generalized, and adapted to our use case. A detailed comparison is made to determine the most suitable model. It is found that the choice of model has a large impact, for example, resulting in a change in the inferred temperatures of up to a factor two. This evaluation is implemented in a Bayesian modeling framework and automated to allow for joint analysis with other diagnostics and a replacement of ad hoc assumptions. We rigorously treat parameter uncertainties, revealing strong correlations between them. General and flexible model formulations permit an expansion to additional effects.

47 OTHER INSTRUMENTATION↗

Robustness of Deep Learning Classification to Adversarial Input on GPUs: Asynchronous Parallel Accumulation Is a Source of Vulnerability

The ability of machine learning (ML) classification models to resist small, targeted input perturbations—known as adversarial attacks—is a key measure of their safety and reliability. We show that floating-point non associativity (FPNA) coupled with asynchronous parallel programming on GPUs is sufficient to result in misclassification, without any perturbation to the input. Additionally, we show that this misclassification is particularly significant for inputs close to the decision boundary and that standard adversarial robustness results may be overestimated up to 4.6 when not considering machine-level details. We first study a linear classifier, before focusing on standard Graph Neural Network (GNN) architectures and datasets used in robustness assessments. We develop a novel black-box attack using Bayesian optimization to discover external workloads that can change the instruction scheduling which bias the output of reductions on GPUs and reliably lead to misclassification. Motivated by these results, we present a new learnable permutation (LP) gradient-based approach to learning floating-point operation orderings that lead to misclassifications. The LP approach provides a worst-case estimate in a computationally efficient manner, avoiding the need to run identical experiments tens of thousands of times over a potentially large set of possible GPU states or architectures. Finally, using instrumentation-based testing, we investigate parallel reduction ordering across different GPU architectures under external background workloads, when utilizing multi-GPU virtualization, and when applying power capping. Our results demonstrate that parallel reduction ordering varies significantly across architectures under the first two conditions, substantially increasing the search space required to fully test the effects of this parallel scheduler-based vulnerability. These results and the methods developed here can help to include machine-level considerations into adversarial robustness assessments, which can make a difference in safety and mission critical applications.

Shanmugavelu, Sanjif [Maxeler Technologies, a Groq↗

Fossil Fuel Emission Verification Modeling at LLNL

We have an established project at LLNL to develop the tools needed to constrain fossil fuel carbon dioxide emissions using measurements of the carbon-14 isotope in atmospheric samples. In Figure 1 we show the fossil fuel plumes from Los Angeles and San Francisco for two different weather patterns. Obviously, a measurement made at any given location is going to depend on the weather leading up to the measurement. Thus, in order to determine the GHG emissions from some region using in situ measurements of those GHGs, we use state-of-the-art global and regional atmospheric chemistry-transport codes to simulate the plumes: the LLNL-IMPACT model (Rotman et al., 2004) and the WRFCHEM community code (http://www.wrf-model.org/index.php). Both codes can use observed (aka assimilated) meteorology in order to recreate the actual transport that occurred. The measured concentration of each tracer at a particular spatio-temporal location is a linear combination of the plumes from each region at that location (for non-reactive species). The challenge is to calculate the emission strengths for each region that fit the observed concentrations. In general this is difficult because there are errors in the measurements and modeling of the plumes. We solve this inversion problem using the strategy illustrated in Figure 2. The Bayesian Inference step combines the a priori estimates of the emissions, and their uncertainty, for each region with the results of the observations, and their uncertainty, and an ensemble of model predicted plumes for each region, and their uncertainty. The result is the mathematical best estimate of the emissions and their errors. In the case of non-linearities, or if we are using a statistical sampling technique such as a Markov Chain Monte Carlo technique, then the process is iterated until it converges (ie reaches stationarity). For the Bayesian inference we can use both a direct inversion capability, which is fast but requires assumptions of linearity and Gaussianity of errors, or one of several statistical sampling techniques, which are computationally slower but do not require either linearity or Gaussianity (Chow, et al., 2008; Delle Monache, et al., 2008). The emission regions we are using are based on the air-basins defined by the California Air Resources Board (CARB), see Figure 3. The only difference is that we have joined some of the smaller air basins together. The results of a test using 4 days of simulated observations using our ensemble retrieval system are shown in Figure 3 (right). The main source of the variation between the different model configurations arises from the uncertainty in the atmospheric boundary layer parameterization in the WRF model. We are currently developing a capability to constrain the boundary layer height in our carbon-14 work either by weighting the ensemble member results by the accuracy of their boundary layer height (using commercial aircraft observations), or as part of the retrieval process using an ensemble Kalman filter (EnKF) capability.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic constrained Bayesian inversion for transpiration cooling

Abstract To enable safe operations in applications such as rocket combustion chambers, the materials require cooling to avoid material damage. Here, transpiration cooling is a promising cooling technique. Numerous studies investigate possibilities to simulate and evaluate the complex cooling mechanism. One naturally arising question is the amount of coolant required to ensure a safe operation. To study this, we introduce an approach that determines the posterior probability distribution of the Reynolds number using an inverse problem and constraining the maximum temperature of the system under parameter uncertainties. Mathematically, this chance inequality constraint is dealt with by a generalized polynomial chaos expansion of the system. The posterior distribution will be evaluated by different Markov chain Monte Carlo based methods. A novel method for the constrained case is proposed and tested among others on two‐dimensional transpiration cooling models.

97 MATHEMATICS AND COMPUTING↗

A BAYESIAN APPROACH TO COMPARING COSMIC RAY ENERGY SPECTRA

A common problem in ultra-high energy cosmic ray physics is the comparison of energy spectra. The question is whether the spectra from two experiments or two regions of the sky agree within their statistical and systematic uncertainties. We develop a method to directly compare energy spectra for ultra-high energy cosmic rays from two different regions of the sky in the same experiment without reliance on agreement with a theoretical model of the energy spectra. The consistency between the two spectra is expressed in terms of a Bayes factor, defined here as the ratio of the likelihood of the two-parent source hypothesis to the likelihood of the one-parent source hypothesis. Unlike other methods, for example {chi}{sup 2} tests, the Bayes factor allows for the calculation of the posterior odds ratio and correctly accounts for non-Gaussian uncertainties. The latter is particularly important at the highest energies, where the number of events is very small.

79 ASTRONOMY AND ASTROPHYSICS↗

Galaxy zoo builder: Morphological dependence of spiral galaxy pitch angle

ABSTRACT Spiral structure is ubiquitous in the Universe, and the pitch angle of arms in spiral galaxies provide an important observable in efforts to discriminate between different mechanisms of spiral arm formation and evolution. In this paper, we present a hierarchical Bayesian approach to galaxy pitch angle determination, using spiral arm data obtained through the Galaxy Builder citizen science project. We present a new approach to deal with the large variations in pitch angle between different arms in a single galaxy, which obtains full posterior distributions on parameters. We make use of our pitch angles to examine previously reported links between bulge and bar strength and pitch angle, finding no correlation in our data (with a caveat that we use observational proxies for both bulge size and bar strength which differ from other work). We test a recent model for spiral arm winding, which predicts uniformity of the cotangent of pitch angle between some unknown upper and lower limits, finding our observations are consistent with this model of transient and recurrent spiral pitch angle as long as the pitch angle at which most winding spirals dissipate or disappear is larger than 10°.

Lingard, Timothy↗

Solid-state lighting life prediction using extended Kalman filter

Solid-state lighting (SSL) luminaires containing light emitting diodes (LEDs) have the potential of seeing excessive temperatures when being transported across country or being stored in non-climate controlled warehouses. They are also being used in outdoor applications in desert environments that see little or no humidity but will experience extremely high temperatures during the day. This makes it important to increase our understanding of what effects high temperature exposure for a prolonged period of time will have on the usability and survivability of these devices. The U.S. Department of Energy has made a long term commitment to advance the efficiency, understanding and development of solid-state lighting (SSL) and is making a strong push for the acceptance and use of SSL products to reduce overall energy consumption attributable to lighting. Traditional light sources “burn out” at end-of-life. For an incandescent bulb, the lamp life is defined by B50 life. However, the LEDs have no filament to “burn”. The LEDs continually degrade and the light output decreases eventually below useful levels causing failure. Presently, the TM-21 test standard is used to predict the L70 life of SSL Luminaires from LM-80 test data. The TM-21 model uses an Arrhenius Equation with an Activation Energy, Pre-decay factor and Decay Rates. Several failure mechanisms may be active in a luminaire at a single time causing lumen depreciation. The underlying TM-21 Arrhenius Model may not capture the failure physics in presence of multiple failure mechanisms. Correlation of lumen maintenance with underlying physics of degradation at system-level is needed. In this paper, a Kalman Filter and Extended Kalman Filters have been used to develop a 70% Lumen Maintenance Life Prediction Model for a LEDs used in SSL luminaires. This model can be used to calculate acceleration factors, evaluate failure-probability and identify ALT methodologies for reducing test time. Ten-thousand hour LM-80 test data for various LEDs have been used for model development. System state has been described in state space form using the measurement of the feature vector, velocity of feature vector change and the acceleration of the feature vector change. System state at each future time has been computed based on the state space at preceding time step, system dynamics matrix, control vector, control matrix, measurement matrix, measured vector, process noise and measurement noise. The future state of the lumen depreciation has been estimated based on a second order Kalman Filter model and a Bayesian Framework. The measured state variable has been related to the underlying damage using physics-based models. Life prediction of L70 life for the LEDs used in SSL luminaires from KF and EKF based models have been compared with the TM-21 model predictions and experimental data.

54 ENVIRONMENTAL SCIENCES↗

Gravitational Waves: Search Results, Data Analysis and Parameter Estimation. Amaldi 10 Parallel Session C2

The Amaldi 10 Parallel Session C2 on gravitational wave(GW) search results, data analysis and parameter estimation included three lively sessions of lectures by 13 presenters, and 34 posters. The talks and posters covered a huge range of material, including results and analysis techniques for ground-based GW detectors, targeting anticipated signals from different astrophysical sources: compact binary inspiral, merger and ringdown; GW bursts from intermediate mass binary black hole mergers, cosmic string cusps, core-collapse supernovae, and other unmodeled sources; continuous waves from spinning neutron stars; and a stochastic GW background. There was considerable emphasis on Bayesian techniques for estimating the parameters of coalescing compact binary systems from the gravitational waveforms extracted from the data from the advanced detector network. This included methods to distinguish deviations of the signals from what is expected in the context of General Relativity.

Tests of general relativity↗

Evaluating the Potential and Challenges of an Uncertainty Quantification Method for Long Short–Term Memory Models for Soil Moisture Predictions

Recently, recurrent deep networks have shown promise to harness newly available satellite–sensed data for long–term soil moisture projections. However, to be useful in forecasting, deep networks must also provide uncertainty estimates. Here we evaluated Monte Carlo dropout with an input–dependent data noise term (MCD+N), an efficient uncertainty estimation framework originally developed in computer vision, for hydrologic time series predictions. MCD+N simultaneously estimates a heteroscedastic input–dependent data noise term (a trained error model attributable to observational noise) and a network weight uncertainty term (attributable to insufficiently constrained model parameters). Although MCD+N has appealing features, many heuristic approximations were employed during its derivation, and rigorous evaluations and evidence of its asserted capability to detect dissimilarity were lacking. To address this, we provided an in–depth evaluation of the scheme's potential and limitations. We showed that for reproducing soil moisture dynamics recorded by the Soil Moisture Active Passive (SMAP) mission, MCD+N indeed gave a good estimate of predictive error, provided that we tuned a hyperparameter and used a representative training data set. The input–dependent term responded strongly to observational noise, while the model term clearly acted as a detector for physiographic dissimilarity from the training data, behaving as intended. However, when the training and test data were characteristically different, the input–dependent term could be misled, undermining its reliability. Additionally, due to the data–driven nature of the model, data noise also influences network weight uncertainty, and therefore the two uncertainty terms are correlated. Altogether, this approach has promise, but care is needed to interpret the results.

54 ENVIRONMENTAL SCIENCES↗