Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗

Large Interferometer For Exoplanets (LIFE) XIII. The value of Combining Thermal Emission and Reflected Light for the Characterization of Earth Twins

Context. Following the recommendations to NASA (in the Astro2020 Decadal survey) and ESA (through the Voyage2050 process), the search for life on exoplanets will be a priority in the next decades. Two concepts for direct imaging space missions are being developed for this purpose: the Habitable Worlds Observatory (HWO) and the Large Interferometer for Exoplanets (LIFE). These two concepts operate in different spectral regimes: HWO is focused on reflected light spectra in the ultraviolet, visible, and near-infrared (UV/VIS/NIR), while LIFE will operate in the mid-infrared (MIR) to capture the thermal emission of temperate exoplanets. Aims. In this study, we aim to assess the potential of HWO and LIFE to characterize a cloud-free Earth twin orbiting a Sun-like star at a distance of 10 pc, both as separate missions and in synergy with each other. We aim to quantify the increase in information that can be gathered by joint atmospheric retrievals on a habitable planet. Methods. We performed Bayesian retrievals on simulated data obtained by an HWO-like mission and a LIFE-like one separately, then jointly. We considered the baseline spectral resolutions currently assumed for these concepts and used two increasingly complex noise simulations, obtained using state-of-the-art noise simulators. Results. An HWO-like concept would allow one to strongly constrain H 2 O, O 2 , and O 3 in the atmosphere of a cloud-free Earth twin, while the atmospheric temperature profile is not well constrained (with an average uncertainty ≈100 K). LIFE-like observations would strongly constrain CO 2 , H 2 O, and O 3 and provide stronger constraints on the thermal atmospheric structure and surface temperature (down to ≈10 K uncertainty). For all the investigated scenarios, both missions would provide an upper limit on CH 4 . A joint retrieval on HWO and LIFE data would accurately define the atmospheric thermal profile and planetary parameters. It would decisively constrain CO 2 , H 2 O, O 2 , and O 3 and find weak constraints on CO and CH 4 . The significance of the detection is in all cases greater than or equal to the single-instrument retrievals. Conclusions. Both missions provide specific information that is relevant for the characterization of a terrestrial habitable exoplanet, but the scientific yield can be maximized by considering synergistic studies of UV/VIS/NIR+MIR observations. The use of HWO and LIFE together will provide stronger constraints on biosignatures and life indicators, with the potential to be transformative for the search for life in the Universe.

E Alei↗

Markov Chain Monte Carlo Sampling Methods for 1D Seismic and EM Data Inversion

This software provides several Markov chain Monte Carlo sampling methods for the Bayesian model developed for inverting 1D marine seismic and controlled source electromagnetic (CSEM) data. The current software can be used for individual inversion of seismic AVO and CSEM data and for joint inversion of both seismic and EM data sets. The structure of the software is very general and flexible, and it allows users to incorporate their own forward simulation codes and rock physics model codes easily into this software. Although the softwae was developed using C and C++ computer languages, the user-supplied codes can be written in C, C++, or various versions of Fortran languages. The software provides clear interfaces for users to plug in their own codes. The output of this software is in the format that the R free software CODA can directly read to build MCMC objects.

Chen, Jinsong↗

UQ Toolkit v 2.0

The Uncertainty Quantification (UQ) Toolkit is a software library for the characterizaton and propagation of uncertainties in computational models. For the characterization of uncertainties, Bayesian inference tools are provided to infer uncertain model parameters, as well as Bayesian compressive sensing methods for discovering sparse representations of high-dimensional input-output response surfaces, and also Karhunen-Loève expansions for representing stochastic processes. Uncertain parameters are treated as random variables and represented with Polynomial Chaos expansions (PCEs). The library implements several spectral basis function types (e.g. Hermite basis functions in terms of Gaussian random variables or Legendre basis functions in terms of uniform random variables) that can be used to represent random variables with PCEs. For propagation of uncertainty, tools are provided to propagate PCEs that describe the input uncertainty through the computational model using either intrusive methods (Galerkin projection of equations onto basis functions) or non-intrusive methods (perform deterministic operation at sampled values of the random values and project the obtained results onto basis functions).

Source record↗

UQ Toolkit v. 3.0

The Uncertainty Quantification (UQ) Toolkit is a software library for the characterization and propagation of uncertainties in computational models. This library provides Bayesian inference tools to infer uncertain model parameters, Bayesian compressive sensing methods for discovering sparse representations of high-dimensional input-output response surfaces, methods for constructing Karhunen-Loève representations of stochastic processes, and global sensitivity analysis tools used to compute Sobol indices in order to characterize the importance of uncertain inputs or the interactions between them. The basis for many of these methods relies on representing random variables with Polynomial Chaos expansions (PCEs). This library implements several spectral basis function types (e.g. Hermite basis functions in terms of Gaussian random variables or Legendre basis functions in terms of uniform random variables) that can be used to represent random variables with PCEs. For the propagation of uncertainty, tools are provided to propagate PCEs that describe the input uncertainty through the computational model using either intrusive methods (Galerkin projection of equations onto basis functions) or non-intrusive methods (perform deterministic operation at sampled values of the random values and project the obtained results onto basis functions).

Sargsyan, Khachik↗

Bayesian calibration of terrestrial ecosystem models: a study of advanced Markov chain Monte Carlo methods

Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this work, a differential evolution adaptive Metropolis (DREAM) algorithm is used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The calibration of DREAM results in a better model fit and predictive performance compared to the popular adaptive Metropolis (AM) scheme. Moreover, DREAM indicates that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identifies one mode. The application suggests that DREAM is very suitable to calibrate complex terrestrial ecosystem models, where the uncertain parameter size is usually large and existence of local optima is always a concern. In addition, this effort justifies the assumptions of the error model used in Bayesian calibration according to the residual analysis. Here, the result indicates that a heteroscedastic, correlated, Gaussian error model is appropriate for the problem, and the consequent constructed likelihood function can alleviate the underestimation of parameter uncertainty that is usually caused by using uncorrelated error models.

54 ENVIRONMENTAL SCIENCES↗

Bayesian calibration of terrestrial ecosystem models: A study of advanced Markov chain Monte Carlo methods

Calibration of terrestrial ecosystem models is important but challenging. Bayesian inference implemented by Markov chain Monte Carlo (MCMC) sampling provides a comprehensive framework to estimate model parameters and associated uncertainties using their posterior distributions. The effectiveness and efficiency of the method strongly depend on the MCMC algorithm used. In this study, a Differential Evolution Adaptive Metropolis (DREAM) algorithm was used to estimate posterior distributions of 21 parameters for the data assimilation linked ecosystem carbon (DALEC) model using 14 years of daily net ecosystem exchange data collected at the Harvard Forest Environmental Measurement Site eddy-flux tower. The DREAM is a multi-chain method and uses differential evolution technique for chain movement, allowing it to be efficiently applied to high-dimensional problems, and can reliably estimate heavy-tailed and multimodal distributions that are difficult for single-chain schemes using a Gaussian proposal distribution. The results were evaluated against the popular Adaptive Metropolis (AM) scheme. DREAM indicated that two parameters controlling autumn phenology have multiple modes in their posterior distributions while AM only identified one mode. The calibration of DREAM resulted in a better model fit and predictive performance compared to the AM. DREAM provides means for a good exploration of the posterior distributions of model parameters. Lastly, it reduces the risk of false convergence to a local optimum and potentially improves the predictive performance of the calibrated model.

54 ENVIRONMENTAL SCIENCES↗

Privacy policy robustness to reverse engineering

Differential privacy policies allow one to preserve data privacy while sharing and analyzing data. However, these policies are susceptible to an array of attacks. In particular, often a portion of the data desired to be privacy protected is exposed online. Access to these pre-privacy protected data samples can then be used to reverse engineer the privacy policy. With knowledge of the generating privacy policy, an attacker can use machine learning to approximate the full set of originating data. Bayesian inference is one method for reverse engineering both model and model parameters. We present a methodology for evaluating and ranking privacy policy robustness to Bayesian inference-based reverse engineering, and demonstrated this method across data with a variety of temporal trends.

Kusne, Aaron Gilad↗

Simplifying Probability Elicitation and Uncertainty Modeling in Bayesian Networks

In this paper we contribute two methods that simplify the demands of knowledge elicitation for particular types of Bayesian networks. The first method simplify the task of providing probabilities when the states that a random variable takes can be described by a new, fully ordered state set in which a state implies all the preceding states. The second method leverages Dempster-Shafer theory of evidence to provide a way for the expert to express the degree of ignorance that they feel about the estimates being provided.

99 GENERAL AND MISCELLANEOUS↗

EVOLUTION OF THE VELOCITY-DISPERSION FUNCTION OF LUMINOUS RED GALAXIES: A HIERARCHICAL BAYESIAN MEASUREMENT

We present a hierarchical Bayesian determination of the velocity-dispersion function of approximately 430,000 massive luminous red galaxies observed at relatively low spectroscopic signal-to-noise ratio (S/N {approx} 3-5 per 69 km s{sup -1}) by the Baryon Oscillation Spectroscopic Survey (BOSS) of the Sloan Digital Sky Survey III. We marginalize over spectroscopic redshift errors, and use the full velocity-dispersion likelihood function for each galaxy to make a self-consistent determination of the velocity-dispersion distribution parameters as a function of absolute magnitude and redshift, correcting as well for the effects of broadband magnitude errors on our binning. Parameterizing the distribution at each point in the luminosity-redshift plane with a log-normal form, we detect significant evolution in the width of the distribution toward higher intrinsic scatter at higher redshifts. Using a subset of deep re-observations of BOSS galaxies, we demonstrate that our distribution-parameter estimates are unbiased regardless of spectroscopic S/N. We also show through simulation that our method introduces no systematic parameter bias with redshift. We highlight the advantage of the hierarchical Bayesian method over frequentist 'stacking' of spectra, and illustrate how our measured distribution parameters can be adopted as informative priors for velocity-dispersion measurements from individual noisy spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

Challenges in Markov Chain Monte Carlo for Bayesian Neural Networks

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such challenges culminate to lack of convergence to the parameter posterior. Nevertheless, this paper shows that a nonconverged Markov chain, generated via MCMC sampling from the parameter space of a neural network, can yield via Bayesian marginalization a valuable posterior predictive distribution of the output of the neural network. Further, classification examples based on multilayer perceptrons showcase highly accurate posterior predictive distributions. The postulate of limited scope for MCMC developments in BNNs is partially valid; an asymptotically exact parameter posterior seems less plausible, yet an accurate posterior predictive distribution is a tenable research avenue.

97 MATHEMATICS AND COMPUTING↗

IZI: INFERRING THE GAS PHASE METALLICITY (Z) AND IONIZATION PARAMETER (q) OF IONIZED NEBULAE USING BAYESIAN STATISTICS

We present a new method for inferring the metallicity (Z) and ionization parameter (q) of H II regions and star-forming galaxies using strong nebular emission lines (SELs). We use Bayesian inference to derive the joint and marginalized posterior probability density functions for Z and q given a set of observed line fluxes and an input photoionization model. Our approach allows the use of arbitrary sets of SELs and the inclusion of flux upper limits. The method provides a self-consistent way of determining the physical conditions of ionized nebulae that is not tied to the arbitrary choice of a particular SEL diagnostic and uses all the available information. Unlike theoretically calibrated SEL diagnostics, the method is flexible and not tied to a particular photoionization model. We describe our algorithm, validate it against other methods, and present a tool that implements it called IZI. Using a sample of nearby extragalactic H II regions, we assess the performance of commonly used SEL abundance diagnostics. We also use a sample of 22 local H II regions having both direct and recombination line (RL) oxygen abundance measurements in the literature to study discrepancies in the abundance scale between different methods. We find that oxygen abundances derived through Bayesian inference using currently available photoionization models in the literature can be in good (∼30%) agreement with RL abundances, although some models perform significantly better than others. We also confirm that abundances measured using the direct method are typically ∼0.2 dex lower than both RL and photoionization-model-based abundances.

79 ASTRONOMY AND ASTROPHYSICS↗

A comprehensive review of dwell time optimization methods in computer-controlled optical surfacing

Dwell time plays a vital role in determining the accuracy and convergence of the computer-controlled optical surfacing process. However, optimizing dwell time presents a challenge due to its ill-posed nature, resulting in non-unique solutions. To address this issue, several well-known methods have emerged, including the iterative, Bayesian, Fourier transform, and matrix-form methods. Despite their independent development, these methods share common objectives, such as minimizing residual errors, ensuring dwell time's positivity and smoothness, minimizing total processing time, and enabling flexible dwell positions. This paper aims to comprehensively review the existing dwell time optimization methods, explore their interrelationships, provide insights for their effective implementations, evaluate their performances, and ultimately propose a unified dwell time optimization methodology.

36 MATERIALS SCIENCE↗

Parameter Calibration for Johnson Cook and Preston-Tonks-Wallace Material Strength Models with Uncertainty Quantification

In this study we perform a Bayesian calibration of the parameters in the Johnson Cook (JC) material strength model, with uncertainty, using experiments with for a range of low and medium strain rates. For the parameter calibration, we used a variational Bayesian approach with experimental data from Hopkinson bar and quasi-static tests done on Oxygen Free High Conductivity (OFHC) copper. The estimated parameter values matched well with experimental data for a modest range of strain rates and temperatures. Through this method, we also recovered uncertainty and correlation information for the estimated parameter values. We also compared our results to a calibration of parameters in the Preston-Tonks-Wallace (PTW) material strength model, using the same variational Bayesian method. The parameters estimated for both models provided good agreement with the experimental data.

36 MATERIALS SCIENCE↗

Uncertainty quantification in breakup reactions

Breakup reactions are one of the favored probes to study loosely bound nuclei, particularly those in the limit of stability forming a halo. In order to interpret such breakup experiments, the continuum discretized coupled channel method is typically used. In this study, the first Bayesian analysis of a breakup reaction model is performed. Herein we use a combination of statistical methods together with a three-body reaction model (the continuum discretized coupled channel method) to quantify the uncertainties on the breakup observables due to the parameters in the effective potential describing the loosely bound projectile of interest. The combination of tools we develop opens the path for a Bayesian analysis of not only breakup processes, but also a wide array of complex processes that require computationally intensive reaction models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Unfolding quantum computer readout noise

Abstract In the current era of noisy intermediate-scale quantum computers, noisy qubits can result in biased results for early quantum algorithm applications. This is a significant challenge for interpreting results from quantum computer simulations for quantum chemistry, nuclear physics, high energy physics (HEP), and other emerging scientific applications. An important class of qubit errors are readout errors. The most basic method to correct readout errors is matrix inversion, using a response matrix built from simple operations to probe the rate of transitions from known initial quantum states to readout outcomes. One challenge with inverting matrices with large off-diagonal components is that the results are sensitive to statistical fluctuations. This challenge is familiar to HEP, where prior-independent regularized matrix inversion techniques (“unfolding”) have been developed for years to correct for acceptance and detector effects, when performing differential cross section measurements. We study one such method, known as iterative Bayesian unfolding, as a potential tool for correcting readout errors from universal gate-based quantum computers. This method is shown to avoid pathologies from commonly used matrix inversion and least squares methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A COMPLETE SPECTROSCOPIC SURVEY OF THE MILKY WAY SATELLITE SEGUE 1: DARK MATTER CONTENT, STELLAR MEMBERSHIP, AND BINARY PROPERTIES FROM A BAYESIAN ANALYSIS

We introduce a comprehensive analysis of multi-epoch stellar line-of-sight velocities to determine the intrinsic velocity dispersion of the ultrafaint satellites of the Milky Way. Our method includes a simultaneous Bayesian analysis of both membership probabilities and the contribution of binary orbital motion to the observed velocity dispersion within a 14-parameter likelihood. We apply our method to the Segue 1 dwarf galaxy and conclude that Segue 1 is a dark-matter-dominated galaxy at high probability with an intrinsic velocity dispersion of 3.7{sup +1.4}{sub -1.1} km s{sup -1}. The dark matter halo required to produce this dispersion must have an average density of {rho}-bar{sub 1/2} = 2.5{sub -1.9}{sup +4.1}, M{sub sun}, pc{sup -3} within a sphere that encloses half the galaxy's stellar luminosity. This is the highest measured density of dark matter in the Local Group. Our results show that a significant fraction of the stars in Segue 1 may be binaries with the most probable mean period close to 10 years, but also consistent with the 180 year mean period seen in the solar vicinity at about 1{sigma}. Despite this binary population, the possibility that Segue 1 is a bound star cluster with the observed velocity dispersion arising from the orbital motion of binary stars is disfavored by the multi-epoch stellar velocity data at greater than 99% C.L. Finally, our treatment yields a projected (two-dimensional) half-light radius for the stellar profile of Segue 1 of R{sub 1/2} = 28{sup +5}{sub -4} pc, in excellent agreement with photometric measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

QUASI-PERIODIC OSCILLATIONS AND BROADBAND VARIABILITY IN SHORT MAGNETAR BURSTS

The discovery of quasi-periodic oscillations (QPOs) in magnetar giant flares has opened up prospects for neutron star asteroseismology. However, with only three giant flares ever recorded, and only two with data of sufficient quality to search for QPOs, such analysis is seriously data limited. We set out a procedure for doing QPO searches in the far more numerous, short, less energetic magnetar bursts. The short, transient nature of these bursts requires the implementation of sophisticated statistical techniques to make reliable inferences. Using Bayesian statistics, we model the periodogram as a combination of red noise at low frequencies and white noise at high frequencies, which we show is a conservative approach to the problem. We use empirical models to make inferences about the potential signature of periodic and QPOs at these frequencies. We compare our method with previously used techniques and find that although it is on the whole more conservative, it is also more reliable in ruling out false positives. We illustrate our Bayesian method by applying it to a sample of 27 bursts from the magnetar SGR J0501+4516 observed by the Fermi Gamma-ray Burst Monitor, and we find no evidence for the presence of QPOs in any of the bursts in the unbinned spectra, but do find a candidate detection in the binned spectra of one burst. However, whether this signal is due to a genuine quasi-periodic process, or can be attributed to unmodeled effects in the noise is at this point a matter of interpretation.

79 ASTRONOMY AND ASTROPHYSICS↗