Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

A Copula-Based Conditional Probabilistic Forecast Model for Wind Power Ramps

Efficient management of wind ramping characteristics can significantly reduce wind integration costs for balancing authorities. By considering the stochastic dependence of wind power ramp (WPR) features, this paper develops a conditional probabilistic wind power ramp forecast (cp-WPRF) model based on Copula theory. The WPRs dataset is constructed by extracting ramps from a large dataset of historical wind power. Each WPR feature (e.g., rate, magnitude, duration, and start-time) is separately forecasted by considering the coupling effects among different ramp features. To accurately model the marginal distributions with a copula, a Gaussian mixture model (GMM) is adopted to characterize the WPR uncertainty and features. The Canonical Maximum Likelihood (CML) method is used to estimate parameters of the multivariable copula. The optimal copula model is chosen based on the Bayesian information criterion (BIC) from each copula family. Finally, the best conditions based cp-WPRF model is determined by predictive interval (PI) based evaluation metrics. Numerical simulations on publicly available wind power data show that the developed copula-based cp-WPRF model can predict WPRs with a high level of reliability and sharpness.

17 WIND ENERGY↗

Efficient compressive and Bayesian characterization of biphoton frequency spectra

Frequency-bin qudits constitute a promising tool for quantum information processing, but their high dimensionality can make for tedious characterization measurements. Here we introduce and compare compressive sensing and Bayesian mean estimation for recovering the spectral correlations of entangled photon pairs. Using a conventional compressive sensing algorithm, we reconstruct joint spectra with up to a 26-fold reduction in measurement time compared to the equivalent raster scan. Applying a custom Bayesian model to the same data, we then additionally realize reliable and consistent quantification of uncertainty. Finally, these efficient methods of biphoton characterization should advance our ability to use the high degree of parallelism and complexity afforded by frequency-bin encoding.

42 ENGINEERING↗

Large-Scale Optimization for Bayesian Inference in Complex Systems

The SAGUARO (Scalable Algorithms for Groundwater Uncertainty Analysis and Robust Optimization) Project focused on the development of scalable numerical algorithms for large-scale Bayesian inversion in complex systems that capitalize on advances in large-scale simulation-based optimization and inversion methods. The project was a collaborative effort among MIT, the University of Texas at Austin, Georgia Institute of Technology, and Sandia National Laboratories. The research was directed in three complementary areas: efficient approximations of the Hessian operator, reductions in complexity of forward simulations via stochastic spectral approximations and model reduction, and employing large-scale optimization concepts to accelerate sampling. The MIT₋Sandia component of the SAGUARO Project addressed the intractability of conventional sampling methods for large-scale statistical inverse problems by devising reduced-order models that are faithful to the full-order model over a wide range of parameter values; sampling then employs the reduced model rather than the full model, resulting in very large computational savings. Results indicate little effect on the computed posterior distribution. On the other hand, in the Texas₋Georgia Tech component of the project, we retain the full-order model, but exploit inverse problem structure (adjoint-based gradients and partial Hessian information of the parameter-to-observation map) to implicitly extract lower dimensional information on the posterior distribution; this greatly speeds up sampling methods, so that fewer sampling points are needed. We can think of these two approaches as "reduce then sample" and "sample then reduce." In fact, these two approaches are complementary, and can be used in conjunction with each other. Moreover, they both exploit deterministic inverse problem structure, in the form of adjoint-based gradient and Hessian information of the underlying parameter-to-observation map, to achieve their speedups.

97 MATHEMATICS AND COMPUTING↗

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Retrieving Temperatures and Abundances of Exoplanet Atmospheres with High-resolution Cross-correlation Spectroscopy

High-resolution spectroscopy (R ≥ 25,000) has recently emerged as one of the leading methods for detecting atomic and molecular species in the atmospheres of exoplanets. However, it has so far been lacking a robust method for extracting quantitative constraints on the temperature structure and molecular/atomic abundances. In this work, we present a novel Bayesian atmospheric retrieval framework applicable to high-resolution cross-correlation spectroscopy (HRCCS) that relies on the cross-correlation between data and models to extract the planetary spectral signal. We successfully test the framework on simulated data and show that it can correctly determine Bayesian credibility intervals on atmospheric temperatures and abundances, allowing for a quantitative exploration of the inherent degeneracies. Furthermore, our new framework permits us to trivially combine and explore the synergies between HRCCS and low-resolution spectroscopy to maximally leverage the information contained within each. This framework also allows us to quantitatively assess the impact of molecular line opacities at high resolution. We apply the framework to VLT CRIRES K-band spectra of HD 209458 b and HD 189733 b and retrieve abundant carbon monoxide but subsolar abundances for water, which are largely invariant under different model assumptions. This confirms previous analysis of these data sets, but is possibly at odds with detections of H{sub 2}O at different wavelengths and spectral resolutions. The framework presented here is the first step toward a true synergy between space observatories and ground-based high-resolution observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Dissecting the Gravitational Lens B1608 656. II. Precision Measurements of the Hubble Constant, Spatial Curvature, and the Dark Energy Equation of State

Strong gravitational lens systems with measured time delays between the multiple images provide a method for measuring the 'time-delay distance' to the lens, and thus the Hubble constant. We present a Bayesian analysis of the strong gravitational lens system B1608+656, incorporating (1) new, deep Hubble Space Telescope (HST) observations, (2) a new velocity dispersion measurement of 260 {+-} 15 km s{sup -1} for the primary lens galaxy, and (3) an updated study of the lens environment. Our analysis of the HST images takes into account the extended source surface brightness, and the dust extinction and optical emission by the interacting lens galaxies. When modeling the stellar dynamics of the primary lens galaxy, the lensing effect, and the environment of the lens, we explicitly include the total mass distribution profile logarithmic slope {gamma}{prime} and the external convergence {kappa}{sub ext}; we marginalize over these parameters, assigning well-motivated priors for them, and so turn the major systematic errors into statistical ones. The HST images provide one such prior, constraining the lens mass density profile logarithmic slope to be {gamma}{prime} = 2.08 {+-} 0.03; a combination of numerical simulations and photometric observations of the B1608+656 field provides an estimate of the prior for {kappa}{sub ext}: 0.10{sub -0.05}{sup +0.08}. This latter distribution dominates the final uncertainty on H{sub 0}. Fixing the cosmological parameters at {Omega}{sub m} = 0.3, {Omega}{sub {Lambda}} = 0.7, and w = -1 in order to compare with previous work on this system, we find H{sub 0} = 70.6{sub -3.1}{sup +3.1} km s{sup -1} Mpc{sup -1}. The new data provide an increase in precision of more than a factor of two, even including the marginalization over {kappa}{sub ext}. Relaxing the prior probability density function for the cosmological parameters to that derived from the WMAP 5-year data set, we find that the B1608+656 data set breaks the degeneracy between {Omega}{sub m} and {Omega}{sub {Lambda}} at w = -1 and constrains the curvature parameter to be -0.031 < {Omega}{sub k} < 0.009 (95% CL), a level of precision comparable to that afforded by the current Type Ia SNe sample. Asserting a flat spatial geometry, we find that, in combination with WMAP, H{sub 0} = 69.7{sub 5.0}{sup +4.9} km s{sup -1} Mpc{sup -1} and w = -0.94{sub -0.19}{sup +0.17} (68% CL), suggesting that the observations of B1608+656 constrain w as tightly as do the current Baryon Acoustic Oscillation data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A systematic strategy for estimating hERG block potency and its implications in a new cardiac safety paradigm

Introduction: hERG block potency is widely used to calculate a drug's safety margin against its torsadogenic potential. Previous studies are confounded by use of different patch clamp electrophysiology protocols and a lack of statistical quantification of experimental variability. Since the new cardiac safety paradigm being discussed by the International Council for Harmonisation promotes a tighter integration of nonclinical and clinical data for torsadogenic risk assessment, a more systematic approach to estimate the hERG block potency and safety margin is needed. Methods: A cross-industry study was performed to collect hERG data on 28 drugs with known torsadogenic risk using a standardized experimental protocol. A Bayesian hierarchical modeling (BHM) approach was used to assess the hERG block potency of these drugs by quantifying both the inter-site and intra-site variability. A modeling and simulation study was also done to evaluate protocol-dependent changes in hERG potency estimates. Results: A systematic approach to estimate hERG block potency is established. The impact of choosing a safety margin threshold on torsadogenic risk evaluation is explored based on the posterior distributions of hERG potency estimated by this method. The modeling and simulation results suggest any potency estimate is specific to the protocol used. Discussion: This methodology can estimate hERG block potency specific to a given voltage protocol. The relationship between safety margin thresholds and torsadogenic risk predictivity suggests the threshold should be tailored to each specific context of use, and safety margin evaluation may need to be integrated with other information to form a more comprehensive risk assessment.

60 APPLIED LIFE SCIENCES↗

A Bayesian Approach for Extracting Fluorescence Lifetimes from Sparse Data Sets and Its Significance for Imaging Experiments

The measurement of fluorescence lifetimes, especially in small sample volumes, presents the dual challenge of probing a small number of fluorophores and fitting the concomitant sparse data set to the appropriate excited-state decay function. A common method of analysis, such as the maximum likelihood (ML) technique, assumes a uniform probability distribution of the parameters describing the fluorescence decay function. An improvement is thus suggested by implementing a suitable nonuniform distribution, as is provided by a Bayesian framework, where the distribution of parameters is obtained from both their prior knowledge and the evidence-based likelihood of an event for a given set of parameters. We have also considered the Dirichlet prior distribution, whose mathematical form enables analytical solutions of the fitting parameters to be rapidly obtained. If Gaussian and exponential prior distributions are judiciously chosen, they reproduce the experimental target lifetime to within 20% with as few as 20 total photon counts for the data set, as does the Dirichlet prior distribution. But because of the analytical solutions afforded by the Dirichlet prior distribution, it is proposed to employ a Dirichlet prior to search parameter space rapidly to provide, if necessary, appropriate parameters for subsequent employment of a Gaussian or exponential prior distribution

97 MATHEMATICS AND COMPUTING↗

WAVELENGTH MEASUREMENTS OF K TRANSITIONS OF OXYGEN, NEON, AND MAGNESIUM WITH X-RAY ABSORPTION LINES

Accurate atomic transition data are important in many astronomical research areas, especially for studies of line spectroscopy. Whereas transition data of He-like and H-like ions (i.e., ions in high-charge states) have been accurately calculated, the corresponding data of K transitions of neutral or low-ionized metal elements are still very uncertain. Spectroscopy of absorption lines produced in the interstellar medium (ISM) has been proven to be an effective way to measure the central wavelengths of these atomic transitions. In this work, we analyze 36 Chandra High Energy Transmission Grating observations to search for and measure the ISM absorption lines along sight lines to 11 low-mass X-ray binaries. We correct the Galactic rotation velocity to the rest frame for every observation and then use two different methods to merge all the corrected spectra to a co-added spectrum. However, the co-added spectra obtained by this method exhibit biases, toward to either observations with high counts or lines with high signal-to-noise ratios. We do a Bayesian analysis of several significantly detected lines to obtain the systematic uncertainty and the bias correction for other lines. Compared to previous studies, our results improve the wavelength accuracy by a factor of two to five and significantly reduce the systematic uncertainties and biases. Several weak transitions (e.g., 1s-2p of Mg IV and Mg V; 1s-3p of Mg III and Mg V) are also detected for the first time, albeit with low significance; future observations with improved accuracy are required to confirm these detections.

79 ASTRONOMY AND ASTROPHYSICS↗

Acoustic emission Bayesian source location: Onset time challenge

Robust identification of the most accurate observed input data among a pool of observations is key in modeling and decision making. A statistically biased observed measurement deteriorates the predictive power of a model and affects decision-making ability based on the prediction of the model. When two competing methods of measurement are available, such as methods which identify arrival times in acoustic emission (AE) signals, a principal question is whether one of the two obtained datasets, or a combination of the two, should be used later on, for example, to localize an AE source. This question becomes more important when collecting not repeatable data such as AE signals created by a propagating crack. Here this paper considers an inverse source location problem in a concrete block to address the mentioned issue, a proposed methodology which also has wider application in competitive data selection. Elastic energy released by an AE event, such as a propagating crack, is recorded by acoustic emission data acquisition system. The onset time of AE signals is often used to locate the source of the event, and its accuracy directly affects the precision of source identification. This research proposes an innovative approach to select the most probable onset time obtained from two automatic picker methods. The proposed method selects the most probable onset times, which are observed by each picker for each sensor, in a probabilistic fashion. To validate the proposed method, the most accurate onset time observed by each picker is identified by visual inspection and is compared with the one is selected by the proposed method. Finally, the dataset is used for source location identification. Results show that picked onset times determined by the proposed method generate more accurate source identification when compared with coordinates obtained using each dataset individually.

97 MATHEMATICS AND COMPUTING↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Mass Detection for Heavy-Duty Vehicles using Gaussian Belief Propagation

Predicting vehicle mass is critical to accurately estimate energy use and emissions of commercial trucks. However, data from vehicle telematics is often not at sufficient temporal resolution or accuracy for use in model-based detection methods. In this work, a new statistical mass prediction technique is described for heavy-duty vehicles that incorporates the use Gaussian Belief Propagation (GBP) for probabilistic inference. Similar to Bayesian inference models, the GBP model typically requires less labeled training data than other contemporary machine learning techniques. First, a factor graph is constructed, and a set of Gaussian belief nodes with associated means and variances are fitted to the training data. To better handle noisy input data, the GBP mass prediction model utilizes a k-nearest factors (kNF) algorithm for probabilistic inference on unseen testing data. The proposed method is compared with a classical weighted k-nearest neighbors (kNN) regressor. This statistical kNF-GBP model works even with low-quantity, low-quality initial training data, while being capable of realtime mass estimation. Unlike the kNN regressor, the GBP model produces a measure of uncertainty with its predictions. The proposed method is validated using curve-sampled driving data collected from multiple cloud-connected Class 8 regional haul diesel trucks. Both the kNN regressor and the kNF-GBP mass prediction model were able to predict payload mass with coefficients of determination above 0.97 with minimal data preprocessing.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Efficient uncertainty quantification methodologies for high-dimensional climate land models

In this report, we proposed, examined and implemented approaches for performing efficient uncertainty quantification (UQ) in climate land models. Specifically, we applied Bayesian compressive sensing framework to a polynomial chaos spectral expansions, enhanced it with an iterative algorithm of basis reduction, and investigated the results on test models as well as on the community land model (CLM). Furthermore, we discussed construction of efficient quadrature rules for forward propagation of uncertainties from high-dimensional, constrained input space to output quantities of interest. The work lays grounds for efficient forward UQ for high-dimensional, strongly non-linear and computationally costly climate models. Moreover, to investigate parameter inference approaches, we have applied two variants of the Markov chain Monte Carlo (MCMC) method to a soil moisture dynamics submodel of the CLM. The evaluation of these algorithms gave us a good foundation for further building out the Bayesian calibration framework towards the goal of robust component-wise calibration.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian Prognostic Algorithm for Assessing Remaining Useful Life of Nuclear Power Components

A central issue in life extension for the current fleet of light water nuclear power reactors is the early detection and monitoring of significant materials degradation. To meet this need nondestructive measurement methods that are suitable for on-line, continuous, in-plant monitoring over extended time periods (months to years) are needed. A related issue is then, based on a condition assessment or degradation trend, to have the ability to estimate the remaining useful life based of components, structures and systems based on the available materials degradation information. Such measurement and modeling methods form the basis for a new range of advanced diagnostic and prognostic approaches. Prognostic methods that predict remaining life based on large crack growth, and phenomena that can be described by linear elastic fracture mechanics, have been reported by several researchers. The challenge of predicting remaining life for earlier phases of degradation is largely unsolved. Monitoring for early detection of materials degradation requires novel and enhanced sensors and data integration techniques. A recent review has considered the stages of degradation and sensing methods that can potentially be employed to detect and monitor early degradation for nuclear power plant applications. An experimental assessment of selected diagnostic techniques was also reported recently. However, the estimation of remaining useful life (RUL) determined from nondestructive diagnostic measurements for early degradation is still an unsolved problem. This present paper will discuss the application of Bayesian prognostic algorithms applied to the early degradation- life problem.

Bayesian prognostics↗

Estimating posterior quantity of interest expectations in a multilevel scalable framework

Scalable approaches for uncertainty quantification are necessary for characterizing prediction confidence in large-scale subsurface flow simulations with uncertain permeability. To this end we explore a multilevel Monte Carlo approach for estimating posterior moments of a particular quantity of interest, where we employ an element-agglomerated algebraic multigrid (AMG) technique to generate the hierarchy of coarse spaces with guaranteed approximation properties for both the generation of spatially correlated random fields and the forward simulation of Darcy's law to model subsurface flow. In both these components (sampling and forward solves), we exploit solvers that rely on state-of-the-art scalable AMG. To illustrate the applicability of this approach, numerical tests are performed on two 3D examples-a unit cube and an egg-shaped domain with an irregular boundary-where the scalability of each simulation as well as the scalability of the overall algorithm are demonstrated.

97 MATHEMATICS AND COMPUTING↗

Multidimensional sum-up rounding for integer programming in optimal experimental design

Here we present a numerical method for approximating the solution of convex integer programs stemming from optimal experimental design. The statistical setup consists of a Bayesian framework for linear inverse problems for which the direct relationship is described by a discretized integral equation. Specifically, we aim to find the optimal sensor placement from a set of candidate locations where data are collected with measurement error. The convex objective function is a measure of the uncertainty, described here by the trace or log-determinant of the posterior covariance matrix, for the discretized linear inverse problem solution. The resulting convex integer program is relaxed, producing a lower bound. An upper bound is obtained by extending the sum-up rounding approach to multiple dimensions. For this extension, we analyze its accuracy as a function of the discretization mesh size for a rectangular domain. We show asymptotic optimality of the integer solution defining the upper bound for different experimental design criteria (A- and D-optimal), by proving the convergence to zero of the gap between the upper and lower bounds as the mesh size goes to zero. The technique is illustrated on a two-dimensional gravity surveying problem for both A-optimal and D-optimal sensor placement where our designs yield better results compared with a thresholding rounding approach.

97 MATHEMATICS AND COMPUTING↗

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗