Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

The Kalai-Smorodinsky solution for many-objective Bayesian optimization

An ongoing aim of research in multiobjective Bayesian optimization is to extend its applicability to a large number of objectives. While coping with a limited budget of evaluations, recovering the set of optimal compromise solutions generally requires numerous observations and is less interpretable since this set tends to grow larger with the number of objectives. We thus propose to focus on a specific solution originating from game theory, the Kalai-Smorodinsky solution, which possesses attractive properties. In particular, it ensures equal marginal gains over all objectives. We further make it insensitive to a monotonic transformation of the objectives by considering the objectives in the copula space. A novel tailored algorithm is proposed to search for the solution, in the form of a Bayesian optimization algorithm: sequential sampling decisions are made based on acquisition functions that derive from an instrumental Gaussian process prior. Our approach is tested on four problems with respectively four, six, eight, and nine objectives. The method is available in the R package GPGame available on CRAN at https://cran.r-project.org/package=GPGame.

Game theory↗

Real-time cure monitoring of fiber-reinforced polymer composites using infrared thermography and recursive Bayesian filtering

Despite the desirable characteristics of fiber-reinforced polymer (FRP) composites, their utilization in high volume production industries is limited by a lack of efficient manufacturing techniques. Monitoring the curing process of these composites can help with improving the quality and efficiency of the manufacturing process. This article discusses a method that uses Kalman-filter-based fusion of the information obtained from infrared thermography (surface temperature measurements) and a heat conduction model to estimate degrees of cure and internal temperatures of curing FRP composite parts in real time. The effectiveness of the methodology is demonstrated by successfully monitoring the curing of an FRP composite part in a laboratory experiment. Finally, the proposed methodology is a crucial step towards identifying anomalies in the curing process that negatively impact the quality of FRP composite parts.

36 MATERIALS SCIENCE↗

Accurate and Accelerated Neuromorphic Network Design Leveraging A Bayesian Hyperparameter Pareto Optimization Approach

Neuromorphic systems allow for extremely efficient hardware implementations for neural networks (NNs). In recent years, several algorithms have been presented to train spiking NNs (SNNs) for neuromorphic hardware. However, SNNs often provide lower accuracy than their artificial NNs (ANNs) counterparts or require computationally expensive and slow training/inference methods. To close this gap, designers typically rely on reconfiguring SNNs through adjustments in the neuron/synapse model or training algorithm itself. Nevertheless, these steps incur significant design time, while still lacking the desired improvement in terms of training/inference times (latency). Designing SNNs that can mimic the accuracy of ANNs with reasonable training times is an exigent challenge in neuromorphic computing. In this work, we present an alternative approach that looks at such designs as an optimization problem rather than algorithm or architecture redesign. We develop a versatile multiobjective hyperparameter optimization (HPO) for automatically tuning HPs of two state-of-the-art SNN training algorithms, SLAYER and HYBRID. We emphasize that, to the best of our knowledge, this is the first work trying to improve SNNs’ computational efficiency, accuracy, and training time using an efficient HPO. We demonstrate significant performance improvements for SNNs on several datasets without the need to redesign or invent new training algorithms/architectures. Our approach results in more accurate networks with lower latency and, in turn, higher energy efficiency than previous implementations. In particular, we demonstrate improvement in accuracy and more than 5× reduction in the training/inference time for the SLAYER algorithm on the DVS Gesture dataset. In the case of HYBRID, we demonstrate 30% reduction in timesteps while surpassing the accuracy of the state-of-the-art networks on CIFAR10. Further, our analysis suggests that even a seemingly minor change in HPs could change the accuracy by 5 - 6×.

Parsa, Maryam↗

General Bayesian Inference over the Stiefel Manifold via the Givens Transform

We introduce here an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We demonstrate how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

97 MATHEMATICS AND COMPUTING↗

Monte Carlo Global QCD Analyses of the Pion Parton Distribution Functions

As the lightest hadron, the pion presents itself as a dichotomy. While being the pseudo Goldstone boson associated with chiral symmetry breaking, it is simultaneously regarded as the lightest pseudoscalar meson typically composed of constituent quark and antiquark. As the chiral symmetry shares the same global symmetry as QCD, studying the pion and its internal structure is key in understanding one of the four fundamental forces of nature, namely the quantum chromodynamic strong interaction. We study the pion's parton distribution functions (PDFs), which are universal quantities that describe the structure of the pion in terms of its constituent quarks, antiquarks, and gluons. Our goal is to discover what the available data reveal for these universal quantities, namely the PDFs. Through the use of factorization theorems and perturbative QCD, we use Monte Carlo (MC) methods to extract the PDFs from the available Drell-Yan (DY) and leading neutron (LN) data. While the DY process involves two hadrons colliding, the LN electroproduction involves an electron beam incident on a target nucleon. We can constrain well the pion PDFs at large momentum fraction using DY data, and at low momentum fraction using LN data. We also use threshold resummation in the DY process to gather predictable higher order terms associated with the soft gluon radiation because their contributions to the cross section are nontrivial. In this dissertation, we parametrize the pion PDFs and fit those parameters to the available data. We make use of Bayesian inference and use MC techniques to sample the parameter space. Three sets of results are presented. We first extract the pion PDFs by fitting the DY and LN data. Then, we include transverse momentum dependent DY data in conjunction with the DY and LN data to extract the pion PDFs. Finally, we apply various methods of threshold resummation to the DY cross section and extract pion PDFs. The pion PDFs presented here are the first global QCD analyses performed as well as the first MC extracted pion PDFs, which are at the forefront of the pion PDF community.

Barry, Patrick↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗

Quantifying prediction fidelity in multiscale multiphysics simulations.

Multiscale multiphysics problems arise in a host of application areas of significant relevance to DOE, including electrical storage systems (membranes and electrodes in fuel cells, batteries, and ultracapacitors), water surety, chemical analysis and detection systems, and surface catalysis. Multiscale methods aim to provide detailed physical insight into these complex systems by incorporating coupled effects of relevant phenomena on all scales. However, many sources of uncertainty and modeling inaccuracies hamper the predictive fidelity of multiscale multiphysics simulations. These include parametric and model uncertainties in the models on all scales, and errors associated with coupling, or information transfer, across scales/physics. This presentation introduces our work on the development of uncertainty quantification methods for spatially decomposed atomistic-to-continuum (A2C) multiscale simulations. The key thrusts of this research effort are: inference of uncertain parameters or observables from experimental or simulation data; propagation of uncertainty through particle models; propagation of uncertainty through continuum models; propagation of information and uncertainty across model/scale interfaces; and numerical and computational analysis and control. To enable the bidirectional coupling between the atomistic and continuum simulations, a general formulation has been developed for the characterization of sampling noise due to intrinsic variability in particle simulations, and for the propagation of both this sampling noise and parametric uncertainties through coupled A2C multiscale simulations. Simplified tests of noise quantification in particle computations are conducted through Bayesian inference of diffusion rates in an idealized isothermal binary material system. A proof of concept is finally presented based on application of the present formulation to the propagation of uncertainties in a model plane Couette flow, where the near wall region is handled with molecular dynamics while the bulk region is handled with continuum methods.

30 DIRECT ENERGY CONVERSION↗

Modeling the Swift Bat Trigger Algorithm with Machine Learning

To draw inferences about gamma-ray burst (GRB) source populations based on Swift observations, it is essential to understand the detection efficiency of the Swift burst alert telescope (BAT). This study considers the problem of modeling the Swift / BAT triggering algorithm for long GRBs, a computationally expensive procedure, and models it using machine learning algorithms. A large sample of simulated GRBs from Lien et al. is used to train various models: random forests, boosted decision trees (with AdaBoost), support vector machines, and artificial neural networks. The best models have accuracies of greater than or equal to 97 percent (less than or equal to 3 percent error), which is a significant improvement on a cut in GRB flux, which has an accuracy of 89.6 percent (10.4 percent error). These models are then used to measure the detection efficiency of Swift as a function of redshift z, which is used to perform Bayesian parameter estimation on the GRB rate distribution. We find a local GRB rate density of n (sub 0) approaching 0.48 (sup plus 0.41) (sub minus 0.23) per cubic gigaparsecs per year with power-law indices of n (sub 1) approaching 1.7 (sup plus 0.6) (sub minus 0.5) and n (sub 2) approaching minus 5.9 (sup plus 5.7) (sub minus 0.1) for GRBs above and below a break point of z (redshift) (sub 1) approaching 6.8 (sup plus 2.8) (sub minus 3.2). This methodology is able to improve upon earlier studies by more accurately modeling Swift detection and using this for fully Bayesian model fitting.

gamma-ray burst: general – gamma-rays: general â↗

Multi-Detection Events, Probability Density Functions, and Reduced Location Area

Abstract Several efforts have been made in the Comprehensive Nuclear-Test-Ban Treaty (CTBT) community to assess the benefits of combining detections of radionuclides to improve the location estimates available from atmospheric transport modeling (ATM) backtrack calculations. We present a Bayesian estimation approach rather than a simple dilution field of regard approach to allow xenon detections and non-detections to be combined mathematically. This system represents one possible probabilistic approach to radionuclide event formation. Application of this method to a recent interesting radionuclide event shows a substantial reduction in the location uncertainty of that event.

atmospheric modeling↗

COMPARING X-RAY AND DYNAMICAL MASS PROFILES IN THE EARLY-TYPE GALAXY NGC 4636

We present the results of an X-ray mass analysis of the early-type galaxy NGC 4636, using Chandra data. We have compared the X-ray mass density profile with that derived from a dynamical analysis of the system's globular clusters (GCs). Given the observed interaction between the central active galactic nucleus and the X-ray emitting gas in NGC 4636, we would expect to see a discrepancy in the masses recovered by the two methods. Such a discrepancy exists within the central approx10 kpc, which we interpret as the result of non-thermal pressure support or a local inflow. However, over the radial range approx10-30 kpc, the mass profiles agree within the 1sigma errors, indicating that even in this highly disturbed system, agreement can be sought at an acceptable level of significance over intermediate radii, with both methods also indicating the need for a dark matter halo. However, at radii larger than 30 kpc, the X-ray mass exceeds the dynamical mass, by a factor of 4-5 at the largest disagreement. A Fully Bayesian Significance Test finds no statistical reason to reject our assumption of velocity isotropy, and an analysis of X-ray mass profiles in different directions from the galaxy center suggests that local disturbances at large radius are not the cause of the discrepancy. We instead attribute the discrepancy to the paucity of GC kinematics at large radius, coupled with not knowing the overall state of the gas at the radius where we are reaching the group regime (>30 kpc), or a combination of the two.

79 ASTRONOMY AND ASTROPHYSICS↗

The molecular architecture of the yeast spindle pole body core determined by Bayesian integrative modeling

Microtubule-organizing centers (MTOCs) form, anchor, and stabilize the polarized network of microtubules in a cell. The central MTOC is the centrosome that duplicates during the cell cycle and assembles a bipolar spindle during mitosis to capture and segregate sister chromatids. Yet, despite their importance in cell biology, the physical structure of MTOCs is poorly understood. Here we determine the molecular architecture of the core of the yeast spindle pole body (SPB) by Bayesian integrative structure modeling based on in vivo fluorescence resonance energy transfer (FRET), small-angle x-ray scattering (SAXS), x-ray crystallography, electron microscopy, and two-hybrid analysis. The model is validated by several methods that include a genetic analysis of the conserved PACT domain that recruits Spc110, a protein related to pericentrin, to the SPB. The model suggests that calmodulin can act as a protein cross-linker and Spc29 is an extended, flexible protein. The model led to the identification of a single, essential heptad in the coiled-coil of Spc110 and a minimal PACT domain. It also led to a proposed pathway for the integration of Spc110 into the SPB.

59 BASIC BIOLOGICAL SCIENCES↗

PRIME

SAND2021-0565 O PRIME is a modeling framework designed for the real-time characterization and forecasting of partially observed epidemics. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. Examples are provided using publicly available COVID-19 data. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗

Iterative HOMER with uncertainties

We present iHOMER, an iterative version of the HOMER method to extract Lund fragmentation functions from experimental data. Through iterations, we address the information gap between latent and observable phase spaces and systematically remove bias. To quantify uncertainties on the inferred weights, we use a combination of Bayesian neural networks and uncertainty-aware regression. We find that the combination of iterations and uncertainty quantification produces well-calibrated weights that accurately reproduce the data distribution. A parametric closure test shows that the iteratively learned fragmentation function is compatible with the true fragmentation function.

Butter, Anja [Heidelberg Univ. (Germany); Sorbonne↗

Bayesian Inference for NASA Probabilistic Risk and Reliability Analysis

This document, Bayesian Inference for NASA Probabilistic Risk and Reliability Analysis, is intended to provide guidelines for the collection and evaluation of risk and reliability-related data. It is aimed at scientists and engineers familiar with risk and reliability methods and provides a hands-on approach to the investigation and application of a variety of risk and reliability data assessment methods, tools, and techniques. This document provides both: A broad perspective on data analysis collection and evaluation issues. A narrow focus on the methods to implement a comprehensive information repository. The topics addressed herein cover the fundamentals of how data and information are to be used in risk and reliability analysis models and their potential role in decision making. Understanding these topics is essential to attaining a risk informed decision making environment that is being sought by NASA requirements and procedures such as 8000.4 (Agency Risk Management Procedural Requirements), NPR 8705.05 (Probabilistic Risk Assessment Procedures for NASA Programs and Projects), and the System Safety requirements of NPR 8715.3 (NASA General Safety Program Requirements).

Dezfuli, Homayoon↗

Bayesian Approach for Determining Microlens System Properties with High-angular resolution Follow-up Imaging

We present the details of the Bayesian analysis of the planetary microlensing event MOA-2016-BLG-227, whose excess flux is likely due to a source/lens companion or an unrelated ambient star, as well as of the assumed prior distributions. Furthermore, we apply this method to four reported planetary events, MOA-2008-BLG-310, MOA2011-BLG-293, OGLE-2012-BLG-0527, and OGLE-2012-BLG-0950, where adaptive optics observations have detected excess flux at the source star positions. For events with small angular Einstein radii, our lens mass estimates are more uncertain than those of previous analyses, which assumed that the excess was due to the lens. Our predictions for MOA-2008-BLG-310 and OGLE-2012-BLG-0950 are consistent with recent results on these events obtained via Keck and Hubble Space Telescope observations when the source star is resolvable from the lens star. For events with small angular Einstein radii, we find that it is generally difficult to conclude whether the excess flux comes from the host star. Therefore, it is necessary to identify the lens star by measuring its proper motion relative to the source star to determine whether the excess flux comes from the lens star. Even without such measurements, our method can be used to statistically test the dependence of the planet-hosting probability on the stellar mass.

Naoki Koshimoto↗

An initial framework for the rapid qualification of long-term creep rupture strength via microstructural modeling

This report describes the development and testing of a new method for extrapolating short-term creep rupture test data to predict long-term rupture strength. The goal of this work is to reduce the time required to qualify new materials for nuclear service by reducing the lead time required for dedicated, long-term material testing to establish key long-term material properties. The new approach described here uses a physics-based model to predict the long-term creep rupture strength of 316H stainless steel using only short-term test data. The key idea is to use Bayesian inference to find the statistical distribution of the model parameters that best explain the short-term rupture data. Because the model is physics-based these parameters are all microstructural quantities that can be measured through detailed material characterization experiments. The Bayesian prior distributions provide a means for incorporating this characterization data into the final model to improve the accuracy of the long-term model predictions. However, where such data is not available the process still produces an accurate model based on an uniformed prior. Our hypothesis is that this approach more accurately extrapolates the short-term test data when compared to current, empirical methods. The report proves this hypothesis using actual long-term rupture data available for 316H, including tests with rupture times greater than 200,000 hours. The general approach developed here could be applied to other materials and other time-dependent material properties. Applying this new technique to develop long-term qualified material properties, potentially in conjunction with other accelerated qualification approaches like staggered qualification test programs, could greatly reduce the time required to qualify new materials for nuclear service.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗