Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Searching for systematics in SNIa and galaxy cluster data using the cosmic duality relation

We compare two different probes of the expansion history of the universe, namely, luminosity distances from type Ia supernovae and angular diameter distances from galaxy clusters, using the Bayesian interpretation of Crossing statistic [1,2] in conjunction with the assumption of cosmic duality relation. Our analysis is conducted independently of any a-priori assumptions about the nature of dark energy. The model independent method which we invoke searches for inconsistencies between SNIa and galaxy cluster data sets. If detected such an inconsistency would imply the presence of systematics in either of the two data sets. Simulating observations based on expected WFIRST supernovae data and X-ray eROSITA + SZ Planck cluster data, we show that our method allows one to detect systematics with high precision and without advancing any hypothesis about the nature of dark energy.

79 ASTRONOMY AND ASTROPHYSICS↗

Encyclopædia curvatonis

We investigate whether the predictions of single-field models of inflation are robust under the introduction of additional scalar degrees of freedom, and whether these extra fields change the potentials for which the data show the strongest preference. We study the situation where an extra light scalar field contributes both to the total curvature perturbations and to the reheating kinematic properties. Ten reheating scenarios are identified, and all necessary formulas allowing a systematic computation of the predictions for this class of models are derived. They are implemented in the public library ASPIC, which contains more than 75 single-field potentials. This paves the way for a forthcoming full Bayesian analysis of the problem. A few representative examples are displayed and discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

The Kalai-Smorodinsky solution for many-objective Bayesian optimization

An ongoing aim of research in multiobjective Bayesian optimization is to extend its applicability to a large number of objectives. While coping with a limited budget of evaluations, recovering the set of optimal compromise solutions generally requires numerous observations and is less interpretable since this set tends to grow larger with the number of objectives. We thus propose to focus on a specific solution originating from game theory, the Kalai-Smorodinsky solution, which possesses attractive properties. In particular, it ensures equal marginal gains over all objectives. We further make it insensitive to a monotonic transformation of the objectives by considering the objectives in the copula space. A novel tailored algorithm is proposed to search for the solution, in the form of a Bayesian optimization algorithm: sequential sampling decisions are made based on acquisition functions that derive from an instrumental Gaussian process prior. Our approach is tested on four problems with respectively four, six, eight, and nine objectives. The method is available in the R package GPGame available on CRAN at https://cran.r-project.org/package=GPGame.

Game theory↗

Real-time cure monitoring of fiber-reinforced polymer composites using infrared thermography and recursive Bayesian filtering

Despite the desirable characteristics of fiber-reinforced polymer (FRP) composites, their utilization in high volume production industries is limited by a lack of efficient manufacturing techniques. Monitoring the curing process of these composites can help with improving the quality and efficiency of the manufacturing process. This article discusses a method that uses Kalman-filter-based fusion of the information obtained from infrared thermography (surface temperature measurements) and a heat conduction model to estimate degrees of cure and internal temperatures of curing FRP composite parts in real time. The effectiveness of the methodology is demonstrated by successfully monitoring the curing of an FRP composite part in a laboratory experiment. Finally, the proposed methodology is a crucial step towards identifying anomalies in the curing process that negatively impact the quality of FRP composite parts.

36 MATERIALS SCIENCE↗

Accurate and Accelerated Neuromorphic Network Design Leveraging A Bayesian Hyperparameter Pareto Optimization Approach

Neuromorphic systems allow for extremely efficient hardware implementations for neural networks (NNs). In recent years, several algorithms have been presented to train spiking NNs (SNNs) for neuromorphic hardware. However, SNNs often provide lower accuracy than their artificial NNs (ANNs) counterparts or require computationally expensive and slow training/inference methods. To close this gap, designers typically rely on reconfiguring SNNs through adjustments in the neuron/synapse model or training algorithm itself. Nevertheless, these steps incur significant design time, while still lacking the desired improvement in terms of training/inference times (latency). Designing SNNs that can mimic the accuracy of ANNs with reasonable training times is an exigent challenge in neuromorphic computing. In this work, we present an alternative approach that looks at such designs as an optimization problem rather than algorithm or architecture redesign. We develop a versatile multiobjective hyperparameter optimization (HPO) for automatically tuning HPs of two state-of-the-art SNN training algorithms, SLAYER and HYBRID. We emphasize that, to the best of our knowledge, this is the first work trying to improve SNNs’ computational efficiency, accuracy, and training time using an efficient HPO. We demonstrate significant performance improvements for SNNs on several datasets without the need to redesign or invent new training algorithms/architectures. Our approach results in more accurate networks with lower latency and, in turn, higher energy efficiency than previous implementations. In particular, we demonstrate improvement in accuracy and more than 5× reduction in the training/inference time for the SLAYER algorithm on the DVS Gesture dataset. In the case of HYBRID, we demonstrate 30% reduction in timesteps while surpassing the accuracy of the state-of-the-art networks on CIFAR10. Further, our analysis suggests that even a seemingly minor change in HPs could change the accuracy by 5 - 6×.

Parsa, Maryam↗

General Bayesian Inference over the Stiefel Manifold via the Givens Transform

We introduce here an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We demonstrate how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

97 MATHEMATICS AND COMPUTING↗

Monte Carlo Global QCD Analyses of the Pion Parton Distribution Functions

As the lightest hadron, the pion presents itself as a dichotomy. While being the pseudo Goldstone boson associated with chiral symmetry breaking, it is simultaneously regarded as the lightest pseudoscalar meson typically composed of constituent quark and antiquark. As the chiral symmetry shares the same global symmetry as QCD, studying the pion and its internal structure is key in understanding one of the four fundamental forces of nature, namely the quantum chromodynamic strong interaction. We study the pion's parton distribution functions (PDFs), which are universal quantities that describe the structure of the pion in terms of its constituent quarks, antiquarks, and gluons. Our goal is to discover what the available data reveal for these universal quantities, namely the PDFs. Through the use of factorization theorems and perturbative QCD, we use Monte Carlo (MC) methods to extract the PDFs from the available Drell-Yan (DY) and leading neutron (LN) data. While the DY process involves two hadrons colliding, the LN electroproduction involves an electron beam incident on a target nucleon. We can constrain well the pion PDFs at large momentum fraction using DY data, and at low momentum fraction using LN data. We also use threshold resummation in the DY process to gather predictable higher order terms associated with the soft gluon radiation because their contributions to the cross section are nontrivial. In this dissertation, we parametrize the pion PDFs and fit those parameters to the available data. We make use of Bayesian inference and use MC techniques to sample the parameter space. Three sets of results are presented. We first extract the pion PDFs by fitting the DY and LN data. Then, we include transverse momentum dependent DY data in conjunction with the DY and LN data to extract the pion PDFs. Finally, we apply various methods of threshold resummation to the DY cross section and extract pion PDFs. The pion PDFs presented here are the first global QCD analyses performed as well as the first MC extracted pion PDFs, which are at the forefront of the pion PDF community.

Barry, Patrick↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗

Quantifying prediction fidelity in multiscale multiphysics simulations.

Multiscale multiphysics problems arise in a host of application areas of significant relevance to DOE, including electrical storage systems (membranes and electrodes in fuel cells, batteries, and ultracapacitors), water surety, chemical analysis and detection systems, and surface catalysis. Multiscale methods aim to provide detailed physical insight into these complex systems by incorporating coupled effects of relevant phenomena on all scales. However, many sources of uncertainty and modeling inaccuracies hamper the predictive fidelity of multiscale multiphysics simulations. These include parametric and model uncertainties in the models on all scales, and errors associated with coupling, or information transfer, across scales/physics. This presentation introduces our work on the development of uncertainty quantification methods for spatially decomposed atomistic-to-continuum (A2C) multiscale simulations. The key thrusts of this research effort are: inference of uncertain parameters or observables from experimental or simulation data; propagation of uncertainty through particle models; propagation of uncertainty through continuum models; propagation of information and uncertainty across model/scale interfaces; and numerical and computational analysis and control. To enable the bidirectional coupling between the atomistic and continuum simulations, a general formulation has been developed for the characterization of sampling noise due to intrinsic variability in particle simulations, and for the propagation of both this sampling noise and parametric uncertainties through coupled A2C multiscale simulations. Simplified tests of noise quantification in particle computations are conducted through Bayesian inference of diffusion rates in an idealized isothermal binary material system. A proof of concept is finally presented based on application of the present formulation to the propagation of uncertainties in a model plane Couette flow, where the near wall region is handled with molecular dynamics while the bulk region is handled with continuum methods.

30 DIRECT ENERGY CONVERSION↗

Multi-Detection Events, Probability Density Functions, and Reduced Location Area

Abstract Several efforts have been made in the Comprehensive Nuclear-Test-Ban Treaty (CTBT) community to assess the benefits of combining detections of radionuclides to improve the location estimates available from atmospheric transport modeling (ATM) backtrack calculations. We present a Bayesian estimation approach rather than a simple dilution field of regard approach to allow xenon detections and non-detections to be combined mathematically. This system represents one possible probabilistic approach to radionuclide event formation. Application of this method to a recent interesting radionuclide event shows a substantial reduction in the location uncertainty of that event.

atmospheric modeling↗

COMPARING X-RAY AND DYNAMICAL MASS PROFILES IN THE EARLY-TYPE GALAXY NGC 4636

We present the results of an X-ray mass analysis of the early-type galaxy NGC 4636, using Chandra data. We have compared the X-ray mass density profile with that derived from a dynamical analysis of the system's globular clusters (GCs). Given the observed interaction between the central active galactic nucleus and the X-ray emitting gas in NGC 4636, we would expect to see a discrepancy in the masses recovered by the two methods. Such a discrepancy exists within the central approx10 kpc, which we interpret as the result of non-thermal pressure support or a local inflow. However, over the radial range approx10-30 kpc, the mass profiles agree within the 1sigma errors, indicating that even in this highly disturbed system, agreement can be sought at an acceptable level of significance over intermediate radii, with both methods also indicating the need for a dark matter halo. However, at radii larger than 30 kpc, the X-ray mass exceeds the dynamical mass, by a factor of 4-5 at the largest disagreement. A Fully Bayesian Significance Test finds no statistical reason to reject our assumption of velocity isotropy, and an analysis of X-ray mass profiles in different directions from the galaxy center suggests that local disturbances at large radius are not the cause of the discrepancy. We instead attribute the discrepancy to the paucity of GC kinematics at large radius, coupled with not knowing the overall state of the gas at the radius where we are reaching the group regime (>30 kpc), or a combination of the two.

79 ASTRONOMY AND ASTROPHYSICS↗

The molecular architecture of the yeast spindle pole body core determined by Bayesian integrative modeling

Microtubule-organizing centers (MTOCs) form, anchor, and stabilize the polarized network of microtubules in a cell. The central MTOC is the centrosome that duplicates during the cell cycle and assembles a bipolar spindle during mitosis to capture and segregate sister chromatids. Yet, despite their importance in cell biology, the physical structure of MTOCs is poorly understood. Here we determine the molecular architecture of the core of the yeast spindle pole body (SPB) by Bayesian integrative structure modeling based on in vivo fluorescence resonance energy transfer (FRET), small-angle x-ray scattering (SAXS), x-ray crystallography, electron microscopy, and two-hybrid analysis. The model is validated by several methods that include a genetic analysis of the conserved PACT domain that recruits Spc110, a protein related to pericentrin, to the SPB. The model suggests that calmodulin can act as a protein cross-linker and Spc29 is an extended, flexible protein. The model led to the identification of a single, essential heptad in the coiled-coil of Spc110 and a minimal PACT domain. It also led to a proposed pathway for the integration of Spc110 into the SPB.

59 BASIC BIOLOGICAL SCIENCES↗

PRIME

SAND2021-0565 O PRIME is a modeling framework designed for the real-time characterization and forecasting of partially observed epidemics. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. Examples are provided using publicly available COVID-19 data. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Safta, Cosmin↗

Iterative HOMER with uncertainties

We present iHOMER, an iterative version of the HOMER method to extract Lund fragmentation functions from experimental data. Through iterations, we address the information gap between latent and observable phase spaces and systematically remove bias. To quantify uncertainties on the inferred weights, we use a combination of Bayesian neural networks and uncertainty-aware regression. We find that the combination of iterations and uncertainty quantification produces well-calibrated weights that accurately reproduce the data distribution. A parametric closure test shows that the iteratively learned fragmentation function is compatible with the true fragmentation function.

Butter, Anja [Heidelberg Univ. (Germany); Sorbonne↗

An initial framework for the rapid qualification of long-term creep rupture strength via microstructural modeling

This report describes the development and testing of a new method for extrapolating short-term creep rupture test data to predict long-term rupture strength. The goal of this work is to reduce the time required to qualify new materials for nuclear service by reducing the lead time required for dedicated, long-term material testing to establish key long-term material properties. The new approach described here uses a physics-based model to predict the long-term creep rupture strength of 316H stainless steel using only short-term test data. The key idea is to use Bayesian inference to find the statistical distribution of the model parameters that best explain the short-term rupture data. Because the model is physics-based these parameters are all microstructural quantities that can be measured through detailed material characterization experiments. The Bayesian prior distributions provide a means for incorporating this characterization data into the final model to improve the accuracy of the long-term model predictions. However, where such data is not available the process still produces an accurate model based on an uniformed prior. Our hypothesis is that this approach more accurately extrapolates the short-term test data when compared to current, empirical methods. The report proves this hypothesis using actual long-term rupture data available for 316H, including tests with rupture times greater than 200,000 hours. The general approach developed here could be applied to other materials and other time-dependent material properties. Applying this new technique to develop long-term qualified material properties, potentially in conjunction with other accelerated qualification approaches like staggered qualification test programs, could greatly reduce the time required to qualify new materials for nuclear service.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Differentially Private Synthesis and Sharing of Network Data Via Bayesian Exponential Random Graph Models

Abstract Network data often contain sensitive relational information. One approach to protecting sensitive information while offering flexibility for network analysis is to share synthesized networks based on the information in originally observed networks. We employ differential privacy (DP) and exponential random graph models (ERGMs) and propose the DP-ERGM method to synthesize network data. We apply DP-ERGM to two real-world networks. We then compare the utility of synthesized networks generated by DP-ERGM, the DyadWise Randomized Response (DWRR) approach, and the Synthesis through Conditional distribution of Edge given nodal Attribute (SCEA) approach. In general, the results suggest that DP-ERGM preserves the original information significantly better than two other approaches in network structural statistics and inference for ERGMs and latent space models. Furthermore, DP-ERGM satisfies node DP through modeling the global network structure with ERGM, a stronger notion of privacy than the edge DP under which DWRR and SCEA operate.

graph synthesis↗

Machine learning enhanced characterization and optimization of photonic cured MAPbI 3 for efficient perovskite solar cells

Photonic curing (PC) can facilitate high-speed perovskite solar cell (PSC) manufacturing because it uses high-intensity light pulses to crystallize perovskite films in milliseconds. However, optimizing PC conditions is challenging due to its many variables, and using power conversion efficiency (PCE) as the optimization metric is both time-consuming and labor-intensive. This work presents a machine learning (ML) approach to optimize PC conditions for fabricating methylammonium lead iodide (MAPbI 3 ) films by quantitatively comparing their ultraviolet-visible (UV-vis) absorbance spectra to thermal annealed (TA) films using four similarity metrics. We perform Bayesian optimization coupled with Gaussian process regression (BO-GP) to minimize the similarity metrics. Refining PC conditions using active learning based on BO-GP models, we achieve a PC MAPbI3 film with an absorbance spectrum closely matching a TA reference film, which is further verified by its crystalline and morphological properties. Thus, we demonstrate that the UV-vis absorption spectrum can accurately proxy film quality. Additionally, we use an AI-based segmentation model for a more efficient grain size analysis. However, when we use the optimized PC condition to fabricate PSCs, we find that interaction between MAPbI 3 and the hole transport layer (HTL) during PC critically degrades the PSC performance. By adding a buffer layer between the HTL and MAPbI 3 , the optimized PC PSCs produce a champion PCE of 11.8%, comparable to the TA reference of 11.7%. Using UV-vis similarity metrics instead of device PCE as the objective in our BO-GP method accelerates the optimization of PC processing conditions for MAPbI 3 films.

14 SOLAR ENERGY↗