Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Event generator tuning using Bayesian optimization

Monte Carlo event generators contain a large number of parameters that must be determined by comparing the output of the generator with experimental data. Generating enough events with a fixed set of parameter values to enable making such a comparison is extremely CPU intensive, which prohibits performing a simple brute-force grid-based tuning of the parameters. Bayesian optimization is a powerful method designed for such black-box tuning applications. In this article, we show that Monte Carlo event generator parameters can be accurately obtained using Bayesian optimization and minimal expert-level physics knowledge. A tune of the PYTHIA 8 event generator using $e^+e^-$ events, where 20 parameters are optimized, can be run on a modern laptop in just two days. Combining the Bayesian optimization approach with expert knowledge should enable producing better tunes in the future, by making it faster and easier to study discrepancies between Monte Carlo and experimental data.

47 OTHER INSTRUMENTATION↗

FUZZY SUPERNOVA TEMPLATES. I. CLASSIFICATION

Modern supernova (SN) surveys are now uncovering stellar explosions at rates that far surpass what the world's spectroscopic resources can handle. In order to make full use of these SN data sets, it is necessary to use analysis methods that depend only on the survey photometry. This paper presents two methods for utilizing a set of SN light-curve templates to classify SN objects. In the first case, we present an updated version of the Bayesian Adaptive Template Matching program (BATM). To address some shortcomings of that strictly Bayesian approach, we introduce a method for Supernova Ontology with Fuzzy Templates (SOFT), which utilizes fuzzy set theory for the definition and combination of SN light-curve models. For well-sampled light curves with a modest signal-to-noise ratio (S/N >10), the SOFT method can correctly separate thermonuclear (Type Ia) SNe from core collapse SNe with >=98% accuracy. In addition, the SOFT method has the potential to classify SNe into sub-types, providing photometric identification of very rare or peculiar explosions. The accuracy and precision of the SOFT method are verified using Monte Carlo simulations as well as real SN light curves from the Sloan Digital Sky Survey and the SuperNova Legacy Survey. In a subsequent paper, the SOFT method is extended to address the problem of parameter estimation, providing estimates of redshift, distance, and host galaxy extinction without any spectroscopy.

79 ASTRONOMY AND ASTROPHYSICS↗

Parameter Estimation and Uncertainty Quantification for Systems Biology Models

Mathematical models can provide quantitative insights into immunoreceptor signaling, and other biological processes, but require parameterization and uncertainty quantification before reliable predictions become possible. We review currently available methods and software tools to address these problems. We consider gradient-based and gradient-free methods for point estimation of parameter values, and methods of profile likelihood, bootstrapping, and Bayesian inference for uncertainty quantification. We consider recent and potential future applications of these methods to systems-level modeling of immune-related phenomena.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian approach for three-dimensional aquifer characterization at the Hanford 300 Area

This study presents a stochastic, three-dimensional characterization of a heterogeneous hydraulic conductivity field within DOE's Hanford 300 Area site, Washington, by assimilating large-scale, constant-rate injection test data with small-scale, three-dimensional electromagnetic borehole flowmeter (EBF) measurement data. We first inverted the injection test data to estimate the transmissivity field, using zeroth-order temporal moments of pressure buildup curves. We applied a newly developed Bayesian geostatistical inversion framework, the method of anchored distributions (MAD), to obtain a joint posterior distribution of geostatistical parameters and local log-transmissivities at multiple locations. The unique aspects of MAD that make it suitable for this purpose are its ability to integrate multi-scale, multi-type data within a Bayesian framework and to compute a nonparametric posterior distribution. After we combined the distribution of transmissivities with depth-discrete relative-conductivity profile from EBF data, we inferred the three-dimensional geostatistical parameters of the log-conductivity field, using the Bayesian model-based geostatistics. Such consistent use of the Bayesian approach throughout the procedure enabled us to systematically incorporate data uncertainty into the final posterior distribution. The method was tested in a synthetic study and validated using the actual data that was not part of the estimation. Results showed broader and skewed posterior distributions of geostatistical parameters except for the mean, which suggests the importance of inferring the entire distribution to quantify the parameter uncertainty.

Murakami, Haruko↗

Application of Covariances to Fast Reactor Core Analysis

In the present paper, the current status of covariance applications to fast reactor analysis and design is summarized with actual examples. The covariance applications are classified into three fields. First, covariances are used to quantify the uncertainty of nuclear core parameters such as criticality, control rod worth, reaction rate ratio, power distribution, sodium void reactivity, etc. The special features of the Japanese case are to include both the burnup-related parameters such as burnup reactivity loss or fuel composition changes, and the temperature-related parameter, that is, the Doppler reactivity. Second, covariances are used to select the important nuclides, reactions and energy ranges which are dominant to the uncertainty of core parameters, and to give nuclear scientists recommendations to improve the accuracy of the data. Finally, covariances are used to improve the accuracy of core design values by adopting the integral data such as the critical experiments and the power reactor operation data. The way toward improvement is classified into the conventional E/C (Experiment/Calculation) bias method and the more comprehensive cross section adjustment based on the Bayesian theorem and the generalized least square method. In Japan, an adjusted group-constant set, ADJ2000R, is now being used in the design work for future fast reactors.

99 GENERAL AND MISCELLANEOUS↗

A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description

A novel framework is proposed for the bulk parameterization of rain microphysics: the Bayesian Observationally Constrained Statistical–Physical Scheme (BOSS). It is designed to facilitate direct constraint by observations using Bayesian inference. BOSS combines existing process-level microphysical knowledge with flexible process rate formulations and parameters constrained by observations within a Bayesian framework. Furthermore, using a raindrop size distribution (DSD) normalization method that relates DSD moments to one another via generalized power series, generalized multivariate power expressions are derived for the microphysical process rates as functions of a set of prognostic DSD moments. The scheme is flexible and can utilize any number and combination of prognostic moments and any number of terms in the process rate formulations. This means that both uncertainty in parameter values and structural uncertainty associated with the process rate formulations can be investigated systematically, which is not possible using traditional schemes. In this paper, BOSS is compared to two- and three-moment versions of a traditional bulk rain microphysics scheme (denoted as MORR). It is demonstrated that some process formulations in MORR are analytically equivalent to the generalized power expressions in BOSS using one or two terms, while others are not. BOSS is able to replicate the behavior of MORR in idealized one-dimensional rainshaft tests, but with a much more flexible and systematic design. Part II of this study describes the application of BOSS to derive rain microphysical process rates and posterior parameter distributions in Bayesian experiments using Markov chain Monte Carlo sampling constrained by synthetic observations.

58 GEOSCIENCES↗

γ-Ray spectroscopy using a binned likelihood approach

The measurement of a reaction cross section from a pulse height spectrum is a ubiquitous problem in experimental nuclear physics. In γ-ray spectroscopy, this is accomplished frequently by measuring the intensity of full-energy primary transition peaks and correcting the intensities for experimental artifacts, such as detection efficiencies and angular correlations. Implicit in this procedure is the assumption that full-energy peaks do not overlap with any secondary peaks, escape peaks, or environmental back- grounds. However, for complex γ-ray cascades, this is often not the case. Furthermore, this technique is difficult to adapt for coincidence spectroscopy, where intensities depend not only on the detection efficiency, but also the detailed decay scheme. We present a method that incorporates the intensities of the entire spectrum (e.g., primary and secondary transition peaks, escape peaks, Compton continua, etc.) into a statistical model, where the transition intensities and branching ratios can be determined using Bayesian statistical inference. This new method provides an elegant solution to the difficulties associated with analyzing coincidence spectra. Finally, we describe it in detail and examine its efficacy in the analysis of 18 O(p,γ) 19 F and 25 Mg(p,γ) 26 Al resonance data. For the 18 O(p,γ) 19 F reaction, the measured branching ratios improve upon the literature values, with a factor of 3 reduction in the uncertainties.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The dependence of the gradients of oxygen and nitrogen-to-oxygen on stellar age in MaNGA galaxies

For this work, we derived the oxygen abundance (O/H), the nitrogen-to-oxygen (N/O) abundance ratio, and their corresponding radial gradients for a sample of 1431 galaxies from the MaNGA DR15 survey using two different realisations of the strong line method: empirical R calibration and the Bayesian model-based HII-CHI-MISTRY (HCM) code. We find that both abundance calculation methods reveal a correlation between the O/H gradient and the stellar mass of a galaxy. This relation is non-linear, with the steepest average gradients in the intermediate mass range and flatter average gradients for high- and low-mass galaxies. The relation between the N/O gradient and the stellar mass is, on average, non-linear with the steepest gradients in the intermediate mass range (log(M/M ⊙ )~10), flatter gradients for high-mass galaxies, and the flattest gradients for low-mass galaxies. However, the general trend of steepening N/O gradients for higher masses, as reported in previous studies, remains evident. We find a dependence between the O/H and N/O gradients and the galaxy mean stellar age traced by the D(4000) index. For galaxies of lower masses, both gradients are, generally, steeper for intermediate values of D(4000) and flatter for low and high values of D(4000). Only the most massive galaxies do not show this correlation. We interpret this behaviour as an evolution of the metallicity gradients with the age of stellar population. Though the galaxies with a positive slope of the D(4000) radial gradient tend to have flatter O/H and N/O gradients, as compared to those with a negative D(4000) gradient.

79 ASTRONOMY AND ASTROPHYSICS↗

A Wise census of young stellar objects in the Perseus OB2 association

We have performed a Wide-Field Infrared Survey Explorer based study to identify and characterize young stellar objects (YSOs) in the 12° × 12° Perseus OB2 association. A spectral energy distribution (SED) slope in the range of 3.4–12 μm and 5σ selection criteria were used to select our initial sample. Further manual inspection reduced our final catalog to 156 known and 119 YSO candidates. The spatial distribution of newly found YSOs all over the field shows an older generation of star formation in which most of its massive members have evolved into main-sequence stars. In contrast, the majority of younger members lie within the Perseus molecular cloud and currently active star-forming clusters such as NGC 1333 and IC 348. We also identified an additional 66 point sources that passed YSO selection criteria but are likely AGB stars. However, their spatial distribution suggests that they may contain a fraction of the YSOs. Comparing our results with the commonly used color–color selections, we found that while the color selection method fails in picking up bright but evolved weak disks, our SED fitting method can identify such sources, including transitional disks. In addition, we have less contamination with background sources such as galaxies, but at a price of losing fainter (J{sub mag}>12) YSOs. Finally, we employed a Bayesian Monte Carlo SED fitting method to determine the characteristics of each YSO candidate. Distribution of SED slopes and model-driven age and mass confirms separated YSO populations with three suggested age groups of younger than 1 Myr old, 1–5 Myr old, and older than 5 Myr, which agrees with the age of the Per OB2 association and currently star-forming sites within the cloud.

79 ASTRONOMY AND ASTROPHYSICS↗

A Transferrable Belief Model Representation for Physical Security of Nuclear Materials

This work analyzed various probabilistic methods such as classic statistics, Bayesian inference, possibilistic theory, and Dempster-Shafer theory of belief functions for the potential insight offered into the physical security of nuclear materials as well as more broad application to nuclear non-proliferation automated decision making theory. A review of the fundamental heuristic and basic limitations of each of these methods suggested that the Dempster-Shafer theory of belief functions may offer significant capability. Further examination of the various interpretations of Dempster-Shafer theory, such as random set, generalized Bayesian, and upper/lower probability demonstrate some limitations. Compared to the other heuristics, the transferrable belief model (TBM), one of the leading interpretations of Dempster-Shafer theory, can improve the automated detection of the violation of physical security using sensors and human judgment. The improvement is shown to give a significant heuristic advantage over other probabilistic options by demonstrating significant successes for several classic gedanken experiments.

97 MATHEMATICS AND COMPUTING↗

Isotope partitioning of soil respiration: A Bayesian solution to accommodate multiple sources of variability

Isotopic methods offer great potential for partitioning trace gas fluxes such as soil respiration into their different source contributions. Traditional partitioning methods face challenges due to variability introduced by different measurement methods, fractionation effects, and end-member uncertainty. To address these challenges, we describe in this paper a hierarchical Bayesian (HB) approach for isotopic partitioning of soil respiration that directly accommodates such variability. We apply our HB method to data from an experiment conducted in a shortgrass steppe ecosystem, where decomposition was previously shown to be stimulated by elevated CO 2 . Our approach simultaneously fits Keeling plot (KP) models to observations of soil or soil-respired δ 13 C and [CO 2 ] obtained via chambers and gas wells, corrects the KP intercepts for apparent fractionation (Δ) due to isotope-specific diffusion rates and/or method artifacts, estimates method- and treatment-specific values for Δ, propagates end-member uncertainty, and calculates proportional contributions from two distinct respiration sources (“old” and “new” carbon). The chamber KP intercepts were estimated with greater confidence than the well intercepts and compared to the theoretical value of 4.4‰, our results suggest that Δ varies between 2 and 5.2‰ depending on method (chambers versus wells) and CO 2 treatment. Because elevated CO 2 plots were fumigated with 13 C-depleted CO 2 , the source contributions were tightly constrained, and new C accounted for 64% (range = 55–73%) of soil respiration. The contributions were less constrained for the ambient CO 2 treatments, but new C accounted for significantly less (47%, range = 15–82%) of soil respiration. Finally, our new HB partitioning approach contrasts our original analysis (higher contribution of old C under elevated CO 2 ) because it uses additional data sources, accounts for end-member bias, and estimates apparent fractionation effects.

54 ENVIRONMENTAL SCIENCES↗

Three-Dimensional Bayesian Geostatistical Aquifer Characterization at the Hanford 300 Area using Tracer Test Data

Tracer testing under natural or forced gradient flow holds the potential to provide useful information for characterizing subsurface properties, through monitoring, modeling and interpretation of the tracer plume migration in an aquifer. Non-reactive tracer experiments were conducted at the Hanford 300 Area, along with constant-rate injection tests and electromagnetic borehole flowmeter (EBF) profiling. A Bayesian data assimilation technique, the method of anchored distributions (MAD) [Rubin et al., 2010], was applied to assimilate the experimental tracer test data with the other types of data and to infer the three-dimensional heterogeneous structure of the hydraulic conductivity in the saturated zone of the Hanford formation. In this study, the Bayesian prior information on the underlying random hydraulic conductivity field was obtained from previous field characterization efforts using the constant-rate injection tests and the EBF data. The posterior distribution of the conductivity field was obtained by further conditioning the field on the temporal moments of tracer breakthrough curves at various observation wells. MAD was implemented with the massively-parallel three-dimensional flow and transport code PFLOTRAN to cope with the highly transient flow boundary conditions at the site and to meet the computational demands of MAD. A synthetic study proved that the proposed method could effectively invert tracer test data to capture the essential spatial heterogeneity of the three-dimensional hydraulic conductivity field. Application of MAD to actual field data shows that the hydrogeological model, when conditioned on the tracer test data, can reproduce the tracer transport behavior better than the field characterized without the tracer test data. This study successfully demonstrates that MAD can sequentially assimilate multi-scale multi-type field data through a consistent Bayesian framework.

54 ENVIRONMENTAL SCIENCES↗

Data from: Comparing traditional and Bayesian approaches to ecological meta-analysis

Despite the wide application of meta-analysis in ecology, some of the traditional methods used for meta-analysis may not perform well given the type of data characteristic of ecological meta-analyses. We reviewed published meta-analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies (ni) and the number of studies or records (k) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta-analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that ni and k were highly variable, distributions were right-skewed, and were generally small (median ni =5, median k=44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval based on the t-distribution that uses an adjusted standard error (the Hartung-Knapp-Sidik-Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z-distribution confidence intervals had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta-analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random-effects meta-analysis, the performance of the best frequentist and Bayesian methods were similar for the same combinations of factors (k and mean replication), though the Bayesian approaches had higher than nominal (>95%) coverage for the mean effect when k was very low (k<15). Our literature review suggests that many meta-analyses that used z-distribution or bootstrapping confidence intervals may have over-estimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta-analyses.

54 ENVIRONMENTAL SCIENCES↗

Joint Data Filtering and Labeling Using Gaussian Processes and Alternating Direction Method of Multipliers

Here, sequence labeling aims at assigning a label to every sample of a signal (or pixel of an image) while considering the sequentiality (or vicinity) of the samples. To perform this task, many works in the literature first filter and then label the data. Unfortunately, the filtering, which is performed independently from the labeling, is far from optimal and frequently makes the latter task harder. In this paper, a novel approach that trains a Gaussian process classifier and estimates the coefficients of an optimal filter jointly is presented. The new approach, based on Bayesian modeling and alternating direction method of multipliers (ADMMs) optimization, performs both tasks simultaneously. All unknowns are treated as stochastic variables, which are estimated using variational inference and filtering and labeling are linked with the use of ADMM. In the experimental section, synthetic and real experiments are presented to compare the proposed method with other existing approaches.

97 MATHEMATICS AND COMPUTING↗

Using Bayesian Networks for Sensitivity Analysis of Complex Biogeochemical Models

Sensitivity analysis is a vital tool in numerical modeling to identify important parameters and processes that contribute to the overall uncertainty in model outputs. We developed a new sensitivity analysis method to quantify the relative importance of uncertain model processes that contain multiple uncertain parameters. The method is based on the concepts of Bayesian networks (BNs) to account for complex hierarchical uncertainty structure of a model system. We derived a new set of sensitivity indices using the methodology of variance-based global sensitivity analysis with the Bayesian inference. The framework is capable of representing the detailed uncertainty information of a complex model system using BNs and affords flexible grouping of different uncertain inputs given their characteristics and dependency structures. We have implemented the method on a real-world biogeochemical model at the groundwater-surface water interface within the Hanford Site’s 300 Area. The uncertainty sources of the model were first grouped into forcing scenario and three different processes based on our understanding of the complex system. The sensitivity analysis results indicate that both the reactive transport and groundwater flow processes are important sources of uncertainty for carbon-consumption predictions. Within the groundwater flow process, the structure of geological formations is more important than the permeability heterogeneity within a given geological formation. Our new sensitivity analysis framework based on BNs offers substantial flexibility for investigating the importance of combinations of interacting uncertainty sources in a hierarchical order, and it is expected to be applicable to a wide range of multi-physics models for complex systems.

Dai, Heng↗

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗

Variational Bayesian Blind Image Deconvolution: A review

In this study, we provide a review of the recent literature on Bayesian Blind Image Deconvolution (BID) methods. We believe that two events have marked the recent history of BID: the predominance of Variational Bayes (VB) inference as a tool to solve BID problems and the increasing interest of the computer vision community in solving BID problems. VB inference in combination with recent image models like the ones based on Super Gaussian (SG) and Scale Mixture of Gaussians (SMG) representations have led to the use of very general and powerful tools to provide clear images from blurry observations. In the provided review emphasis is paid on VB inference and the use of SG and SMG models with coverage of recent advances in sampling methods. We also provide examples of current state of the art BID methods and discuss problems that very likely will mark the near future of BID.

97 MATHEMATICS AND COMPUTING↗

Attributing runoff changes to climate variability and human activities: Uncertainty analysis using four monthly water balance models

Hydrological simulations to delineate the impacts of climate variability and human activities are subjected to uncertainties related to both parameter and structure of the hydrological models. To analyze the impact of these uncertainties on the model performance and to yield more reliable simulation results, a global calibration and multimodel combination method that integrates the Shuffled Complex Evolution Metropolis (SCEM) and Bayesian Model Averaging (BMA) of four monthly water balance models was proposed. The method was applied to the Weihe River Basin (WRB), the largest tributary of the Yellow River, to determine the contribution of climate variability and human activities to runoff changes. The change point, which was used to determine the baseline period (1956-1990) and human-impacted period (1991-2009), was derived using both cumulative curve and Pettitt’s test. Results show that the combination method from SCEM provides more skillful deterministic predictions than the best calibrated individual model, resulting in the smallest uncertainty interval of runoff changes attributed to climate variability and human activities. This combination methodology provides a practical and flexible tool for attribution of runoff changes to climate variability and human activities by hydrological models.

runoff change, uncertainty assessment, monthly wat↗