Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Statistically Rigorous Uncertainty Quantification for Physical Parameter Model Calibration with Functional Output

In experiments conducted on the Z-machine at Sandia National Laboratories, dynamic material properties cannot be analyzed using traditional analytic methods, necessitating solving an inverse problem. Bayesian model calibration is a statistical framework for solving an inverse problem to estimate parameters input into a computational model in the presence of multiple uncertainties. Disentangling input parameter uncertainty and model misspecification is often poorly identified problem. When using computational models for physical parameter estimation, the issue of parameter identifiability must be carefully considered to obtain accurate and precise estimates of physical parameters. Additionally, in dynamic material properties applications, the experimental output is a function, velocity over time. While we can sample an arbitrarily large number of points from the measured velocity, these curves only contain a finite amount of information about the calibration parameters. In this report, we propose modifications to the Bayesian model calibration framework to simplify and improve the estimation of physical parameters with functional outputs. Specifically, we propose scaling the likelihood function by an effective sample size rather than modeling the discrepancy function; and modularizing input nuisance parameters with weakly identified parameters. We evaluate the performance of these proposed methods using a statistical simulation study and then apply these methods to estimate parameters of the tantalum equation of state. We conclude that these proposed methods can provide simple, fast, and statistically valid alternatives to the full Bayesian model calibration procedure; and that these methods can be used to estimate parameters of the equation of state for tantalum.

97 MATHEMATICS AND COMPUTING↗

A METHOD FOR INDIVIDUAL SOURCE BRIGHTNESS ESTIMATION IN SINGLE- AND MULTI-BAND DATA

We present a method of reliable extraction of the flux of individual sources from sky maps in the presence of noise and a source population in which number counts are a steeply falling function of flux. The method is an extension of a standard Bayesian procedure in the millimeter/submillimeter literature. As in the standard method, the prior applied to source flux measurements is derived from an estimate of the source counts as a function of flux, dN/dS. The key feature of the new method is that it enables reliable extraction of properties of individual sources, which previous methods in the literature do not. We first present the method for extracting individual source fluxes from data in a single observing band, then we extend the method to multiple bands, including prior information about the spectral behavior of the source population(s). The multi-band estimation technique is particularly relevant for classifying individual sources into populations according to their spectral behavior. We find that proper treatment of the correlated prior information between observing bands is key to avoiding significant biases in estimations of multi-band fluxes and spectral behavior, biases which lead to significant numbers of misclassified sources. We test the single- and multi-band versions of the method using simulated observations with observing parameters similar to that of the South Pole Telescope data used in Vieira et al.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning

Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. Here, the discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Event generator tuning using Bayesian optimization

Monte Carlo event generators contain a large number of parameters that must be determined by comparing the output of the generator with experimental data. Generating enough events with a fixed set of parameter values to enable making such a comparison is extremely CPU intensive, which prohibits performing a simple brute-force grid-based tuning of the parameters. Bayesian optimization is a powerful method designed for such black-box tuning applications. In this article, we show that Monte Carlo event generator parameters can be accurately obtained using Bayesian optimization and minimal expert-level physics knowledge. A tune of the PYTHIA 8 event generator using $e^+e^-$ events, where 20 parameters are optimized, can be run on a modern laptop in just two days. Combining the Bayesian optimization approach with expert knowledge should enable producing better tunes in the future, by making it faster and easier to study discrepancies between Monte Carlo and experimental data.

47 OTHER INSTRUMENTATION↗

FUZZY SUPERNOVA TEMPLATES. I. CLASSIFICATION

Modern supernova (SN) surveys are now uncovering stellar explosions at rates that far surpass what the world's spectroscopic resources can handle. In order to make full use of these SN data sets, it is necessary to use analysis methods that depend only on the survey photometry. This paper presents two methods for utilizing a set of SN light-curve templates to classify SN objects. In the first case, we present an updated version of the Bayesian Adaptive Template Matching program (BATM). To address some shortcomings of that strictly Bayesian approach, we introduce a method for Supernova Ontology with Fuzzy Templates (SOFT), which utilizes fuzzy set theory for the definition and combination of SN light-curve models. For well-sampled light curves with a modest signal-to-noise ratio (S/N >10), the SOFT method can correctly separate thermonuclear (Type Ia) SNe from core collapse SNe with >=98% accuracy. In addition, the SOFT method has the potential to classify SNe into sub-types, providing photometric identification of very rare or peculiar explosions. The accuracy and precision of the SOFT method are verified using Monte Carlo simulations as well as real SN light curves from the Sloan Digital Sky Survey and the SuperNova Legacy Survey. In a subsequent paper, the SOFT method is extended to address the problem of parameter estimation, providing estimates of redshift, distance, and host galaxy extinction without any spectroscopy.

79 ASTRONOMY AND ASTROPHYSICS↗

Parameter Estimation and Uncertainty Quantification for Systems Biology Models

Mathematical models can provide quantitative insights into immunoreceptor signaling, and other biological processes, but require parameterization and uncertainty quantification before reliable predictions become possible. We review currently available methods and software tools to address these problems. We consider gradient-based and gradient-free methods for point estimation of parameter values, and methods of profile likelihood, bootstrapping, and Bayesian inference for uncertainty quantification. We consider recent and potential future applications of these methods to systems-level modeling of immune-related phenomena.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian approach for three-dimensional aquifer characterization at the Hanford 300 Area

This study presents a stochastic, three-dimensional characterization of a heterogeneous hydraulic conductivity field within DOE's Hanford 300 Area site, Washington, by assimilating large-scale, constant-rate injection test data with small-scale, three-dimensional electromagnetic borehole flowmeter (EBF) measurement data. We first inverted the injection test data to estimate the transmissivity field, using zeroth-order temporal moments of pressure buildup curves. We applied a newly developed Bayesian geostatistical inversion framework, the method of anchored distributions (MAD), to obtain a joint posterior distribution of geostatistical parameters and local log-transmissivities at multiple locations. The unique aspects of MAD that make it suitable for this purpose are its ability to integrate multi-scale, multi-type data within a Bayesian framework and to compute a nonparametric posterior distribution. After we combined the distribution of transmissivities with depth-discrete relative-conductivity profile from EBF data, we inferred the three-dimensional geostatistical parameters of the log-conductivity field, using the Bayesian model-based geostatistics. Such consistent use of the Bayesian approach throughout the procedure enabled us to systematically incorporate data uncertainty into the final posterior distribution. The method was tested in a synthetic study and validated using the actual data that was not part of the estimation. Results showed broader and skewed posterior distributions of geostatistical parameters except for the mean, which suggests the importance of inferring the entire distribution to quantify the parameter uncertainty.

Murakami, Haruko↗

A Bayesian Approach for Statistical–Physical Bulk Parameterization of Rain Microphysics. Part I: Scheme Description

A novel framework is proposed for the bulk parameterization of rain microphysics: the Bayesian Observationally Constrained Statistical–Physical Scheme (BOSS). It is designed to facilitate direct constraint by observations using Bayesian inference. BOSS combines existing process-level microphysical knowledge with flexible process rate formulations and parameters constrained by observations within a Bayesian framework. Furthermore, using a raindrop size distribution (DSD) normalization method that relates DSD moments to one another via generalized power series, generalized multivariate power expressions are derived for the microphysical process rates as functions of a set of prognostic DSD moments. The scheme is flexible and can utilize any number and combination of prognostic moments and any number of terms in the process rate formulations. This means that both uncertainty in parameter values and structural uncertainty associated with the process rate formulations can be investigated systematically, which is not possible using traditional schemes. In this paper, BOSS is compared to two- and three-moment versions of a traditional bulk rain microphysics scheme (denoted as MORR). It is demonstrated that some process formulations in MORR are analytically equivalent to the generalized power expressions in BOSS using one or two terms, while others are not. BOSS is able to replicate the behavior of MORR in idealized one-dimensional rainshaft tests, but with a much more flexible and systematic design. Part II of this study describes the application of BOSS to derive rain microphysical process rates and posterior parameter distributions in Bayesian experiments using Markov chain Monte Carlo sampling constrained by synthetic observations.

58 GEOSCIENCES↗

γ-Ray spectroscopy using a binned likelihood approach

The measurement of a reaction cross section from a pulse height spectrum is a ubiquitous problem in experimental nuclear physics. In γ-ray spectroscopy, this is accomplished frequently by measuring the intensity of full-energy primary transition peaks and correcting the intensities for experimental artifacts, such as detection efficiencies and angular correlations. Implicit in this procedure is the assumption that full-energy peaks do not overlap with any secondary peaks, escape peaks, or environmental back- grounds. However, for complex γ-ray cascades, this is often not the case. Furthermore, this technique is difficult to adapt for coincidence spectroscopy, where intensities depend not only on the detection efficiency, but also the detailed decay scheme. We present a method that incorporates the intensities of the entire spectrum (e.g., primary and secondary transition peaks, escape peaks, Compton continua, etc.) into a statistical model, where the transition intensities and branching ratios can be determined using Bayesian statistical inference. This new method provides an elegant solution to the difficulties associated with analyzing coincidence spectra. Finally, we describe it in detail and examine its efficacy in the analysis of 18 O(p,γ) 19 F and 25 Mg(p,γ) 26 Al resonance data. For the 18 O(p,γ) 19 F reaction, the measured branching ratios improve upon the literature values, with a factor of 3 reduction in the uncertainties.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The dependence of the gradients of oxygen and nitrogen-to-oxygen on stellar age in MaNGA galaxies

For this work, we derived the oxygen abundance (O/H), the nitrogen-to-oxygen (N/O) abundance ratio, and their corresponding radial gradients for a sample of 1431 galaxies from the MaNGA DR15 survey using two different realisations of the strong line method: empirical R calibration and the Bayesian model-based HII-CHI-MISTRY (HCM) code. We find that both abundance calculation methods reveal a correlation between the O/H gradient and the stellar mass of a galaxy. This relation is non-linear, with the steepest average gradients in the intermediate mass range and flatter average gradients for high- and low-mass galaxies. The relation between the N/O gradient and the stellar mass is, on average, non-linear with the steepest gradients in the intermediate mass range (log(M/M ⊙ )~10), flatter gradients for high-mass galaxies, and the flattest gradients for low-mass galaxies. However, the general trend of steepening N/O gradients for higher masses, as reported in previous studies, remains evident. We find a dependence between the O/H and N/O gradients and the galaxy mean stellar age traced by the D(4000) index. For galaxies of lower masses, both gradients are, generally, steeper for intermediate values of D(4000) and flatter for low and high values of D(4000). Only the most massive galaxies do not show this correlation. We interpret this behaviour as an evolution of the metallicity gradients with the age of stellar population. Though the galaxies with a positive slope of the D(4000) radial gradient tend to have flatter O/H and N/O gradients, as compared to those with a negative D(4000) gradient.

79 ASTRONOMY AND ASTROPHYSICS↗

A Wise census of young stellar objects in the Perseus OB2 association

We have performed a Wide-Field Infrared Survey Explorer based study to identify and characterize young stellar objects (YSOs) in the 12° × 12° Perseus OB2 association. A spectral energy distribution (SED) slope in the range of 3.4–12 μm and 5σ selection criteria were used to select our initial sample. Further manual inspection reduced our final catalog to 156 known and 119 YSO candidates. The spatial distribution of newly found YSOs all over the field shows an older generation of star formation in which most of its massive members have evolved into main-sequence stars. In contrast, the majority of younger members lie within the Perseus molecular cloud and currently active star-forming clusters such as NGC 1333 and IC 348. We also identified an additional 66 point sources that passed YSO selection criteria but are likely AGB stars. However, their spatial distribution suggests that they may contain a fraction of the YSOs. Comparing our results with the commonly used color–color selections, we found that while the color selection method fails in picking up bright but evolved weak disks, our SED fitting method can identify such sources, including transitional disks. In addition, we have less contamination with background sources such as galaxies, but at a price of losing fainter (J{sub mag}>12) YSOs. Finally, we employed a Bayesian Monte Carlo SED fitting method to determine the characteristics of each YSO candidate. Distribution of SED slopes and model-driven age and mass confirms separated YSO populations with three suggested age groups of younger than 1 Myr old, 1–5 Myr old, and older than 5 Myr, which agrees with the age of the Per OB2 association and currently star-forming sites within the cloud.

79 ASTRONOMY AND ASTROPHYSICS↗

A Transferrable Belief Model Representation for Physical Security of Nuclear Materials

This work analyzed various probabilistic methods such as classic statistics, Bayesian inference, possibilistic theory, and Dempster-Shafer theory of belief functions for the potential insight offered into the physical security of nuclear materials as well as more broad application to nuclear non-proliferation automated decision making theory. A review of the fundamental heuristic and basic limitations of each of these methods suggested that the Dempster-Shafer theory of belief functions may offer significant capability. Further examination of the various interpretations of Dempster-Shafer theory, such as random set, generalized Bayesian, and upper/lower probability demonstrate some limitations. Compared to the other heuristics, the transferrable belief model (TBM), one of the leading interpretations of Dempster-Shafer theory, can improve the automated detection of the violation of physical security using sensors and human judgment. The improvement is shown to give a significant heuristic advantage over other probabilistic options by demonstrating significant successes for several classic gedanken experiments.

97 MATHEMATICS AND COMPUTING↗

Isotope partitioning of soil respiration: A Bayesian solution to accommodate multiple sources of variability

Isotopic methods offer great potential for partitioning trace gas fluxes such as soil respiration into their different source contributions. Traditional partitioning methods face challenges due to variability introduced by different measurement methods, fractionation effects, and end-member uncertainty. To address these challenges, we describe in this paper a hierarchical Bayesian (HB) approach for isotopic partitioning of soil respiration that directly accommodates such variability. We apply our HB method to data from an experiment conducted in a shortgrass steppe ecosystem, where decomposition was previously shown to be stimulated by elevated CO 2 . Our approach simultaneously fits Keeling plot (KP) models to observations of soil or soil-respired δ 13 C and [CO 2 ] obtained via chambers and gas wells, corrects the KP intercepts for apparent fractionation (Δ) due to isotope-specific diffusion rates and/or method artifacts, estimates method- and treatment-specific values for Δ, propagates end-member uncertainty, and calculates proportional contributions from two distinct respiration sources (“old” and “new” carbon). The chamber KP intercepts were estimated with greater confidence than the well intercepts and compared to the theoretical value of 4.4‰, our results suggest that Δ varies between 2 and 5.2‰ depending on method (chambers versus wells) and CO 2 treatment. Because elevated CO 2 plots were fumigated with 13 C-depleted CO 2 , the source contributions were tightly constrained, and new C accounted for 64% (range = 55–73%) of soil respiration. The contributions were less constrained for the ambient CO 2 treatments, but new C accounted for significantly less (47%, range = 15–82%) of soil respiration. Finally, our new HB partitioning approach contrasts our original analysis (higher contribution of old C under elevated CO 2 ) because it uses additional data sources, accounts for end-member bias, and estimates apparent fractionation effects.

54 ENVIRONMENTAL SCIENCES↗

Three-Dimensional Bayesian Geostatistical Aquifer Characterization at the Hanford 300 Area using Tracer Test Data

Tracer testing under natural or forced gradient flow holds the potential to provide useful information for characterizing subsurface properties, through monitoring, modeling and interpretation of the tracer plume migration in an aquifer. Non-reactive tracer experiments were conducted at the Hanford 300 Area, along with constant-rate injection tests and electromagnetic borehole flowmeter (EBF) profiling. A Bayesian data assimilation technique, the method of anchored distributions (MAD) [Rubin et al., 2010], was applied to assimilate the experimental tracer test data with the other types of data and to infer the three-dimensional heterogeneous structure of the hydraulic conductivity in the saturated zone of the Hanford formation. In this study, the Bayesian prior information on the underlying random hydraulic conductivity field was obtained from previous field characterization efforts using the constant-rate injection tests and the EBF data. The posterior distribution of the conductivity field was obtained by further conditioning the field on the temporal moments of tracer breakthrough curves at various observation wells. MAD was implemented with the massively-parallel three-dimensional flow and transport code PFLOTRAN to cope with the highly transient flow boundary conditions at the site and to meet the computational demands of MAD. A synthetic study proved that the proposed method could effectively invert tracer test data to capture the essential spatial heterogeneity of the three-dimensional hydraulic conductivity field. Application of MAD to actual field data shows that the hydrogeological model, when conditioned on the tracer test data, can reproduce the tracer transport behavior better than the field characterized without the tracer test data. This study successfully demonstrates that MAD can sequentially assimilate multi-scale multi-type field data through a consistent Bayesian framework.

54 ENVIRONMENTAL SCIENCES↗

Data from: Comparing traditional and Bayesian approaches to ecological meta-analysis

Despite the wide application of meta-analysis in ecology, some of the traditional methods used for meta-analysis may not perform well given the type of data characteristic of ecological meta-analyses. We reviewed published meta-analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies (ni) and the number of studies or records (k) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta-analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that ni and k were highly variable, distributions were right-skewed, and were generally small (median ni =5, median k=44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval based on the t-distribution that uses an adjusted standard error (the Hartung-Knapp-Sidik-Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z-distribution confidence intervals had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta-analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random-effects meta-analysis, the performance of the best frequentist and Bayesian methods were similar for the same combinations of factors (k and mean replication), though the Bayesian approaches had higher than nominal (>95%) coverage for the mean effect when k was very low (k<15). Our literature review suggests that many meta-analyses that used z-distribution or bootstrapping confidence intervals may have over-estimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta-analyses.

54 ENVIRONMENTAL SCIENCES↗

Joint Data Filtering and Labeling Using Gaussian Processes and Alternating Direction Method of Multipliers

Here, sequence labeling aims at assigning a label to every sample of a signal (or pixel of an image) while considering the sequentiality (or vicinity) of the samples. To perform this task, many works in the literature first filter and then label the data. Unfortunately, the filtering, which is performed independently from the labeling, is far from optimal and frequently makes the latter task harder. In this paper, a novel approach that trains a Gaussian process classifier and estimates the coefficients of an optimal filter jointly is presented. The new approach, based on Bayesian modeling and alternating direction method of multipliers (ADMMs) optimization, performs both tasks simultaneously. All unknowns are treated as stochastic variables, which are estimated using variational inference and filtering and labeling are linked with the use of ADMM. In the experimental section, synthetic and real experiments are presented to compare the proposed method with other existing approaches.

97 MATHEMATICS AND COMPUTING↗

Using Bayesian Networks for Sensitivity Analysis of Complex Biogeochemical Models

Sensitivity analysis is a vital tool in numerical modeling to identify important parameters and processes that contribute to the overall uncertainty in model outputs. We developed a new sensitivity analysis method to quantify the relative importance of uncertain model processes that contain multiple uncertain parameters. The method is based on the concepts of Bayesian networks (BNs) to account for complex hierarchical uncertainty structure of a model system. We derived a new set of sensitivity indices using the methodology of variance-based global sensitivity analysis with the Bayesian inference. The framework is capable of representing the detailed uncertainty information of a complex model system using BNs and affords flexible grouping of different uncertain inputs given their characteristics and dependency structures. We have implemented the method on a real-world biogeochemical model at the groundwater-surface water interface within the Hanford Site’s 300 Area. The uncertainty sources of the model were first grouped into forcing scenario and three different processes based on our understanding of the complex system. The sensitivity analysis results indicate that both the reactive transport and groundwater flow processes are important sources of uncertainty for carbon-consumption predictions. Within the groundwater flow process, the structure of geological formations is more important than the permeability heterogeneity within a given geological formation. Our new sensitivity analysis framework based on BNs offers substantial flexibility for investigating the importance of combinations of interacting uncertainty sources in a hierarchical order, and it is expected to be applicable to a wide range of multi-physics models for complex systems.

Dai, Heng↗

Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN

Physics-informed neural network (PINN) has been successfully applied in solving a variety of nonlinear non-convex forward and inverse problems. However, the training is challenging because of the non-convex loss functions and the multiple optima in the Bayesian inverse problem. In this work, we propose a multi-variance replica exchange stochastic gradient Langevin dynamics method to tackle the challenge of the multiple local optima in the optimization and the challenge of the multiple modal posterior distribution in the inverse problem. Replica exchange methods are capable of escaping from the local traps and accelerating the convergence; two chains with different temperatures are designed where the low temperature chain aims for the local convergence, and the target of the high temperature chain is to travel globally and explore the whole loss function entropy landscape. However, it may not be efficient to solve mathematical inversion problems by using the vanilla replica method directly since the method doubles the computational cost in evaluating the forward solvers (likelihood functions) in the two chains. To address this issue, we propose to make different assumptions on the energy function estimation and this facilities one to use solvers of different fidelities in the likelihood function evaluation. More precisely, one can use a solver with low fidelity in the high temperature chain while using a solver with high fidelity in the low temperature chain. Our proposed method significantly lowers the computational cost in the high temperature chain, meanwhile preserving the accuracy and converging very fast. Here we give an unbiased estimate of the swapping rate and give an estimation of the discretization error of the scheme. To verify our idea, we design and solve four inverse problems which have multiple modes. The proposed method is also employed to train the Bayesian PINN to solve the forward and inverse problems; faster and more accurate convergence has been observed when compared to the stochastic gradient Langevin dynamics (SGLD) method and vanilla replica exchange methods.

97 MATHEMATICS AND COMPUTING↗