Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian hierarchical model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge L 1 and L 2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. Here, we illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.

Bayesian shrinkage↗

A Bayes network approach to uncertainty quantification in hierarchically developed computational models

Here, performance assessment of complex systems is ideally accomplished through system-level testing, but because they are expensive, such tests are seldom performed. On the other hand, for economic reasons, data from tests on individual components that are parts of complex systems are more readily available. The lack of system-level data leads to a need to build computational models of systems and use them for performance prediction in lieu of experiments. Because their complexity, models are sometimes built in a hierarchical manner, starting with simple components, progressing to collections of components, and finally, to the full system. Quantification of uncertainty in the predicted response of a system model is required in order to establish confidence in the representation of actual system behavior. This paper proposes a framework for the complex, but very practical problem of quantification of uncertainty in system-level model predictions. It is based on Bayes networks and uses the available data at multiple levels of complexity (i.e., components, subsystem, etc.). Because epistemic sources of uncertainty were shown to be secondary, in this application, aleatoric only uncertainty is included in the present uncertainty quantification. An example showing application of the techniques to uncertainty quantification of measures of response of a real, complex aerospace system is included.

97 MATHEMATICS AND COMPUTING↗

On‐site surrogates for large‐scale calibration

Abstract Motivated by a computer model calibration problem from the oil and gas industry, involving the design of a honeycomb seal, we develop a new Bayesian methodology to cope with limitations in the canonical apparatus stemming from several factors. We propose a new strategy of on‐site design and surrogate modeling for a computer simulator acting on a high‐dimensional input space that, although relatively speedy, is prone to numerical instabilities, missing data, and nonstationary dynamics. Our aim is to strike a balance between data‐faithful modeling and computational tractability in a calibration framework—tailoring the computer model to a limited field experiment. Situating our on‐site surrogates within the canonical calibration apparatus requires updates to that framework. We describe a novel yet intuitive Bayesian setup that carefully decomposes otherwise prohibitively large matrices by exploiting the sparse blockwise structure. Empirical illustrations demonstrate that this approach performs well on toy data and our motivating honeycomb example.

Huang, Jiangeng↗

An Adaptive Bayesian Parameter Estimation of a Synchronous Generator Under Gross Errors

Polynomial-chaos-expansion-based surrogate models have recently been advocated in the literature for power system dynamic parameter estimation. Regarding the estimation of the uncertain generator parameters, a Bayesian inference framework has been proposed based on a polynomial-based reduced-order representation of the synchronous machines using assumed parameter values. Then, the non-Gaussian posterior probability distribution functions (pdfs) of these parameters are recovered through the stochastic sampling approach efficiently. However, facing very large parameter errors, the reliability of the surrogate model decreases, yielding biased estimation results. To overcome this problem, here we develop hierarchical Bayesian inference framework that processes the measurements provided by phasor measurement units, while making use of multifidelity surrogates together with the importance sampling method. The latter allows us to estimate in an efficient manner the posterior pdfs of the uncertain parameters through the normalized weights of the prior samples. To improve the accuracy of the posterior pdfs, an adaptive procedure is further adopted in the importance sampling for the gradual evolution of its proposal functions. The new proposals assist in fine-tuning the sample space and thereby help to construct surrogates with higher fidelity. Through an iterative process, this approach is able to estimate accurately and efficiently non-Gaussian posterior pdfs of the uncertain generator parameters subject to gross errors.

42 ENGINEERING↗

Probabilistic models for feedback systems.

In previous work, we developed a Bayesian-based methodology to analyze the reliability of hierarchical systems. The output of the procedure is a statistical distribution of the reliability, thus allowing many questions to be answered. The principal advantage of the approach is that along with an estimate of the reliability, we also can provide statements of confidence in the results. The model is quite general in that it allows general representations of all of the distributions involved, it incorporates prior knowledge into the models, it allows errors in the 'engineered' nodes of a system to be determined by the data, and leads to the ability to determine optimal testing strategies. In this report, we provide the preliminary steps necessary to extend this approach to systems with feedback. Feedback is an essential component of 'complexity' and provides interesting challenges in modeling the time-dependent action of a feedback loop. We provide a mechanism for doing this and analyze a simple case. We then consider some extensions to more interesting examples with local control affecting the entire system. Finally, a discussion of the status of the research is also included.

99 GENERAL AND MISCELLANEOUS↗

Estimating methane emissions in California's urban and rural regions using multitower observations

Here, we present an analysis of methane (CH 4 ) emissions using atmospheric observations from 36 thirteen sites in California during June 2013 – May 2014. A hierarchical Bayesian inversion 37 method is used to estimate CH 4 emissions for spatial regions (0.3° pixels for major regions) by 38 comparing measured CH 4 mixing ratios with transport model (WRF-STILT) predictions based 39 on seasonally varying California-specific CH 4 prior emission models. The transport model is 40 assessed using a combination of meteorological and carbon monoxide (CO) measurements 41 coupled with the gridded California Air Resources Board (CARB) carbon monoxide (CO) 42 emission inventory. Hierarchical Bayesian inversion suggests that state annual anthropogenic 43 CH 4 emissions are 2.42 ± 0.49 Tg CH 4 /yr (at 95% confidence, including transport bias 44 uncertainty), higher (1.2 - 1.8 times) than the CARB current inventory (1.64 Tg CH 4 /yr in 2013). 45 We note that the estimated CH 4 emissions drop to 1.0 - 1.6 times the CARB inventory if we 46 correct for the 10% median CH 4 emissions assuming the bias in CO analysis is applicable to 47 CH 4 . The CH 4 emissions from the Central Valley and urban regions (San Francisco Bay and 48 South Coast Air Basins) account for ~58% and 26% of the total posterior emissions, 49 respectively. This study suggests that the livestock sector is likely the major contributor to the 50 state total CH 4 emissions, in agreement with CARB’s inventory. Attribution to source sectors for 51 sub-regions of California using additional trace gas species would further improve the 52 quantification of California’s CH 4 emissions and mitigation efforts towards the California Global 53 Warming Solutions Act of 2006 (AB-32).

54 ENVIRONMENTAL SCIENCES↗

Stochastic modeling and statistical calibration with model error and scarce data

This paper introduces a procedure to assess the predictive accuracy of stochastic models subject to model error and sparse data. Model error is introduced as uncertainty on the coefficients of appropriate polynomial chaos expansions (PCE). The error associated with finite sample size allows us to conceive of these coefficients as statistics of the data that we describe as random variables whose influence on output quantities of interest is evaluated through the extended polynomial chaos expansion (EPCE). A Bayesian data assimilation scheme is introduced to update these expansions by considering the resulting nested chaos expansion as a hierarchical probabilistic model. Stochastic models of quantities of interest (QoI) are thus constructed and efficiently evaluated. Here, the Metropolis–Hastings Markov chain Monte Carlo procedure is used to sample the posterior. Two illustrative analytical and numerical problems are used to demonstrate the proposed approach.

Bayesian inference↗

How to Obtain the Redshift Distribution from Probabilistic Redshift Estimates

Abstract A reliable estimate of the redshift distribution n ( z ) is crucial for using weak gravitational lensing and large-scale structures of galaxy catalogs to study cosmology. Spectroscopic redshifts for the dim and numerous galaxies of next-generation weak-lensing surveys are expected to be unavailable, making photometric redshift (photo- z ) probability density functions (PDFs) the next best alternative for comprehensively encapsulating the nontrivial systematics affecting photo- z point estimation. The established stacked estimator of n ( z ) avoids reducing photo- z PDFs to point estimates but yields a systematically biased estimate of n ( z ) that worsens with a decreasing signal-to-noise ratio, the very regime where photo- z PDFs are most necessary. We introduce Cosmological Hierarchical Inference with Probabilistic Photometric Redshifts ( CHIPPR ), a statistically rigorous probabilistic graphical model of redshift-dependent photometry that correctly propagates the redshift uncertainty information beyond the best-fit estimator of n ( z ) produced by traditional procedures and is provably the only self-consistent way to recover n ( z ) from photo- z PDFs. We present the chippr prototype code, noting that the mathematically justifiable approach incurs computational cost. The CHIPPR approach is applicable to any one-point statistic of any random variable, provided the prior probability density used to produce the posteriors is explicitly known; if the prior is implicit, as may be the case for popular photo- z techniques, then the resulting posterior PDFs cannot be used for scientific inference. We therefore recommend that the photo- z community focus on developing methodologies that enable the recovery of photo- z likelihoods with support over all redshifts, either directly or via a known prior probability density.

79 ASTRONOMY AND ASTROPHYSICS↗

DETERMINING AGES OF APOGEE GIANTS WITH KNOWN DISTANCES

We present a sample of 705 local giant stars observed using the New Mexico State University 1 m telescope with the Sloan Digital Sky Survey-III/Apache Point Observatory Galactic Evolution Experiment (APOGEE) spectrograph, for which we estimate stellar ages and the local star formation history (SFH). The high-resolution (R ∼ 22,500), near infrared (1.51–1.7 μm) APOGEE spectra provide measurements of stellar atmospheric parameters (temperature, surface gravity, [M/H], and [α/M]). Due to the smaller uncertainties in surface gravity possible with high-resolution spectra and accurate Hipparcos distance measurements, we are able to calculate the stellar masses to within 30%. For giants, the relatively rapid evolution up the red giant branch allows the age to be constrained by the mass. We examine methods of estimating age using both the mass–age relation directly and a Bayesian isochrone matching of measured parameters, assuming a constant SFH. To improve the SFH prior, we use a hierarchical modeling approach to constrain the parameters of the model SFH using the age probability distribution functions of the data. The results of an α-dependent Gaussian SFH model show a clear age–[α/M] relation at all ages. Using this SFH model as the prior for an empirical Bayesian analysis, we determine ages for individual stars. The resulting age–metallicity relation is flat, with a slight decrease in [M/H] at the oldest ages and a ∼0.5 dex spread in metallicity across most ages. For stars with ages ≲1 Gyr we find a smaller spread, consistent with radial migration having a smaller effect on these young stars than on the older stars.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian mass estimates of the milky way: including measurement uncertainties with hierarchical bayes

We present a hierarchical Bayesian method for estimating the total mass and mass profile of the Milky Way Galaxy. The new hierarchical Bayesian approach further improves the framework presented by Eadie et al. and Eadie and Harris and builds upon the preliminary reports by Eadie et al. The method uses a distribution function f(E,L) to model the Galaxy and kinematic data from satellite objects, such as globular clusters (GCs), to trace the Galaxy’s gravitational potential. A major advantage of the method is that it not only includes complete and incomplete data simultaneously in the analysis, but also incorporates measurement uncertainties in a coherent and meaningful way. We first test the hierarchical Bayesian framework, which includes measurement uncertainties, using the same data and power-law model assumed in Eadie and Harris and find the results are similar but more strongly constrained. Next, we take advantage of the new statistical framework and incorporate all possible GC data, finding a cumulative mass profile with Bayesian credible regions. This profile implies a mass within 125 kpc of 4.8×10{sup 11}M{sub ⊙} with a 95% Bayesian credible region of (4.0--5.8)×10{sup 11}M{sub ⊙}. Our results also provide estimates of the true specific energies of all the GCs. By comparing these estimated energies to the measured energies of GCs with complete velocity measurements, we observe that (the few) remote tracers with complete measurements may play a large role in determining a total mass estimate of the Galaxy. Thus, our study stresses the need for more remote tracers with complete velocity measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Lower soil moisture and deep soil temperatures in thermokarst features increase old soil carbon loss after 10 years of experimental permafrost warming

Almost half of the global terrestrial soil carbon (C) is stored in the northern circumpolar permafrost region, where air temperatures are increasing two times faster than the global average. As climate warms, permafrost thaws and soil organic matter becomes vulnerable to greater microbial decomposition. Long-term soil warming of ice-rich permafrost can result in thermokarst formation that creates variability in environmental conditions. Consequently, plant and microbial proportional contributions to ecosystem respiration may change in response to long-term soil warming. Natural abundance δ 13 C and Δ 14 C of aboveground and belowground plant material, and of young and old soil respiration were used to inform a mixing model to partition the contribution of each source to ecosystem respiration fluxes. We employed a hierarchical Bayesian approach that incorporated gross primary productivity and environmental drivers to constrain source contributions. We found that long-term experimental permafrost warming introduced a soil hydrology component that interacted with temperature to affect old soil C respiration. Old soil C loss was suppressed in plots with warmer deep soil temperatures because they tended to be wetter. When soil volumetric water content significantly decreased in 2018 relative to 2016 and 2017, the dominant respiration sources shifted from plant aboveground and young soil respiration to old soil respiration. The proportion of ecosystem respiration from old soil C accounted for up to 39% of ecosystem respiration and represented a 30-fold increase compared to the wet-year average. Our findings show that thermokarst formation may act to moderate microbial decomposition of old soil C when soil is highly saturated. However, when soil moisture decreases, a higher proportion of old soil C is vulnerable to decomposition and can become a large flux to the atmosphere. Furthermore, as permafrost systems continue to change with climate, we must understand the thresholds that may propel these systems from a C sink to a source.

permafrost↗

Effect of Epistemic Uncertainty Modeling Approach on Decision-Making: Example using Equipment Performance Indicator

Quantitative risk assessments are an integral part of risk-informed regulation of current and future nuclear plants in the U.S. The Bayesian approach to uncertainty, in which both stochastic and epistemic uncertainties are represented with precise probability distributions, is the standard approach to modeling uncertainties in such quantitative risk assessments. However, there are long-standing criticisms of the Bayesian approach to epistemic uncertainty from many perspectives, and a number of alternative approaches have been proposed. Among these alternatives, the most promising (and most rapidly developing) would appear to be the concept of imprecise probability. In this paper, we employ a performance indicator example to focus the discussion. We first give a short overview of the traditional Bayesian paradigm and review some its controversial aspects, for example, issues with so-called noninformative prior distributions. We then discuss how the imprecise probability approach treats these issues and compare it with two other approaches: sensitivity analysis and hierarchical Bayes modeling. We conclude with some practical implications for risk-informed decision making.

99 GENERAL AND MISCELLANEOUS↗

Exploring physics of ferroelectric domain walls via Bayesian analysis of atomically resolved STEM data

The physics of ferroelectric domain walls is explored using the Bayesian inference analysis of atomically resolved STEM data. We demonstrate that domain wall profile shapes are ultimately sensitive to the nature of the order parameter in the material, including the functional form of Ginzburg-Landau-Devonshire expansion, and numerical value of the corresponding parameters. The preexisting materials knowledge naturally folds in the Bayesian framework in the form of prior distributions, with the different order parameters forming competing (or hierarchical) models. Here, we explore the physics of the ferroelectric domain walls in BiFeO 3 using this method, and derive the posterior estimates of relevant parameters. More generally, this inference approach both allows learning materials physics from experimental data with associated uncertainty quantification, and establishing guidelines for instrumental development answering questions on what resolution and information limits are necessary for reliable observation of specific physical mechanisms of interest.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initialization

Obtaining lightweight and accurate approximations of discretized objective functional Hessians in inverse problems governed by partial differential equations (PDEs) is essential to make both deterministic and Bayesian statistical large-scale inverse problems computationally tractable. The cubic computational complexity of dense linear algebraic tasks, such as Cholesky factorization, that provide a means to sample Gaussian distributions and determine solutions of Newton linear systems is a computational bottleneck at large-scale. These tasks can be reduced to log-linear complexity by utilizing hierarchical off-diagonal low-rank (HODLR) matrix approximations. In this work, we show that a class of Hessians that arise from inverse problems governed by PDEs are well approximated by the HODLR matrix format. In particular, we study inverse problems governed by PDEs that model the instantaneous viscous flow of ice sheets. In these problems, we seek a spatially distributed basal sliding parameter field such that the flow predicted by the ice sheet model is consistent with ice sheet surface velocity observations. Here, we demonstrate the use of HODLR Hessian approximation to efficiently sample the Laplace approximation of the posterior distribution with covariance further approximated by HODLR matrix compression. Computational studies are performed which illustrate ice sheet problem regimes for which the Gauss–Newton data-misfit Hessian is more efficiently approximated by the HODLR matrix format than the low-rank (LR) format. We then demonstrate that HODLR approximations can be favorable, when compared to global LR approximations, for large-scale problems by studying the data-misfit Hessian associated with inverse problems governed by the first-order Stokes flow model on the Humboldt glacier and Greenland ice sheet.

97 MATHEMATICS AND COMPUTING↗

Assimilating irregularly spaced sparsely observed turbulent signals with hierarchical Bayesian reduced stochastic filters

In this paper, we consider a practical filtering approach for assimilating irregularly spaced, sparsely observed turbulent signals through a hierarchical Bayesian reduced stochastic filtering framework. The proposed hierarchical Bayesian approach consists of two steps, blending a data-driven interpolation scheme and the Mean Stochastic Model (MSM) filter. We examine the potential of using the deterministic piecewise linear interpolation scheme and the ordinary kriging scheme in interpolating irregularly spaced raw data to regularly spaced processed data and the importance of dynamical constraint (through MSM) in filtering the processed data on a numerically stiff state estimation problem. In particular, we test this approach on a two-layer quasi-geostrophic model in a two-dimensional domain with a small radius of deformation to mimic ocean turbulence. Our numerical results suggest that the dynamical constraint becomes important when the observation noise variance is large. Second, we find that the filtered estimates with ordinary kriging are superior to those with linear interpolation when observation networks are not too sparse; such robust results are found from numerical simulations with many randomly simulated irregularly spaced observation networks, various observation time intervals, and observation error variances. Third, when the observation network is very sparse, we find that both the kriging and linear interpolations are comparable.

97 MATHEMATICS AND COMPUTING↗

Deep Spatiotemporal Feature Learning with Application to Image Classification

Deep machine learning is an emerging framework for dealing with complex high-dimensionality data in a hierarchical fashion which draws some inspiration from biological sources. Despite the notable progress made in the field, there remains a need for an architecture that can represent temporal information with the same ease that spatial information is discovered. In this work, we present new results using a recently introduced deep learning architecture called Deep Spatio-Temporal Inference Network (DeSTIN). DeSTIN is a discriminative deep learning architecture that combines concepts from unsupervised learning for dynamic pattern representation together with Bayesian inference. In DeSTIN the spatiotemporal dependencies that exist within the observations are modeled inherently in an unguided manner. Each node models the inputs by means of clustering and simple dynamics modeling while it constructs a belief state over the distribution of sequences using Bayesian inference. We demonstrate that information from the different layers of this hierarchical system can be extracted and utilized for the purpose of pattern classification. Earlier simulation results indicated that the framework is highly promising, consequently in this work we expand DeSTIN to a popular problem, the MNIST data set of handwritten digits. The system as a preprocessor to a neural network achieves a recognition accuracy of 97.98% on this data set. We further show related experimental results pertaining to automatic cluster adaptation and termination.

99 GENERAL AND MISCELLANEOUS↗

TDCOSMO - IV. Hierarchical time-delay cosmography – joint inference of the Hubble constant and galaxy density profiles

The H0LiCOW collaboration inferred via strong gravitational lensing time delays a Hubble constant value of H0 = 73.3−1.8+1.7 km s−1 Mpc−1, describing deflector mass density profiles by either a power-law or stars (constant mass-to-light ratio) plus standard dark matter halos. The mass-sheet transform (MST) that leaves the lensing observables unchanged is considered the dominant source of residual uncertainty in H0. We quantify any potential effect of the MST with a flexible family of mass models, which directly encodes it, and they are hence maximally degenerate with H0. Our calculation is based on a new hierarchical Bayesian approach in which the MST is only constrained by stellar kinematics. The approach is validated on mock lenses, which are generated from hydrodynamic simulations. We first applied the inference to the TDCOSMO sample of seven lenses, six of which are from H0LiCOW, and measured H0 = 74.5−6.1+5.6 km s−1 Mpc−1. Secondly, in order to further constrain the deflector mass density profiles, we added imaging and spectroscopy for a set of 33 strong gravitational lenses from the Sloan Lens ACS (SLACS) sample. For nine of the 33 SLAC lenses, we used resolved kinematics to constrain the stellar anisotropy. From the joint hierarchical analysis of the TDCOSMO+SLACS sample, we measured H0 = 67.4−3.2+4.1 km s−1 Mpc−1. This measurement assumes that the TDCOSMO and SLACS galaxies are drawn from the same parent population. The blind H0LiCOW, TDCOSMO-only and TDCOSMO+SLACS analyses are in mutual statistical agreement. The TDCOSMO+SLACS analysis prefers marginally shallower mass profiles than H0LiCOW or TDCOSMO-only. Without relying on the form of the mass density profile used by H0LiCOW, we achieve a ∼5% measurement of H0. While our new hierarchical analysis does not statistically invalidate the mass profile assumptions by H0LiCOW – and thus the H0 measurement relying on them – it demonstrates the importance of understanding the mass density profile of elliptical galaxies. The uncertainties on H0 derived in this paper can be reduced by physical or observational priors on the form of the mass profile, or by additional data.Key words: gravitational lensing: strong / galaxies: general / galaxies: kinematics and dynamics / distance scale / cosmological parameters / cosmology: observations⋆ The full analysis is available at https://github.com/TDCOSMO/hierarchy_analysis_2020_public.

79 ASTRONOMY AND ASTROPHYSICS↗