Search NASA⌕ Search

SEARCH · Search NASA

Results for “Variational Bayesian”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Introduction in IND and recursive partitioning

This manual describes the IND package for learning tree classifiers from data. The package is an integrated C and C shell re-implementation of tree learning routines such as CART, C4, and various MDL and Bayesian variations. The package includes routines for experiment control, interactive operation, and analysis of tree building. The manual introduces the system and its many options, gives a basic review of tree learning, contains a guide to the literature and a glossary, and lists the manual pages for the routines and instructions on installation.

Buntine, Wray↗
NASA NTRS1991

Introduction to IND and recursive partitioning, version 1.0

This manual describes the IND package for learning tree classifiers from data. The package is an integrated C and C shell re-implementation of tree learning routines such as CART, C4, and various MDL and Bayesian variations. The package includes routines for experiment control, interactive operation, and analysis of tree building. The manual introduces the system and its many options, gives a basic review of tree learning, contains a guide to the literature and a glossary, lists the manual pages for the routines, and instructions on installation.

Buntine, Wray↗
NASA NTRS1997

Bayesian Blocks: A New Method to Analyze Photon Counting Data

A Bayesian analysis of photon-counting data leads to a new time-domain algorithm for detecting localized structures (bursts), revealing pulse shapes, and generally characterizing intensity variations. The raw counting data -- time-tag events (TTE), time-to-spill (TTS) data, or binned counts -- is converted to a maximum likelihood segmentation of the observation into time intervals during which the photon arrival rate is perceptibly constant -- i.e. has a fixed intensity without statistically significant variations. The resulting structures, Bayesian Blocks, can be thought of as bins with arbitrary spacing determined by the data. The method itself sets no lower limit to the time scale on which variability can be detected. We have applied the method to RXTE data on Cyg X-1, yielding information on this source's short-time-scale variability.

Scargle, Jeffrey D.↗
NASA NTRS2015

An Inversion Analysis of Recent Variability in Natural CO2 Fluxes Using GOSAT and In Situ Observations

About one-half of the global CO2 emissions from fossil fuel combustion and deforestation accumulates in the atmosphere, where it contributes to global warming. The rest is taken up by vegetation and the ocean. The precise contribution of the two sinks, and their location and year-to-year variability are, however, not well understood. We use two different approaches, batch Bayesian synthesis inversion and variational data assimilation, to deduce the global spatiotemporal distributions of CO2 fluxes during 2009-2010. One of our objectives is to assess different sources of uncertainties in inferred fluxes, including uncertainties in prior flux estimates and observations, and differences in inversion techniques. For prior constraints, we utilize fluxes and uncertainties from the CASA-GFED model of the terrestrial biosphere and biomass burning driven by satellite observations and interannually varying meteorology. We also use measurement-based ocean flux estimates and two sets of fixed fossil CO2 emissions. Here, our inversions incorporate column CO2 measurements from the GOSAT satellite (ACOS retrieval, filtered and bias-corrected) and in situ observations (individual flask and afternoon-average continuous observations) to estimate fluxes in 108 regions over 8-day intervals for the batch inversion and at 3 x 3.75 weekly for the variational system. Relationships between fluxes and atmospheric concentrations are derived consistently for the two inversion systems using the PCTM atmospheric transport model driven by meteorology from the MERRA reanalysis. We compare the posterior fluxes and uncertainties derived using different data sets and the two inversion approaches, and evaluate the posterior atmospheric concentrations against independent data including aircraft measurements. The optimized fluxes generally resemble those from other studies. For example, the results indicate that the terrestrial biosphere is a net CO2 sink, and a GOSAT-only inversion suggests a shift in the global sink from the tropics south to the north relative to the prior and to an in-situ-only inversion. We also find a smaller terrestrial sink in higher-latitude northern regions in boreal summer of 2010 relative to 2009.

Carbon dioxide↗
NASA NTRS2009

Understanding the Scalability of Bayesian Network Inference using Clique Tree Growth Curves

Bayesian networks (BNs) are used to represent and efficiently compute with multi-variate probability distributions in a wide range of disciplines. One of the main approaches to perform computation in BNs is clique tree clustering and propagation. In this approach, BN computation consists of propagation in a clique tree compiled from a Bayesian network. There is a lack of understanding of how clique tree computation time, and BN computation time in more general, depends on variations in BN size and structure. On the one hand, complexity results tell us that many interesting BN queries are NP-hard or worse to answer, and it is not hard to find application BNs where the clique tree approach in practice cannot be used. On the other hand, it is well-known that tree-structured BNs can be used to answer probabilistic queries in polynomial time. In this article, we develop an approach to characterizing clique tree growth as a function of parameters that can be computed in polynomial time from BNs, specifically: (i) the ratio of the number of a BN's non-root nodes to the number of root nodes, or (ii) the expected number of moral edges in their moral graphs. Our approach is based on combining analytical and experimental results. Analytically, we partition the set of cliques in a clique tree into different sets, and introduce a growth curve for each set. For the special case of bipartite BNs, we consequently have two growth curves, a mixed clique growth curve and a root clique growth curve. In experiments, we systematically increase the degree of the root nodes in bipartite Bayesian networks, and find that root clique growth is well-approximated by Gompertz growth curves. It is believed that this research improves the understanding of the scaling behavior of clique tree clustering, provides a foundation for benchmarking and developing improved BN inference and machine learning algorithms, and presents an aid for analytical trade-off studies of clique tree clustering using growth curves.

Mengshoel, Ole Jakob↗
NASA NTRSDate not supplied

Defining Change Thresholds: What Change Is Outside Typical Sources of Variation?

Researchers often have a difficult time defining meaningful thresholds for change. We sometimes identify subtle changes but what amount of change is beyond typical sources of variation? This is especially complicated when trying to understand new disease pathogenesis like the constellation of eye changes leading to Spaceflight-associated Neuro-ocular Syndrome (SANS). To support decision makers in defining minimal meaningful change, we used a Bayesian hierarchical model to estimate innate sources of variability such as natural day to day variation. Healthy subjects were recruited and imaged with MRI, OCT, and US on separate days and measured by several technicians. Models were developed specifying random effects for the sources of variation – between left and right eyes, within-individuals over time, between raters, and finally between individuals. This allowed us to find the posterior distribution for the total typical variation, within an eye, which we use to define a threshold where change beyond typical sources of variation is likely. This threshold is now used as our earliest indicator of systematic increase in Total Retinal Thickness (a precursor to optic disc edema).

Millennia Young↗
NASA NTRS2021

OGLE-2018-BLG-1185b: A Low-mass Microlensing Planet Orbiting a Low-mass Dwarf

We report an analysis of the planetary microlensing event OGLE-2018-BLG-1185, which was observed by a large number of ground-based telescopes and by the Spitzer Space Telescope. The ground-based light curve indicates a low planet–host star mass ratio ofq=(6.9±0.2)×10−5, which is near the peak of the wide-orbit exoplanet mass-ratio distribution. We estimate the host star and planet masses with a Bayesian analysis using the measured angular Einstein radius under the assumption that stars of all masses have an equal probability of hosting the planet. The flux variation observed by Spitzer is marginal, but still places a constraint on the microlens parallax. Imposing a conservative constraint that this flux variation should beΔfSpz<4 instrumental flux units yields a host mass of=-+MM0.37 host 0.210.35 and a planet mass of =-+ÅmM8.4p4.77.9. A Bayesian analysis including the full parallax constraint from Spitzer suggests smaller host star and planet masses of =-+MM0.091 host 0.0180.064 and =-+ÅmM2.1p0.41.5, respectively. Future high-resolution imaging observations with the Hubble Space Telescope or Extremely Large Telescope could distinguish between these two scenarios and help reveal the planetary system properties in more detail.

Gravitational microlensing↗
NASA NTRS2013

Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks [Scargle 1998]-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piece- wise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by [Arias-Castro, Donoho and Huo 2003]. In the spirit of Reproducible Research [Donoho et al. (2008)] all of the code and data necessary to reproduce all of the figures in this paper are included as auxiliary material.

signal detection↗
NASA NTRS2013

Downscaling Satellite Precipitation with Emphasis on Extremes: A Variational 1-Norm Regularization in the Derivative Domain

The increasing availability of precipitation observations from space, e.g., from the Tropical Rainfall Measuring Mission (TRMM) and the forthcoming Global Precipitation Measuring (GPM) Mission, has fueled renewed interest in developing frameworks for downscaling and multi-sensor data fusion that can handle large data sets in computationally efficient ways while optimally reproducing desired properties of the underlying rainfall fields. Of special interest is the reproduction of extreme precipitation intensities and gradients, as these are directly relevant to hazard prediction. In this paper, we present a new formalism for downscaling satellite precipitation observations, which explicitly allows for the preservation of some key geometrical and statistical properties of spatial precipitation. These include sharp intensity gradients (due to high-intensity regions embedded within lower-intensity areas), coherent spatial structures (due to regions of slowly varying rainfall),and thicker-than-Gaussian tails of precipitation gradients and intensities. Specifically, we pose the downscaling problem as a discrete inverse problem and solve it via a regularized variational approach (variational downscaling) where the regularization term is selected to impose the desired smoothness in the solution while allowing for some steep gradients(called 1-norm or total variation regularization). We demonstrate the duality between this geometrically inspired solution and its Bayesian statistical interpretation, which is equivalent to assuming a Laplace prior distribution for the precipitation intensities in the derivative (wavelet) space. When the observation operator is not known, we discuss the effect of its misspecification and explore a previously proposed dictionary-based sparse inverse downscaling methodology to indirectly learn the observation operator from a database of coincidental high- and low-resolution observations. The proposed method and ideas are illustrated in case studies featuring the downscaling of a hurricane precipitation field.

Hurricanes↗
NASA NTRSDate not supplied

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗
NASA NTRSDate not supplied

Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗
NASA NTRS2010

Understanding the Scalability of Bayesian Network Inference Using Clique Tree Growth Curves

One of the main approaches to performing computation in Bayesian networks (BNs) is clique tree clustering and propagation. The clique tree approach consists of propagation in a clique tree compiled from a Bayesian network, and while it was introduced in the 1980s, there is still a lack of understanding of how clique tree computation time depends on variations in BN size and structure. In this article, we improve this understanding by developing an approach to characterizing clique tree growth as a function of parameters that can be computed in polynomial time from BNs, specifically: (i) the ratio of the number of a BN s non-root nodes to the number of root nodes, and (ii) the expected number of moral edges in their moral graphs. Analytically, we partition the set of cliques in a clique tree into different sets, and introduce a growth curve for the total size of each set. For the special case of bipartite BNs, there are two sets and two growth curves, a mixed clique growth curve and a root clique growth curve. In experiments, where random bipartite BNs generated using the BPART algorithm are studied, we systematically increase the out-degree of the root nodes in bipartite Bayesian networks, by increasing the number of leaf nodes. Surprisingly, root clique growth is well-approximated by Gompertz growth curves, an S-shaped family of curves that has previously been used to describe growth processes in biology, medicine, and neuroscience. We believe that this research improves the understanding of the scaling behavior of clique tree clustering for a certain class of Bayesian networks; presents an aid for trade-off studies of clique tree clustering using growth curves; and ultimately provides a foundation for benchmarking and developing improved BN inference and machine learning algorithms.

Mengshoel, Ole J.↗
NASA NTRS1993

The inference of mantle viscosity from an inversion of the Fennoscandian relaxation spectrum

The theory of Peltier (1976) for mantle viscosity is adopted, within the framework of nonlinear Bayesian Inference, to invert the Fennoscandian relaxation spectra derived by McConnell (1968). A set of rigorous constraints which all models for the viscosity variation beneath Fennoscandian must satisfy is derived. These constraints are used to test the plausibility of a wide class of viscosity models. It is shown that a model with a weak asthenosphere overlying an isoviscous 10 exp 21 Pa s deep mantle provides to good fit to the relaxation spectrum. This is also true of models with a thin sublithospheric low-viscosity zone overlying a two-layer deep mantle with a moderate jump in viscosity across 670 km depth, and models with a viscosity jump of between four and six across isoviscous upper and lower mantle regions.

Mitrovica, J. X.↗
NASA NTRS1992

Iterative Bayesian Classification In Polarimetric SAR

In improved scheme for Bayesian classification of picture elements in polarimetric synthetic-aperture radar image of terrain, priori probability that given picture element belongs to given class, adjusted according to spatial variation of statistical properties of image data. Accuracy increases dramatically in first few iterations. Scheme involves sequence of classifications. In first, a priori probability that element belongs to class taken to be constant over the whole image. In subsequent classifications, adaptive a priori probabilities calculated for each picture element.

Van Zyl, Jakob J.↗
NASA NTRS1999

Measuring Greenland Ice Mass Variation With Gravity Recovery and the Climate Experiment Gravity and GPS

The response of the Greenland ice sheet to climate change could significantly alter sea level. The ice sheet was much thicker at the last glacial maximum. To gain insight into the global change process and the future trend, it is important to evaluate the ice mass variation as a function of time and space. The Gravity Recovery and Climate Experiment (GRACE) mission to fly in 2001 for 5 years will measure gravity changes associated with the current ice variation and the solid earth's response to past variations. Our objective is to assess the separability of different change sources, accuracy and resolution in the mass variation determination by the new gravity data and possible Global Positioning System (GPS) bedrock uplift measurements. We use a reference parameter state that follows a dynamic ice model for current mass variation and a variant of the Tushingham and Peltier ICE-3G deglaciation model for historical deglaciation. The current linear trend is also assumed to have started 5 kyr ago. The Earth model is fixed as preliminary reference Earth model (PREM) with four viscoelastic layers. A discrete Bayesian inverse algorithm is developed employing an isotropic Gaussian a priori covariance function over the ice sheet and time. We use data noise predicted by the University of Texas and JPL for major GRACE error sources. A 2 mm/yr uplift uncertainty is assumed for GPS occupation time of 5 years. We then carry out covariance analysis and inverse simulation using GRACE geoid coefficients up to degree 180 in conjunction with a number of GPS uplift rates. Present-day ice mass variation and historical deglaciation are solved simultaneously over 146 grids of roughly 110 km x 110 km and with 6 time increments of 3 kyr each, along with a common starting epoch of the current trend. For present-day ice thickness change, the covariance analysis using GRACE geoid data alone results in a root mean square (RMS) posterior root variance of 2.6 cm/yr, with fairly large a priori uncertainties in the parameters and a Gaussian correlation length of 350 km. Simulated inverse can successfully recover most features in the reference present-day change. The RMS difference between them over the grids is 2.8 cm/yr. The RMS difference becomes 1.1 cm/yr when both are averaged with a half Gaussian wavelength of 150 km. With a fixed Earth model, GRACE alone can separate the geoid signals due to past and current load fairly well. Shown are the reference geoid signatures of direct and elastic effects of the current trend, the viscoelastic effect of the same trend starting from 5 kyr ago, the Post Glacial Rebound (PGR), and the predicted GRACE geoid error. The difference between the reference and inverse modeled total viscoelastic signatures is also shown. Although past and current ice mass variations are allowed the same spatial scale, their geoid signals have different spatial patterns. GPS data can contribute to the ice mass determination as well. Additional information is contained in the original.

Wu, Xiao-Ping↗
NASA NTRS2011

NASA's Human Mission to a Near-Earth Asteroid: Landing on a Moving Target

This paper describes a Bayesian approach for comparing the productivity and cost-risk tradeoffs of sending versus not sending one or more robotic surveyor missions prior to a human mission to land on an asteroid. The expected value of sample information based on productivity combined with parametric variations in the prior probability an asteroid might be found suitable for landing were used to assess the optimal number of spacecraft and asteroids to survey. The analysis supports the value of surveyor missions to asteroids and indicates one launch with two spacecraft going simultaneously to two independent asteroids appears optimal.

precursor decision making↗
NASA NTRS2009

Parametric Analysis of a Hover Test Vehicle using Advanced Test Generation and Data Analysis

Large complex aerospace systems are generally validated in regions local to anticipated operating points rather than through characterization of the entire feasible operational envelope of the system. This is due to the large parameter space, and complex, highly coupled nonlinear nature of the different systems that contribute to the performance of the aerospace system. We have addressed the factors deterring such an analysis by applying a combination of technologies to the area of flight envelop assessment. We utilize n-factor (2,3) combinatorial parameter variations to limit the number of cases, but still explore important interactions in the parameter space in a systematic fashion. The data generated is automatically analyzed through a combination of unsupervised learning using a Bayesian multivariate clustering technique (AutoBayes) and supervised learning of critical parameter ranges using the machine-learning tool TAR3, a treatment learner. Covariance analysis with scatter plots and likelihood contours are used to visualize correlations between simulation parameters and simulation results, a task that requires tool support, especially for large and complex models. We present results of simulation experiments for a cold-gas-powered hover test vehicle.

Gundy-Burlet, Karen↗