Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian parameter estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Bayesian approach to model-based extrapolation of nuclear observables

Here, we considered 10 global models based on nuclear density functional theory with realistic energy density functionals as well as two more phenomenological mass models. The emulators of two-neutron separation energy residuals and Bayesian confidence intervals defining theoretical error bars were constructed using Bayesian Gaussian processes and Bayesian neural networks. By establishing statistical methodology and parameters, we carried out extrapolations toward the two-neutron dripline. While both Gaussian processes (GP) and Bayesian neural networks reduce the root-mean-square (rms) deviation from experiment significantly, GP offers a better and much more stable performance. The increase in the predictive power of microscopic models aided by the statistical treatment is quite astonishing: The resulting rms deviations from experiment on the testing dataset are similar to those of more phenomenological models. The estimated credibility intervals on predictions make it possible to evaluate predictive power of individual models and also make quantified predictions using groups of models. The proposed robust statistical approach to extrapolation of nuclear model results can be useful for assessing the impact of current and future experiments in the context of model developments. The new Bayesian capability to evaluate residuals is also expected to impact research in the domains where experiments are currently impossible, for instance, in simulations of the astrophysical r process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Castagna, M., M. W. Becker, and A. Bellin (2011), Joint estimation of transmissivity and storativity in a bedrock fracture, Water Resour. Res., 47, W09504, doi:10.1029/2010WR009262.

The spatial variability of transmissivity (T) and storativity (S) in a sandstone bedding plane fracture was investigated through field and numerical hydraulic tomography experiments. Cross-hole pumping tests were conducted in a single subhorizontal bedrock fracture, thereby constraining the problem to two dimensions. A Bayesian method implementing pilot points was used to invert the drawdown, under the hypothesis that T and S are independent random space functions, where integral scale, mean, and variance of the random fields were parameters of inversion in addition to pilot point values. An ensemble of 20 Monte Carlo realizations was created for each model scenario. Inversion of the measured cross-hole drawdown resulted in spatially variable T and S fields. To determine the accuracy of the method, a suite of synthetic inversions modeled after the field site were also conducted. The synthetic experiments demonstrate that the assumed spatial structure of S influences the accuracy of both the T and S inversions. When the S field is spatially heterogeneous and is assumed to be heterogeneous in the inversion, a consistent representation of the T and S fields is obtained. When the S field is spatially heterogeneous but is assumed to be homogeneous in the inversion, a consistent representation of the T field is still obtained, but the S field is entirely misrepresented; if the S field is actually homogeneous but assumed to be heterogeneous, a poor representation of the T and S fields is obtained along with high uncertainty in the inversion statistics of confidence.

54 ENVIRONMENTAL SCIENCES↗

Encoding nonlinear and unsteady aerodynamics of limit cycle oscillations using nonlinear sparse Bayesian learning

This article investigates the applicability of a recently proposed, nonlinear sparse Bayesian learning (NSBL) algorithm to identify and estimate the complex aerodynamics of limit cycle oscillations. NSBL provides a semi-analytical framework for determining the data-optimal sparse model nested within a (potentially) over-parameterized model. This is particularly relevant to nonlinear dynamical systems where modelling approaches involve the use of physics-based and data-driven components. In such cases, the data-driven components, where analytical descriptions of the physical processes are not readily available, are often prone to overfitting, meaning that the empirical aspects of these models will often involve the calibration of an unnecessarily large number of parameters. While an overparameterized model may fit the observed data well, such models may be inadequate for making predictions in regimes that are different from those wherein the data were recorded. In view of this, it is desirable to not only calibrate the model parameters, but also identify the optimal compromise between data fit and model complexity. In this article, we exhibit the optimal model discovery for an aeroelastic system wherein the structural dynamics are well-known and described by a differential equation model, coupled with a semi-empirical aerodynamic model for laminar separation flutter, resulting in low-amplitude limit cycle oscillations (LCO). To illustrate the performance of the algorithm, in this article, we use synthetic data and demonstrate the ability of the algorithm to correctly rediscover the optimal model and model parameters, given a known data-generating model. The synthetic data are generated from a forward simulation of a known differential equation model with parameters selected so as to mimic the dynamics observed in wind-tunnel experiments. Subsequently, we demonstrate the performance of the algorithm for model selection using noisy LCO data from wind tunnel experiments. As there is no ground truth available for the experimental data case, we provide a comparison between NSBL and Bayesian model selection to validate the results, and demonstrate the use of NSBL as an efficient alternative to traditional methods.

97 MATHEMATICS AND COMPUTING↗

WE-E-BRE-05: Ensemble of Graphical Models for Predicting Radiation Pneumontis Risk

Purpose: We propose a prior knowledge-based approach to construct an interaction graph of biological and dosimetric radiation pneumontis (RP) covariates for the purpose of developing a RP risk classifier. Methods: We recruited 59 NSCLC patients who received curative radiotherapy with minimum 6 month follow-up. 16 RP events was observed (CTCAE grade ≥2). Blood serum was collected from every patient before (pre-RT) and during RT (mid-RT). From each sample the concentration of the following five candidate biomarkers were taken as covariates: alpha-2-macroglobulin (α2M), angiotensin converting enzyme (ACE), transforming growth factor β (TGF-β), interleukin-6 (IL-6), and osteopontin (OPN). Dose-volumetric parameters were also included as covariates. The number of biological and dosimetric covariates was reduced by a variable selection scheme implemented by L1-regularized logistic regression (LASSO). Posterior probability distribution of interaction graphs between the selected variables was estimated from the data under the literature-based prior knowledge to weight more heavily the graphs that contain the expected associations. A graph ensemble was formed by averaging the most probable graphs weighted by their posterior, creating a Bayesian Network (BN)-based RP risk classifier. Results: The LASSO selected the following 7 RP covariates: (1) pre-RT concentration level of α2M, (2) α2M level mid- RT/pre-RT, (3) pre-RT IL6 level, (4) IL6 level mid-RT/pre-RT, (5) ACE mid-RT/pre-RT, (6) PTV volume, and (7) mean lung dose (MLD). The ensemble BN model achieved the maximum sensitivity/specificity of 81%/84% and outperformed univariate dosimetric predictors as shown by larger AUC values (0.78∼0.81) compared with MLD (0.61), V20 (0.65) and V30 (0.70). The ensembles obtained by incorporating the prior knowledge improved classification performance for the ensemble size 5∼50. Conclusion: We demonstrated a probabilistic ensemble method to detect robust associations between RP covariates and its potential to improve RP prediction accuracy. Our Bayesian approach to incorporate prior knowledge can enhance efficiency in searching of such associations from data. The authors acknowledge partial support by: 1) CREATE Medical Physics Research Training Network grant of the Natural Sciences and Engineering Research Council (Grant number: 432290) and 2) The Terry Fox Foundation Strategic Training Initiative for Excellence in Radiation Research for the 21st Century (EIRR21)

60 APPLIED LIFE SCIENCES↗

Correcting Satellite Image Derived Surface Model for Atmospheric Effects

This project was a continuation of the project entitled "Resolution Earth Surface Features from Repeat Moderate Resolution Satellite Imagery". In the previous study, a Bayesian Maximum Posterior Estimate (BMPE) algorithm was used to obtain a composite series of repeat imagery from the Advanced Very High Resolution Radiometer (AVHRR). The spatial resolution of the resulting composite was significantly greater than the 1 km resolution of the individual AVHRR images. The BMPE algorithm utilized a simple, no-atmosphere geometrical model for the short-wave radiation budget at the Earth's surface. A necessary assumption of the algorithm is that all non geometrical parameters remain static over the compositing period. This assumption is of course violated by temporal variations in both the surface albedo and the atmospheric medium. The effect of the albedo variations is expected to be minimal since the variations are on a fairly long time scale compared to the compositing period, however, the atmospheric variability occurs on a relatively short time scale and can be expected to cause significant errors in the surface reconstruction. The current project proposed to incorporate an atmospheric correction into the BMPE algorithm for the purpose of investigating the effects of a variable atmosphere on the surface reconstructions. Once the atmospheric effects were determined, the investigation could be extended to include corrections various cloud effects, including short wave radiation through thin cirrus clouds. The original proposal was written for a three year project, funded one year at a time. The first year of the project focused on developing an understanding of atmospheric corrections and choosing an appropriate correction model. Several models were considered and the list was narrowed to the two best suited. These were the 5S and 6S shortwave radiation models developed at NASA/GODDARD and tested extensively with data from the AVHRR instrument. Although the 6S model was a successor to the 5S and slightly more advanced, the 5S was selected because outputs from the individual components comprising the short-wave radiation budget were more easily separated. The separation was necessary since both the 5S and 6S did not include geometrical corrections for terrain, a fundamental constituent of the BMPE algorithm. The 5S correction code was incorporated into the BMPE algorithm and many sensitivity studies were performed.

Emery, William↗

Stochastic Inversion of 2D Magnetotelluric Data

The algorithm is developed to invert 2D magnetotelluric (MT) data based on sharp boundary parametrization using a Bayesian framework. Within the algorithm, we consider the locations and the resistivity of regions formed by the interfaces are as unknowns. We use a parallel, adaptive finite-element algorithm to forward simulate frequency-domain MT responses of 2D conductivity structure. Those unknown parameters are spatially correlated and are described by a geostatistical model. The joint posterior probability distribution function is explored by Markov Chain Monte Carlo (MCMC) sampling methods. The developed stochastic model is effective for estimating the interface locations and resistivity. Most importantly, it provides details uncertainty information on each unknown parameter. Hardware requirements: PC, Supercomputer, Multi-platform, Workstation; Software requirements C and Fortan; Operation Systems/version is Linux/Unix or Windows

Chen, Jinsong↗

Smoothing-based compressed state Kalman filter for joint state-parameter estimation: Applications in reservoir characterization and CO 2 storage monitoring

The operation of most engineered hydrogeological systems relies on simulating physical processes using numerical models with uncertain parameters and initial conditions. Predictions by such uncertain models can be greatly improved by Kalman-filter techniques that sequentially assimilate monitoring data. Each assimilation constitutes a nonlinear optimization, which is solved by linearizing an objective function about the model prediction and applying a linear correction to this prediction. However, if model parameters and initial conditions are uncertain, the optimization problem becomes strongly nonlinear and a linear correction may yield unphysical results. In this paper, we investigate the utility of one-step ahead smoothing, a variant of the traditional filtering process, to eliminate nonphysical results and reduce estimation artifacts caused by nonlinearities. Here, we present the smoothing-based compressed state Kalman filter (sCSKF), an algorithm that combines one step ahead smoothing, in which current observations are used to correct the state and parameters one step back in time, with a nonensemble covariance compression scheme, that reduces the computational cost by efficiently exploring the high-dimensional state and parameter space. Numerical experiments show that when model parameters are uncertain and the states exhibit hyperbolic behavior with sharp fronts, as in CO 2 storage applications, one-step ahead smoothing reduces overshooting errors and, by design, gives physically consistent state and parameter estimates. We compared sCSKF with commonly used data assimilation methods and showed that for the same computational cost, combining one step ahead smoothing and nonensemble compression is advantageous for real-time characterization and monitoring of large-scale hydrogeological systems with sharp moving fronts.

42 ENGINEERING↗

Semisupervised Classification of Texts Using Particle Learning for Probabilistic Automata

This chapter presents a novel online learning system for classification of email texts based on particle learning for composite mixture models involving probabilistic automata. The composite mixture structure allows specification of a joint probability model for heterogeneous collections of independent variables without requiring complex embeddings via generalized linear models or copula techniques. The chapter is organized as follows. Section 12.2 presents a hierarchical model representation of a class of probabilistic automata and derives the particle learning algorithm for obtaining parameter estimates. Section 12.3 describes a framework for semisupervised text classification problems based on a composite mixture model formulation. Section 12.4 discusses an application of the classifier to a spam detection dataset. Section 12.5 concludes with a discussion of computational considerations and future work.

97 MATHEMATICS AND COMPUTING↗

BAYESIAN MAGNETOHYDRODYNAMIC SEISMOLOGY OF CORONAL LOOPS

We perform a Bayesian parameter inference in the context of resonantly damped transverse coronal loop oscillations. The forward problem is solved in terms of parametric results for kink waves in one-dimensional flux tubes in the thin tube and thin boundary approximations. For the inverse problem, we adopt a Bayesian approach to infer the most probable values of the relevant parameters, for given observed periods and damping times, and to extract their confidence levels. The posterior probability distribution functions are obtained by means of Markov Chain Monte Carlo simulations, incorporating observed uncertainties in a consistent manner. We find well-localized solutions in the posterior probability distribution functions for two of the three parameters of interest, namely the Alfven travel time and the transverse inhomogeneity length scale. The obtained estimates for the Alfven travel time are consistent with previous inversion results, but the method enables us to additionally constrain the transverse inhomogeneity length scale and to estimate real error bars for each parameter. When observational estimates for the density contrast are used, the method enables us to fully constrain the three parameters of interest. These results can serve to improve our current estimates of unknown physical parameters in coronal loops and to test the assumed theoretical model.

79 ASTRONOMY AND ASTROPHYSICS↗

Variability Timescale and Spectral Index of Sgr A* in the Near Infrared: Approximate Bayesian Computation Analysis of the Variability of the Closest Supermassive Black Hole

Sagittarius A* (Sgr A* ) is the variable radio, near-infrared (NIR), and X-ray source associated with accretion onto the Galactic center black hole. We present an analysis of the most comprehensive NIR variability data set of Sgr A* to date: eight 24 hr epochs of continuous monitoring of Sgr A* at 4.5 μm with the IRAC instrument on the Spitzer Space Telescope, 93 epochs of 2.18 μm data from Naos Conica at the Very Large Telescope, and 30 epochs of 2.12 μm data from the NIRC2 camera at the Keck Observatory, in total 94,929 measurements. A new approximate Bayesian computation method for fitting the first-order structure function extracts information beyond current fast Fourier transformation (FFT) methods of power spectral density (PSD) estimation. With a combined fit of the data of all three observatories, the characteristic coherence timescale of Sgr A* is b 243 57 82 t = - + minutes (90% credible interval). The PSD has no detectable features on timescales down to 8.5 minutes (95% credible level), which is the ISCO orbital frequency for a dimensionless spin parameter a = 0.92. One light curve measured simultaneously at 2.12 and 4.5 μm during a low flux-density phase gave a spectral index αs = 1.6 ± 0.1 (F µ n s n -a ). This value implies that the Sgr A* NIR color becomes bluer during higher flux-density phases. The probability densities of flux densities of the combined data sets are best fit by log-normal distributions. Based on these distributions, the Sgr A* spectral energy distribution is consistent with synchrotron radiation from a nonthermal electron population from below 20 GHz through the NIR.

accretion↗

Quantifying modeling uncertainty in simplified beam models for building response prediction

The use of simple models for response prediction of building structures is preferred in earthquake engineering for risk evaluations at regional scales, as they make computational studies more feasible. The primary impediment in their gainful use presently is the lack of viable methods for quantifying (and reducing upon) the modeling errors/uncertainties they bear. This study presents a Bayesian calibration method wherein the modeling error is embedded into the parameters of the model. Here, the method is specifically described for coupled shear-flexural beam models here, but it can be applied to any parametric surrogate model. The major benefit the method offers is the ability to consider the modeling uncertainty in the forward prediction of any degree-of-freedom or composite response regardless of the data used in calibration. The method is extensively verified using two synthetic examples. In the first example, the beam model is calibrated to represent a similar beam model but with enforced modeling errors. In the second example, the beam model is used to represent the detailed finite element model of a 52-story building. Both examples show the capability of the proposed solution to provide realistic uncertainty estimation around the mean prediction.

47 OTHER INSTRUMENTATION↗

Probabilistic Context Neighborhood model for lattices

Here we present the Probabilistic Context Neighborhood model designed for two-dimensional lattices as a variation of a Markov random field assuming discrete values. In this model, the neighborhood structure has a fixed geometry but a variable order, depending on the neighbors’ values. Our model extends the Probabilistic Context Tree model, originally applicable to one-dimensional space. It retains advantageous properties, such as representing the dependence neighborhood structure as a graph in a tree format, facilitating an understanding of model complexity. Furthermore, we adapt the algorithm used to estimate the Probabilistic Context Tree to estimate the parameters of the proposed model. We illustrate the accuracy of our estimation methodology through simulation studies. Additionally, we apply the Probabilistic Context Neighborhood model to spatial real-world data, showcasing its practical utility.

97 MATHEMATICS AND COMPUTING↗

An efficient Bayesian data-worth analysis using a multilevel Monte Carlo method

Improving the understanding of subsurface systems and thus reducing prediction uncertainty requires collection of data. As the collection of subsurface data is costly, it is important that the data collection scheme is cost-effective. Design of a cost-effective data collection scheme, i.e., data-worth analysis, requires quantifying model parameter, prediction, and both current and potential data uncertainties. Assessment of these uncertainties in large-scale stochastic subsurface hydrological model simulations using standard Monte Carlo (MC) sampling or surrogate modeling is extremely computationally intensive, sometimes even infeasible. In this paper, we propose an efficient Bayesian data-worth analysis using a multilevel Monte Carlo (MLMC) method. Compared to the standard MC that requires a significantly large number of high-fidelity model executions to achieve a prescribed accuracy in estimating expectations, the MLMC can substantially reduce computational costs using multifidelity approximations. Since the Bayesian data-worth analysis involves a great deal of expectation estimation, the cost saving of the MLMC in the assessment can be outstanding. While the proposed MLMC-based data-worth analysis is broadly applicable, we use it for a highly heterogeneous two-phase subsurface flow simulation to select an optimal candidate data set that gives the largest uncertainty reduction in predicting mass flow rates at four production wells. Finally, the choices made by the MLMC estimation are validated by the actual measurements of the potential data, and consistent with the standard MC estimation. But compared to the standard MC, the MLMC greatly reduces the computational costs.

97 MATHEMATICS AND COMPUTING↗

Parameter Estimation with Entangled Photons Produced by Parametric Down-Conversion

We explore the advantages offered by twin light beams produced in parametric down-conversion for precision measurement. The symmetry of these bipartite quantum states, even under losses, suggests that monitoring correlations between the divergent beams permits a high-precision inference of any symmetry-breaking effect, e.g., fiber birefringence. We show that the quantity of entanglement is not the key feature for such an instrument. In a lossless setting, scaling of precision at the ultimate ''Heisenberg'' limit is possible with photon counting alone. Even as photon losses approach 100% the precision is shot-noise limited, and we identify the crossover point between quantum and classical precision as a function of detected flux. The predicted hypersensitivity is demonstrated with a Bayesian simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Parameter Estimation with Entangled Photons Produced by Parametric Down-Conversion

We explore the advantages offered by twin light beams produced in parametric down-conversion for precision measurement. The symmetry of these bipartite quantum states, even under losses, suggests that monitoring correlations between the divergent beams permits a high-precision inference of any symmetry-breaking effect, e.g., fiber birefringence. We show that the quantity of entanglement is not the key feature for such an instrument. In a lossless setting, scaling of precision at the ultimate "Heisenberg" limit is possible with photon counting alone. Even as photon losses approach 100% the precision is shot-noise limited, and we identify the crossover point between quantum and classical precision as a function of detected flux. The predicted hypersensitivity is demonstrated with a Bayesian simulation.

Cable, Hugo↗

Survival of Juvenile Florida Scrub-Jays is Habitat Specific, Positively Correlated With Month and Negatively Correlated With Male Breeder Death

Juvenile survival in birds is difficult to estimate but this vital rate can be an important consideration for management decisions. We estimated juvenile survival of cooperatively breeding Florida Scrub-Jays (Aphelocoma coerulescens) in a landscape degraded by fire suppression and fragmentation using data from marked (n = 325) and unmarked juveniles (n = 1,306) with an integrated hierarchical Bayesian model. To assess the combined analyses, we also analyzed these datasets separately, with a Cormack-Jolly-Seber (CJS) model (marked) and young model (unmarked). Our data consisted of monthly censuses of territorial family groups from Florida Scrub-Jay populations in East Central Florida collected over a 22-yr period. Juvenile survival was estimated from July when young Florida Scrub-Jays begin developing independence to March when they become first year individuals and grouped according to the habitat quality class of their natal territory that were based on shrub height (with intermediate shrub heights being optimal and short and tall shrub heights being suboptimal) and the presence of sandy openings (the preferred open having many sandy openings; closed not having enough). Parameter estimates in the combined analysis were intermediate to the separate analyses. Notable differences among the separate analyses were that suboptimal habitat survival was lower in the unmarked analysis, the unmarked analysis showed a linear effect of time not seen in the marked analysis, and there was an effect of male breeder death in the marked but not unmarked analysis. The combined data analysis provided more inference than did either data set analyzed separately including juveniles in optimal-closed territories unexpectedly had higher survival than those in optimal-open, survival increased through time, and male breeder death had a negative effect on survival. This study suggests that optimal-closed habitat may play an important role in juvenile Florida Scrub-Jay survival perhaps by providing better cover from predators and warrants further investigation for management implications.

Florida Scrub-Jay↗

Microsimulation model calibration using incremental mixture approximate Bayesian computation

Microsimulation models (MSMs) are used to inform policy by predicting population-level outcomes under different scenarios. MSMs simulate individual-level event histories that mark the disease process (such as the development of cancer) and the effect of policy actions (such as screening) on these events. MSMs often have many unknown parameters; calibration is the process of searching the parameter space to select parameters that result in accurate MSM prediction of a wide range of targets. We develop Incremental Mixture Approximate Bayesian Computation (IMABC) for MSM calibration which results in a simulated sample from the posterior distribution of model parameters given calibration targets. IMABC begins with a rejection-based ABC step, drawing a sample of points from the prior distribution of model parameters and accepting points that result in simulated targets that are near observed targets. Next, the sample is iteratively updated by drawing additional points from a mixture of multivariate normal distributions and accepting points that result in accurate predictions. Posterior estimates are obtained by weighting the final set of accepted points to account for the adaptive sampling scheme. We demonstrate IMABC by calibrating CRC-SPIN 2.0, an updated version of a MSM for colorectal cancer (CRC) that has been used to inform national CRC screening guidelines.

97 MATHEMATICS AND COMPUTING↗

Assimilation of satellite microwave observations over the rainbands of tropical cyclones

A novel Bayesian Monte Carlo integration (BMCI) technique was developed to retrieve geophysical variables from satellite microwave radiometer data in the presence of tropical cyclones. The BMCI technique includes three steps: generating a stochastic database, simulating satellite brightness temperatures using a radiative transfer model, and retrieving geophysical variables such as profiles of temperature, relative humidity, and cloud liquid and ice water content from real observations. The technique also provides uncertainty estimates for each retrieval and can output the error covariance matrix of selected parameters. The measurements from the Advanced Technology Microwave Sounder (ATMS) on board Suomi National Polar-Orbiting Partnership (Suomi NPP) and the Global Precipitation Measurement (GPM) Microwave Imager (GMI) were used as input. A new technique was developed to correct the ATMS and GMI observations for the beam-filling effect, which is due to small-scale variability of precipitation and clouds when compared with the instrument footprint and also the nonlinear relation between the brightness temperature and precipitation. In addition, the assimilation of the BMCI retrievals into the NASA GEOS model is discussed for Hurricane Maria. The results show that assimilating the BMCI retrievals can influence the dynamical features of the cyclone, including a stronger warm core, a symmetric eye, and vertically aligned wind columns. Two possible factors that may limit the impact of the BMCI retrievals include 1) the resolution of the model (about 25 km), which was too coarse to show the potential of the BMCI data in improving the representation of tropical storms in the model forecast, and 2) the data assimilation system not being able to consider vertically correlated observation errors.

Isaac Moradi↗