Search NASA⌕ Search

SEARCH · Search NASA

Results for “marginal likelihood”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Improved Nested Sampling and Surrogate-Enabled Comparison With Other Marginal Likelihood Estimators

Estimating marginal likelihood is of central importance to Bayesian model selection and/or model averaging. The nested sampling method has been recently used together with the Metropolis-Hasting (M-H) sampling algorithm for estimating marginal likelihood. This study develops a new implementation of nested sampling by using the DiffeRential Evolution Adaptive Metropolis (DREAMzs) sampling algorithm. The two implementations of nested sampling are evaluated for four models of a synthetic groundwater flow modeling. The DREAMzs-based nested sampling outperforms the M-H-based nested sampling in terms of their accuracy, convergence, efficiency, and stability, which is attributed to the fact that DREAMzs is more robust than M-H for parameter sampling. The nested sampling method is also compared with four other methods (arithmetic mean, harmonic mean, stabilized harmonic mean, and thermodynamic integration) commonly used for estimating marginal likelihood and posterior probability of the four groundwater models. The comparative study requires hundreds of millions of model executions, which would not be possible without using surrogate models to replace the original models. Using the arithmetic mean estimator as the reference, the comparison reveals that thermodynamic integration outperforms nested sampling in terms of accuracy and stability, whereas nested sampling is more computationally efficient to reach to convergence. Here, the harmonic mean and stabilized harmonic mean methods give the worst marginal likelihood estimation. Accurate marginal likelihood estimation is important for accurate estimation of posterior model probability and better predictive performance of Bayesian model averaging.

54 ENVIRONMENTAL SCIENCES↗

Non -degenerate marginal-likelihood calibration with application to quantum characterization

Here, we propose a marginal likelihood strategy within the Kennedy-O’Hagan (KOH) Bayesian framework, where a Gaussian process (GP) models the discrepancy between a physical system and its simulator. Our approach introduces a novel marginalized likelihood by integrating out the degenerate eigenspace of the covariance matrix, rather than approximating the original likelihood. Unlike approximation methods that compromise accuracy for computational efficiency, our method defines an exact likelihood—distinct from the original but preserving all relevant information. This formulation achieves computational efficiency and stability, even for large datasets where the covariance matrix nears degeneracy. Applied to the characterization of a superconducting quantum device at Lawrence Livermore National Laboratory, the approach enhances the predictive accuracy of the Lindblad master equations for modeling Ramsey measurement data by effectively quantifying uncertainties consistent with the quantum data.

general physics↗

Evaluating marginal likelihood with thermodynamic integration method and comparison with several other numerical methods

Evaluating marginal likelihood is the most critical and computationally expensive task, when conducting Bayesian model averaging to quantify parametric and model uncertainties. The evaluation is commonly done by using Laplace approximations to evaluate semianalytical expressions of the marginal likelihood or by using Monte Carlo (MC) methods to evaluate arithmetic or harmonic mean of a joint likelihood function. This study introduces a new MC method, i.e., thermodynamic integration, which has not been attempted in environmental modeling. Instead of using samples only from prior parameter space (as in arithmetic mean evaluation) or posterior parameter space (as in harmonic mean evaluation), the thermodynamic integration method uses samples generated gradually from the prior to posterior parameter space. This is done through a path sampling that conducts Markov chain Monte Carlo simulation with different power coefficient values applied to the joint likelihood function. The thermodynamic integration method is evaluated using three analytical functions by comparing the method with two variants of the Laplace approximation method and three MC methods, including the nested sampling method that is recently introduced into environmental modeling. The thermodynamic integration method outperforms the other methods in terms of their accuracy, convergence, and consistency. The thermodynamic integration method is also applied to a synthetic case of groundwater modeling with four alternative models. The application shows that model probabilities obtained using the thermodynamic integration method improves predictive performance of Bayesian model averaging. As a result, the thermodynamic integration method is mathematically rigorous, and its MC implementation is computationally general for a wide range of environmental problems.

97 MATHEMATICS AND COMPUTING↗

Development and application of marginal likelihood optimization for integral parameter adjustment

When adjusting nuclear data with integral experiments, care must be taken that spurious adjustments are not made by assimilating poorly characterized integral parameters. If there are unaccounted for biases or poorly estimated uncertainties in the calculated and experimental values for an integral parameter, the Bayesian data assimilation may adjust the nuclear data in a manner that does not reflect the physics of the integral parameter. To identify and lessen the impact of these inconsistent integral parameters, in this study we present a Marginal Likelihood Optimization algorithm. In a data-driven way, the marginalized likelihood is used to modulate hyperparameter terms that decrease the influence of inconsistent integral parameters on the adjustment. The advantage of this approach over other methods in the literature is that it incorporates correlation information and does not remove an integral parameter from the adjustment. Herein, we present and motivate the algorithm, and apply it to an integral data assimilation case study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sampling Functions from Gaussian Processes and Structured Covariance Gaussian Networks

When learning aerodynamic models from data, it is critical to incorporate estimates of model uncertainty. This motivates the design of probabilistic aerodynamic databases which can be sampled to generate physically and statistically plausible aerodynamic models. In this talk we discuss how to sample deterministic functions from two different kinds of probabilistic models and demonstrate their use. First, Gaussian Process Regressors (GPRs) are a widely used probabilistic kernel-based model which can be thought of as Gaussian distributions over functions. GPRs are generally trained by maximizing the marginal likelihood of seeing the training data over the kernel parameter space. Sample functions are easily generated by drawing points from the Gaussian distribution at desired input points. However, when the points are not known ahead of time, the classical sampling approach is not possible since successive function samples will generate different function realizations. We present an approach for sampling consistent function evaluations from a GPR over multiple samples. Second, we describe a neural network architecture which learns a conditional Gaussian distribution by maximizing the marginal likelihood at each point in the input space. We then discuss and compare several options for generating sample functions which match this distribution. Finally, we demonstrate the use of these probabilistic aerodynamic models in an atmospheric reentry simulation.

Gaussian process regression↗

Cosmic temperature fluctuations from two years of COBE differential microwave radiometers observations

The first two years of Cosmic Background Explorer (COBE) Differential Microwave Radiometers (DMR) observations of the cosmic microwave background (CMB) anisotropy are analyzed and compared with our previously published first year results. The results are consistent, but the addition of the second year of data increases the precision and accuracy detected CMB temperature fluctuations. The 2 yr 53 GHz data are characterized by rms temperature fluctuations of (delta-T)(sub rms) (7 deg) = 44 +/- 7 micro-K and (delta-T)(sub rms) (10 deg) = 30.5 +/- 2.7 micro-K at 7 deg and 10 deg angular resolution, respectively. The 53 x 90 GHz cross-correlation amplitude at zero lag is C(0)(sup 1/2) = 36 +/- 5 micro-K (68% CL) for the unsmoothed (7 deg resolution) DMR data. We perform a likelihood analysis of the cross-correlation function, with Monte Carlo simulations to infer biases of the method, for a power-law model of initial density fluctuations, P(k) proportional to R(exp n). The Monte Carlo simulations indicate that derived estimates of n are biased by +0.11 +/- 0.01, while the subset of simulations with a low quadrupole (as observed) indicate a bias of +0.31+/- 0.04. Derived values for 68% confidence intervals are given corrected (and not corrected) for our estimated biases. Including the quadrupole anisotropy, the most likely quadrupole-normalized amplitude is Q(sub rms-PS) = 14.3(sup + 5.2 sub -3.3) micro-K (12.8(sup + 5.2 sub -3.3) micro-K0 with a spectral index n = 1.42(sup + 0.49 sub -0.55)(n = 1.53(sup + 0.49 sub -0.55). With n fixed to 1.0 the most likely amplitude is 18.2 +/- 11.5 micro-K (17.4 +/- 1.5 micro-K). The marginal likelihood of n is 1.42 +/- 0.37 (1.53 +/- 0.37). Excluding the quadrupole anisotropy, the most likely quadrupole-normalized amplitude is Q(sub rms-PS) = 17.4(sup + 7.5 sub -5.2) micro-K (15.8(sup + 7.5 sub -5.2) micro-K) with a spectral index n = 1.11(sup + 0.60 sub -0.55) (n = 1.22(sup + 0.60 sub -0.55). With n fixed to 1.0 the most likely amplitude is 18.6 +/- 1.6 micro-K (18.2 +/- 1.6 micro-K). The marginal likelihood of n is 1.11 +/- 0.40 (1.22 +/- 0.40). Our best estimate of the dipole from the 2 yr DMR data is 3.363 +/- 0.024 mK toward Galactic coordinates (l, b) = (264.4 deg +/- 0.2 deg, 48.1 deg +/- 0.4 deg), and our best estimate of the rms quadrupole amplitude in our sky is 6 +/- 3 micro-K (68% CL).

Bennett, C. L.↗

Modeling strength and failure variability due to porosity in additively manufactured metals

To model and quantify the variability in plasticity and failure of additively manufactured metals due to imperfections in their microstructure, we have developed uncertainty quantification methodology based on pseudo marginal likelihood and embedded variability techniques. We account for both the porosity resolvable in computed tomography scans of the initial material and the sub-threshold distribution of voids through a physically motivated model. Calibration of the model indicates that the sub-threshold population of defects dominates the yield and failure response. Finally, the technique also allows us to quantify the distribution of material parameters connected to microstructural variability created by the manufacturing process, and, thereby, make assessments of material quality and process control.

36 MATERIALS SCIENCE↗

Extreme data compression for the CMB

We apply the Karhunen-Loéve methods to cosmic microwave background (CMB) data sets, and show that we can recover the input cosmology and obtain the marginalized likelihoods in Λ cold dark matter cosmologies in under a minute, much faster than Markov chain Monte Carlo methods. This is achieved by forming a linear combination of the power spectra at each multipole l, and solving a system of simultaneous equations such that the Fisher matrix is locally unchanged. Instead of carrying out a full likelihood evaluation over the whole parameter space, we need evaluate the likelihood only for the parameter of interest, with the data compression effectively marginalizing over all other parameters. The weighting vectors contain insight about the physical effects of the parameters on the CMB anisotropy power spectrum C l . The shape and amplitude of these vectors give an intuitive feel for the physics of the CMB, the sensitivity of the observed spectrum to cosmological parameters, and the relative sensitivity of different experiments to cosmological parameters. We test this method on exact theory C l as well as on a Wilkinson Microwave Anisotropy Probe (WMAP)-like CMB data set generated from a random realization of a fiducial cosmology, comparing the compression results to those from a full likelihood analysis using CosmoMC. Furthermore, after showing that the method works, we apply it to the temperature power spectrum from the WMAP seven-year data release, and discuss the successes and limitations of our method as applied to a real data set.

79 ASTRONOMY AND ASTROPHYSICS↗

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas↗

Comoving Stars in Gaia DR1: An Abundance of Very Wide Separation Comoving Pairs

The primary sample of the Gaia Data Release 1 is the Tycho-Gaia Astrometric Solution (TGAS): ≈2 million Tycho-2 sources with improved parallaxes and proper motions relative to the initial catalog. This increased astrometric precision presents an opportunity to find new binary stars and moving groups. We search for high-confidence comoving pairs of stars in TGAS by identifying pairs of stars consistent with having the same 3D velocity using a marginalized likelihood ratio test to discriminate candidate comoving pairs from the field population. Although we perform some visualizations using (bias-corrected) inverse parallax as a point estimate of distance, the likelihood ratio is computed with a probabilistic model that includes the covariances of parallax and proper motions and marginalizes the (unknown) true distances and 3D velocities of the stars. We find 13,085 comoving star pairs among 10,606 unique stars with separations as large as 10 pc (our search limit). Some of these pairs form larger groups through mutual comoving neighbors: many of these pair networks correspond to known open clusters and OB associations, but we also report the discovery of several new comoving groups. Most surprisingly, we find a large number of very wide (>1 pc) separation comoving star pairs, the number of which increases with increasing separation and cannot be explained purely by false-positive contamination. Our key result is a catalog of high-confidence comoving pairs of stars in TGAS. We discuss the utility of this catalog for making dynamical inferences about the Galaxy, testing stellar atmosphere models, and validating chemical abundance measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Matter Constraints from a Unified Analysis of Strong Gravitational Lenses and Milky Way Satellite Galaxies

Joint analyses of small-scale cosmological structure probes have been relatively unexplored yet promise to advance measurements of microphysical dark matter properties using heterogeneous data. Here, we present a multidimensional analysis of dark matter substructure using strong gravitational lenses and the Milky Way (MW) satellite galaxy population, accounting for degeneracies in model predictions and using covariances in the constraining power of these individual probes for the first time. We simultaneously infer the projected subhalo number density and the half-mode mass describing the suppression of the subhalo mass function in thermal relic warm dark matter (WDM), $M_{\mathrm{hm}}$, using the semianalytic model \texttt{Galacticus} to connect the subhalo population inferred from MW satellite observations to the strong lensing host halo mass and redshift regime. Combining MW satellite and strong lensing posteriors in this parameter space yields $M_{\mathrm{hm}}<10^{7.0}\ M_{\mathrm{\odot}}$ (WDM particle mass $m_{\mathrm{WDM}}>9.7\ \mathrm{keV}$) at $95\%$ confidence and disfavors $M_{\mathrm{hm}}=10^{7.4}\ M_{\mathrm{\odot}}$ ($m_{\mathrm{WDM}}=7.4\ \mathrm{keV}$) with a 20:1 marginal likelihood ratio, improving limits on $m_{\mathrm{WDM}}$ set by the two methods independently by $\sim 30\%$. These results are marginalized over the line-of-sight contribution to the strong lensing signal, the mass of the MW host halo, and the efficiency of subhalo disruption due to baryons and are robust to differences in the disruption efficiency between the MW and strong lensing regimes at the $\sim 10\%$ level. This work paves the way for unified analyses of next-generation small-scale structure measurements covering a wide range of scales and redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be-+12.390.981.30km and-+2.0720.0660.067Me respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is=-+TlogK5.99100.060.05([])for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters(within the prior support)and can thus be computed from the posterior samples.

Millisecond pulsars↗

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be ${12.39}_{-0.98}^{+1.30}$ km and ${2.072}_{-0.066}^{+0.067}$ M ⊙ respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is ${\mathrm{log}}_{10}(T\,[{\rm{K}}])={5.99}_{-0.06}^{+0.05}$ for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Furthermore, our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters (within the prior support) and can thus be computed from the posterior samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Marginalizing instrument systematics in HST WFC3 transit light curves

Hubble Space Telescope (HST) Wide Field Camera 3 (WFC3) infrared observations at 1.1–1.7 μm probe primarily the H{sub 2}O absorption band at 1.4 μm, and have provided low-resolution transmission spectra for a wide range of exoplanets. We present the application of marginalization based on Gibson to analyze exoplanet transit light curves obtained from HST WFC3 to better determine important transit parameters such as R{sub p}/R{sub *}, which are important for accurate detections of H{sub 2}O. We approximate the evidence, often referred to as the marginal likelihood, for a grid of systematic models using the Akaike Information Criterion. We then calculate the evidence-based weight assigned to each systematic model and use the information from all tested models to calculate the final marginalized transit parameters for both the band-integrated and spectroscopic light curves to construct the transmission spectrum. We find that a majority of the highest weight models contain a correction for a linear trend in time as well as corrections related to HST orbital phase. We additionally test the dependence on the shift in spectral wavelength position over the course of the observations and find that spectroscopic wavelength shifts δ{sub λ}(λ) best describe the associated systematic in the spectroscopic light curves for most targets while fast scan rate observations of bright targets require an additional level of processing to produce a robust transmission spectrum. The use of marginalization allows for transparent interpretation and understanding of the instrument and the impact of each systematic evaluated statistically for each data set, expanding the ability to make true and comprehensive comparisons between exoplanet atmospheres.

79 ASTRONOMY AND ASTROPHYSICS↗

Marginalizing Instrument Systematics in HST WFC3 Transit Light Curves

Hubble Space Telescope (HST) Wide Field Camera 3 (WFC3) infrared observations at 1.1-1.7 microns probe primarily the H2O absorption band at 1.4 microns, and have provided low-resolution transmission spectra for a wide range of exoplanets. We present the application of marginalization based on Gibson to analyze exoplanet transit light curves obtained from HST WFC3 to better determine important transit parameters such as "ramp" probability (R (sub p)) divided by "ramp" total (R (sub asterisk)), which are important for accurate detections of H2O. We approximate the evidence, often referred to as the marginal likelihood, for a grid of systematic models using the Akaike Information Criterion. We then calculate the evidence-based weight assigned to each systematic model and use the information from all tested models to calculate the final marginalized transit parameters for both the band-integrated and spectroscopic light curves to construct the transmission spectrum. We find that a majority of the highest weight models contain a correction for a linear trend in time as well as corrections related to HST orbital phase. We additionally test the dependence on the shift in spectral wavelength position over the course of the observations and find that spectroscopic wavelength shifts delta (sub lambda) times lambda) best describe the associated systematic in the spectroscopic light curves for most targets while fast scan rate observations of bright targets require an additional level of processing to produce a robust transmission spectrum. The use of marginalization allows for transparent interpretation and understanding of the instrument and the impact of each systematic evaluated statistically for each data set, expanding the ability to make true and comprehensive comparisons between exoplanet atmospheres.

Wakeford, H. R.↗

DEVELOPING ATMOSPHERIC RETRIEVAL METHODS FOR DIRECT IMAGING SPECTROSCOPY OF GAS GIANTS IN REFLECTED LIGHT. I. METHANE ABUNDANCES AND BASIC CLOUD PROPERTIES

Upcoming space-based coronagraphic instruments in the next decade will perform reflected light spectroscopy and photometry of cool directly imaged extrasolar giant planets. We are developing a new atmospheric retrieval methodology to help assess the science return and inform the instrument design for such future missions, and ultimately interpret the resulting observations. Our retrieval technique employs a geometric albedo model coupled with both a Markov chain Monte Carlo Ensemble Sampler ( emcee ) and a multimodal nested sampling algorithm ( MultiNest ) to map the posterior distribution. This combination makes the global evidence calculation more robust for any given model and highlights possible discrepancies in the likelihood maps. As a proof of concept, our current atmospheric model contains one or two cloud layers, methane as a major absorber, and a H{sub 2}–He background gas. This 6-to-9 parameter model is appropriate for Jupiter-like planets and can be easily expanded in the future. In addition to deriving the marginal likelihood distribution and confidence intervals for the model parameters, we perform model selection to determine the significance of methane and cloud detection as a function of expected signal-to-noise ratio in the presence of spectral noise correlations. After internal validation, the method is applied to realistic spectra of Jupiter, Saturn, and HD 99492c, a model observing target. We find that the presence or absence of clouds and methane can be determined with high confidence, while parameter uncertainties are model dependent and correlated. Such general methods will also be applicable to the interpretation of direct imaging spectra of cloudy terrestrial planets.

79 ASTRONOMY AND ASTROPHYSICS↗

On determining the spectrum of primordial inhomogeneity from the COBE DMR sky maps: Results of two-year data analysis

A new technique of Fourier analysis on a cut sky has been applied to the two-year Cosmic Background Explorer (COBE) Differential Microwave Radiometer (DMR) 53 and 90 GHz sky maps. The Bayesian power spectrum estimation results are consistent with the Harrison-Zel'dovich n = 1 model. The maximum likelihood estimates of the usual parameters defining the power spectrum of primordial perturbations are n = 1.22 (1.02) and Q(sub rms-PS) = 17 (20) microK including (excluding) the quadrupole. A spectral-index-independent normalization is naturally expressed for the two-year maps in terms of the multipole amplitude a(sub 9) = 8.2 (8.3) microK (to approximately 12 sigma significance). The marginal likelihood function on n obtained by intergration with respect to a(sub 9) renders n = 1.17 +/- 0.31 (0.96 +/- 0.36).

Gorski, K. M.↗