Search NASA⌕ Search

SEARCH · Search NASA

Results for “nested sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Surface phase diagrams from nested sampling

From nested sampling, we compute the partition function and, from that, the phase diagram of gas adsorbates, including their anharmonic and configurational degrees of freedom, on flat and stepped surfaces of the Lennard-Jones solid.

Chemistry↗

Improved Nested Sampling and Surrogate-Enabled Comparison With Other Marginal Likelihood Estimators

Estimating marginal likelihood is of central importance to Bayesian model selection and/or model averaging. The nested sampling method has been recently used together with the Metropolis-Hasting (M-H) sampling algorithm for estimating marginal likelihood. This study develops a new implementation of nested sampling by using the DiffeRential Evolution Adaptive Metropolis (DREAMzs) sampling algorithm. The two implementations of nested sampling are evaluated for four models of a synthetic groundwater flow modeling. The DREAMzs-based nested sampling outperforms the M-H-based nested sampling in terms of their accuracy, convergence, efficiency, and stability, which is attributed to the fact that DREAMzs is more robust than M-H for parameter sampling. The nested sampling method is also compared with four other methods (arithmetic mean, harmonic mean, stabilized harmonic mean, and thermodynamic integration) commonly used for estimating marginal likelihood and posterior probability of the four groundwater models. The comparative study requires hundreds of millions of model executions, which would not be possible without using surrogate models to replace the original models. Using the arithmetic mean estimator as the reference, the comparison reveals that thermodynamic integration outperforms nested sampling in terms of accuracy and stability, whereas nested sampling is more computationally efficient to reach to convergence. Here, the harmonic mean and stabilized harmonic mean methods give the worst marginal likelihood estimation. Accurate marginal likelihood estimation is important for accurate estimation of posterior model probability and better predictive performance of Bayesian model averaging.

54 ENVIRONMENTAL SCIENCES↗

Hybrid nested sampling algorithm for Bayesian model selection applied to inverse subsurface flow problems

A Hybrid Nested Sampling (HNS) algorithm is proposed for efficient Bayesian model calibration and prior model selection. The proposed algorithm combines, Nested Sampling (NS) algorithm, Hybrid Monte Carlo (HMC) sampling and gradient estimation using Stochastic Ensemble Method (SEM). NS is an efficient sampling algorithm that can be used for Bayesian calibration and estimating the Bayesian evidence for prior model selection. Nested sampling has the advantage of computational feasibility. Within the nested sampling algorithm, a constrained sampling step is performed. For this step, we utilize HMC to reduce the correlation between successive sampled states. HMC relies on the gradient of the logarithm of the posterior distribution, which we estimate using a stochastic ensemble method based on an ensemble of directional derivatives. SEM only requires forward model runs and the simulator is then used as a black box and no adjoint code is needed. The developed HNS algorithm is successfully applied for Bayesian calibration and prior model selection of several nonlinear subsurface flow problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

nautilus : boosting Bayesian importance nested sampling with deep learning

ABSTRACT We introduce a novel approach to boost the efficiency of the importance nested sampling (INS) technique for Bayesian posterior and evidence estimation using deep learning. Unlike rejection-based sampling methods such as vanilla nested sampling (NS) or Markov chain Monte Carlo (MCMC) algorithms, importance sampling techniques can use all likelihood evaluations for posterior and evidence estimation. However, for efficient importance sampling, one needs proposal distributions that closely mimic the posterior distributions. We show how to combine INS with deep learning via neural network regression to accomplish this task. We also introduce nautilus, a reference open-source python implementation of this technique for Bayesian posterior and evidence estimation. We compare nautilus against popular NS and MCMC packages, including emcee, dynesty, ultranest, and pocomc, on a variety of challenging synthetic problems and real-world applications in exoplanet detection, galaxy SED fitting and cosmology. In all applications, the sampling efficiency of nautilus is substantially higher than that of all other samplers, often by more than an order of magnitude. Simultaneously, nautilus delivers highly accurate results and needs fewer likelihood evaluations than all other samplers tested. We also show that nautilus has good scaling with the dimensionality of the likelihood and is easily parallelizable to many CPUs.

97 MATHEMATICS AND COMPUTING↗

The use of nested sampling in the extraction of polarisation observables at CLAS

The extraction of polarisation observables from photoproduction experiments provides an insight into the spectrum of nucleon resonances and the 'missing resonance' problem. Experiments carried out at JLab, Mainz and Bonn cover a wide range of reactions, which will soon result in the first 'complete measurement' in pseudoscalar meson photoproduction. Traditionally, these measurements have been analysed using frequentist statistics, where parameters are extracted by fitting distributions. An alternative method is the application of Bayesian statistics, where any existing knowledge about the results can be used in the initial conditions. One such application of this is nested sampling. This work discusses nested sampling and how it can be applied to the extraction of spin observables.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nested sampling of isobaric phase space for the direct evaluation of the isothermal-isobaric partition function of atomic systems

Nested Sampling (NS) is a powerful athermal statistical mechanical sampling technique that directly calculates the partition function, and hence gives access to all thermodynamic quantities in absolute terms, including absolute free energies and absolute entropies. NS has been used predominately to compute the canonical (NVT) partition function. Although NS has recently been used to obtain the isothermal-isobaric (NPT) partition function of the hard sphere model, a general approach to the computation of the NPT partition function has yet to be developed. Here, we describe an isobaric NS (IBNS) method which allows for the computation of the NPT partition function of any atomic system. We demonstrate IBNS on two finite Lennard-Jones systems and confirm the results through comparison to parallel tempering Monte Carlo. Temperature-entropy plots are constructed as well as a simple pressure-temperature phase diagram for each system. We further demonstrate IBNS by computing part of the pressure-temperature phase diagram of a Lennard-Jones system under periodic boundary conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HELIOS–RETRIEVAL: An Open-source, Nested Sampling Atmospheric Retrieval Code; Application to the HR 8799 Exoplanets and Inferred Constraints for Planet Formation

We present an open-source retrieval code named HELIOS–RETRIEVAL, designed to obtain chemical abundances and temperature–pressure profiles by inverting the measured spectra of exoplanetary atmospheres. In our forward model, we use an exact solution of the radiative transfer equation, in the pure absorption limit, which allows us to analytically integrate over all of the outgoing rays. Two chemistry models are considered: unconstrained chemistry and equilibrium chemistry (enforced via analytical formulae). The nested sampling algorithm allows us to formally implement Occam’s Razor based on a comparison of the Bayesian evidence between models. We perform a retrieval analysis on the measured spectra of the four HR 8799 directly imaged exoplanets. Chemical equilibrium is disfavored for HR 8799b and c. We find supersolar C/H and O/H values for the outer HR 8799b and c exoplanets, while the inner HR 8799d and e exoplanets have a range of C/H and O/H values. The C/O values range from being superstellar for HR 8799b to being consistent with stellar for HR 8799c and being substellar for HR 8799d and e. If these retrieved properties are representative of the bulk compositions of the exoplanets, then they are inconsistent with formation via gravitational instability (without late-time accretion) and consistent with a core accretion scenario in which late-time accretion of ices occurred differently for the inner and outer exoplanets. For HR 8799e, we find that spectroscopy in the K band is crucial for constraining C/O and C/H. HELIOS–RETRIEVAL is publicly available as part of the Exoclimes Simulation Platform (http://www.exoclime.org).

79 ASTRONOMY AND ASTROPHYSICS↗

Multispectral signatures in relation to ground control signatures using nested sampling approach

The author has identified the following signficant results. An experiment was conducted to evaluate the feasibility of using ERTS-1 MSS imagery for spot transmission measurements on selected sites. Using the 15-unit gray scale on the 70 mm positive imagery as the base of comparison, a correlation was made between the transmittance measured at each site on the imagery and the radiance values (counts) recorded on CCT tape by the spacecraft over the same sites. The imagery was enlarged by a 750-watt projector and focused on a white cardboard screen 6 meters from the screen. Observations were made on 30 sub-sites which were pre-selected for their differing image brightness and total area; all are dried pond beds. Observations were also made on average gray backgrounds and a small lake. There was a very good correlation between the density values obtained from projected imagery and radiance values received by the detector on the spacecraft. A shorter experiment time and closer integration of gray scale and site readings would avoid the variation in lamp intensities that occurred.

Lyon, R. J. P.↗

Multispectral signatures in relation to ground control signature using nested sampling approach

The author has identified the following significant results. Principal effort has been on the development of a PDP-10 software package to read the CCT tapes more cheaply and rapidly. This is 90% completed and debugged. A shade print example of Treasure Island is provided. Stanford area was overflown with the U-2 as an add-on photographic mission to help fill in record-gaps in ERTS-1 overpass which was clouded out.

Lyon, R. J. P.↗

Multispectral signatures in relation to ground control signature using nested sampling approach

The author has identified the following significant results. In a cooperative study with USGS personnel, it has been possible to detect a 1.5 by 1 mile anomaly on ERTS CCT data, in the pine-covered mountains of western Nevada. This anomalous area is about 3-5 times larger than that of the known geobotanical anomaly which lies centrally within the area. The site has been studied on the ground and bi-directional reflectances, relative to BaS04 obtained for 40 trees, using both in-vivo techniques (similar to cherry picker operations) and field determinations of cut branches. The anomaly can be seen best by color transparencies made from 5/4, 6/4, 7/4 ratioed digital data, the 3 ratios each being coded by one of 3 colors (blue, green, and red).

Lyon, R. J. P.↗

Evaluation of ERTS multispectral signatures in relation to ground control signatures using a nested-sampling approach

The author has identified the following significant results. Ground measured spectral signatures of wavelength bands matching ERTS MSS were collected using a radiometer at several Californian and Nevadan sites, and directly compared with similar data from ERTS CCTs. The comparison was tested at the highest possible spatial resolution for ERTS, using deconvoluted MSS data, and contrasted with that of ground measured spectra, originally from 1 meter squares. In the mobile traverses of the grassland sites, these one meter fields of view were integrated into eighty meter transects along the five km track across four major rock/soil types. Suitable software was developed to read the MSS CCT tapes, to shadeprint individual bands with user-determined greyscale stretching. Four new algorithms for unsupervised and supervised, normalized and unnormalized clustering were developed, into a program termed STANSORT. Parallel software allowed the field data to be calibrated, and by using concurrently continuously collected, upward- and downward-viewing, 4 band radiometers, bidirectional reflectances could be calculated.

Lyon, R. J. P.↗

Darwinian Model Building

We present a way to generate heuristic mathematical models based on the Darwinian principles of variation and selection in a pool of individuals over many generations. Each individual has a genotype (the hereditary properties) and a phenotype (the expression of these properties in the environment). Variation is achieved by cross-over and mutation operations on the genotype which consists in the present case of a single chromosome. The genotypes 'live' in the environment of the data. Nested Sampling is used to optimize the free parameters of the models given the data, thus giving rise to the phenotypes. Selection is based on the phenotypes.The evidences which naturally follow from the Nested Sampling Algorithm are used in a second level of Nested Sampling to find increasingly better models.The data in this paper originate from the Leiden Cytology and Pathology Laboratory (LCPL), which screens pap smears for cervical cancer. We have data for 1750 women who on average underwent 5 tests each. The data on individual women are treated as a small time series. We will try to estimate the next value of the prime cancer indicator from previous tests of the same woman.

97 MATHEMATICS AND COMPUTING↗

Interpreting High-resolution Spectroscopy of Exoplanets using Cross-correlations and Supervised Machine Learning

We present a new method for performing atmospheric retrieval on ground-based, high-resolution data of exoplanets. Our method combines cross-correlation functions with a random forest, a supervised machine-learning technique, to overcome challenges associated with high-resolution data. A series of cross-correlation functions are concatenated to give a “CCF-sequence” for each model atmosphere, which reduces the dimensionality by a factor of ∼100. The random forest, trained on our grid of ∼65,000 models, provides a likelihood-free method of retrieval. The precomputed grid spans 31 values of both temperature and metallicity, and incorporates a realistic noise model. We apply our method to HARPS-N observations of the ultra-hot Jupiter KELT-9b and obtain a metallicity consistent with solar (logM = − 0.2 ± 0.2). Our retrieved transit chord temperature (T=6000{sub −200}{sup +0}K) is unreliable as strong ion lines lie outside of the extent of the training set, which we interpret as being indicative of missing physics in our atmospheric model. We compare our method to traditional nested sampling, as well as other machine-learning techniques, such as Bayesian neural networks. We demonstrate that the likelihood-free aspect of the random forest makes it more robust than nested sampling to different error distributions, and that the Bayesian neural network we tested is unable to reproduce complex posteriors. We also address the claim in Cobb et al. 2019 that our random forest retrieval technique can be overconfident but incorrect. We show that this is an artifact of the training set, rather than of the machine-learning method, and that the posteriors agree with those obtained using nested sampling.

79 ASTRONOMY AND ASTROPHYSICS↗