Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian Processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Dodging the cosmic curvature to probe the constancy of the speed of light

We develop a new model-independent method to probe the constancy of the speed of light c . In our method, the degeneracy between the cosmic curvature and the speed of light can be eliminated, which makes the test more natural and general. Combining the independent observations of Hubble parameter H ( z ) and luminosity distance d {sub L} ( z ), we use the model-independent smoothing technique, Gaussian processes, to reconstruct them and then detect variation of the speed of light. We find no signal of deviation from the present value of the speed of light c {sub 0}. Moreover, to demonstrate the improvement in probing the constancy of the speed of light from future experiments, we produce a series of simulated data. The Dark Energy Survey will be able to detect Δ c / c {sub 0} ∼ 1% at ∼ 1.5σ confidence level and Δ c / c {sub 0} ∼ 2% at ∼ 3σ confidence level. If the errors are reduced to one-tenth of the expected DES ones, it can detect a Δ c / c {sub 0} ∼ 0.1% variation at ∼ 2σ confidence level.

79 ASTRONOMY AND ASTROPHYSICS↗

Applying Constrained Bayesian Optimization to the Design of Critical Experiments

Often when planning a criticality experiment, many design configurations are iteratively investigated with a Monte Carlo transport code. The goal is that the experiment will be optimal with respect to some variable, like the fraction of fissions occurring at a certain energy range, while simultaneously being critical. Unfortunately, the Monte Carlo transport simulations are expensive, which can ultimately limit the number of configurations that can be explored. In this work, we present how Gaussian processes (GPs) can be used as a reduced-order model in a constrained Bayesian optimization (CBO) algorithm to design a criticality experiment. The GPs replace the Monte Carlo transport simulations that explore the design space. The CBO algorithm efficiently identifies new points in the design space to run the Monte Carlo transport code while respecting the criticality constraint. It does so in a manner that both improves the accuracy of the GP and finds the approximate global optimum. We demonstrate the performance of CBO with the design of a Thermal Epithermal eXperiment (TEX) for the criticality safety validation of nuclear waste models of the Hanford Tank Farm.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling gas–shell mixing in ICF with separated reactants

Mixing between fuel and shell materials in ICF implosions can affect implosion dynamics and even prevent ignition. We use data from a series of separated reactant experiments on the National Ignition Facility to calibrate and test the predictive power of gas–shell mix models. Two models are used to estimate fuel–shell mix: a Reynolds-averaged turbulence model and molecular diffusion. Minor uncertainties in capsule manufacture, experimental conditions, and values for mix model parameters produce significant variation in simulation results. Using input/output pairs from 1D simulations, we train Gaussian process surrogate models to predict experimental quantities of interest. The surrogates are used to construct posteriors for mix model parameters by marginalizing over uncertainties in capsule manufacture and experimental conditions. Mix models are calibrated with a subset of experimental data (neutron yields, ion temperature, and bang time) and tested using the remaining data. In general, both the diffusion and turbulence model correctly predict experimental DT and TT neutron yields. Despite having more free parameters, the turbulence model underpredicts ion temperature at high convergence ratio. Furthermore, the simpler diffusion model correctly predicts these temperatures, suggesting nonhydrodynamic gas–shell mix. The computational model consistently overpredicts DD neutron yield, indicating possible shortcomings outside of the mix model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Infinite neural network quantum states: entanglement and training dynamics

We study infinite limits of neural network quantum states (∞-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics. Ensemble averages of entanglement entropies are expressed in terms of neural network correlators, and architectures that exhibit volume-law entanglement are presented. The analytic calculations of entanglement entropy bound are tractable because the ensemble statistics are simplified in the Gaussian process limit. A general framework is developed for studying the gradient descent dynamics of neural network quantum states (NNQS), using a quantum state neural tangent kernel (QS-NTK). For ∞-NNQS the training dynamics is simplified, since the QS-NTK becomes deterministic and constant. An analytic solution is derived for quantum state supervised learning, which allows an ∞-NNQS to recover any target wavefunction. Numerical experiments on finite and infinite NNQS in the transverse field Ising model and Fermi Hubbard model demonstrate excellent agreement with theory. ∞-NNQS opens up new opportunities for studying entanglement and training dynamics in other physics applications, such as in finding ground states.

quantum state supervised learning↗

Measuring the speed of light with ultra-compact radio quasars

In this paper, based on a 2.29 GHz VLBI all-sky survey of 613 milliarcsecond ultra-compact radio sources with 0.0035< z <3.787, we describe a method of identifying the sub-sample which can serve as individual standard rulers in cosmology. If the linear size of the compact structure is assumed to depend on source luminosity and redshift as l {sub m} = l L {sup β} (1+ z ) {sup n} , only intermediate-luminosity quasars (10{sup 27} W/Hz< L < 10{sup 28} W/Hz) show negligible dependence (| n |≅ 10{sup −3}, |β|≅ 10{sup −4}), and thus represent a population of such rulers with fixed characteristic length l =11.42 pc. With a sample of 120 such sources covering the redshift range 00.46< z <2.8, we confirm the existence of dark energy in the Universe with high significance under the assumption of a flat universe, and obtain stringent constraints on both the matter density Ω {sub m} =0.323{sup +0.245}{sub −0.145} and the Hubble constant H {sub 0}=66.30{sup +7.00}{sub −8.50} km sec{sup −1} Mpc{sup −1}. Finally, with the angular diameter distances D {sub A} measured for quasars extending to high redshifts (0 z ∼ 3.), we reconstruct the D {sub A} ( z ) function using the technique of Gaussian processes. This allows us to identify the redshift corresponding to the maximum of the D {sub A} ( z ) function: 0 z {sub m} =1.7 and the corresponding angular diameter distance D {sub A} ( z {sub m} )=1719.01±43.46 Mpc. Similar reconstruction of the expansion rate function H ( z ) based on the data from cosmic chronometers and BAO gives us H ( z {sub m} )=176.77±6.11 km sec{sup −1} Mpc{sup −1}. These measurements are used to estimate the speed of light: c =3.039(±0.180)× 10{sup 5} km/s. This is the first measurement of the speed of light in a cosmological setting referring to the distant past.

79 ASTRONOMY AND ASTROPHYSICS↗

Rate constants for fine-structure excitations in O-H collisions with error bars obtained by machine learning

We present an approach using a combination of coupled channel scattering calculations with a machine-learning technique based on Gaussian Process regression to determine the sensitivity of the rate constants for non-adiabatic transitions in inelastic atomic collisions to variations of the underlying adiabatic interaction potentials. Using this approach, we improve the previous computations of the rate constants for the fine-structure transitions in collisions of O({sup 3}P{sub j}) with atomic H. We compute the error bars of the rate constants corresponding to 20% variations of the ab initio potentials and show that this method can be used to determine which of the individual adiabatic potentials are more or less important for the outcome of different fine-structure changing collisions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian Cross-matching of High Proper-motion Stars in Gaia DR2 and Photometric Metallicities for ∼1.7 million K and M Dwarfs

We present a Bayesian method to cross-match 5,827,988 high proper-motion Gaia sources (μ > 40 mas yr{sup −1}) to various photometric surveys: Two Micron All Sky Survey, AllWISE data release from the Wide-field Infrared Explorer (WISE) mission, Galaxy Evolution Explorer, Radial Velocity Experiment, Sloan Digital Sky Survey, and Panoramic Survey Telescope and Rapid Response System (Pan-STARRS). To efficiently associate these objects across catalogs, we develop a technique that compares the multidimensional distribution of all sources in the vicinity of each Gaia star to a reference distribution of random field stars obtained by extracting all sources in a region on the sky displaced 2′. This offset preserves the local field stellar density and magnitude distribution, allowing us to characterize the frequency of chance alignments. The resulting catalog with Bayesian probabilities >95% has a marginally higher match rate than current internal Gaia data release 2 (DR2) matches for most catalogs. However, a significant improvement is found with Pan-STARRS, where ∼99.8% of the sample within the Pan-STARRS footprint is recovered, as compared to a low ∼20.8% in Gaia DR2. Using these results, we train a Gaussian process regressor to calibrate two photometric metallicity relationships. For dwarfs of 3500 < T{sub eff} < 5280 K, we use metallicity values of 4378 stars from the Apache Point Observatory Galactic Evolution Experiment and Hejazi et al. to calibrate the relationship, producing results with a 1σ precision of 0.12 dex and few systematic errors. We then indirectly infer the metallicity of 4018 stars with 2850 < T{sub eff} < 3500 K, which are wide companions of primaries whose metallicities are estimated with our first regressor, to produce a relationship with a 1σ precision of 0.21 dex and significant systematic errors. Additional work is needed to better remove unresolved binaries from this second sample to reduce these systematic errors.

47 OTHER INSTRUMENTATION↗

COSMIC EMULATION: FAST PREDICTIONS FOR THE GALAXY POWER SPECTRUM

The halo occupation distribution (HOD) approach has proven to be an effective method for modeling galaxy clustering and bias. In this approach, galaxies of a given type are probabilistically assigned to individual halos in N-body simulations. In this paper, we present a fast emulator for predicting the fully nonlinear galaxy–galaxy auto and galaxy–dark matter cross power spectrum and correlation function over a range of freely specifiable HOD modeling parameters. The emulator is constructed using results from 100 HOD models run on a large ΛCDM N-body simulation, with Gaussian Process interpolation applied to a PCA-based representation of the galaxy power spectrum. The total error is currently ∼1% in the auto correlations and ∼2% in the cross correlations from z = 1 to z = 0, over the considered parameter range. We use the emulator to investigate the accuracy of various analytic prescriptions for the galaxy power spectrum, parametric dependencies in the HOD model, and the behavior of galaxy bias as a function of HOD parameters. Additionally, we obtain fully nonlinear predictions for tangential shear correlations induced by galaxy–galaxy lensing from our galaxy–dark matter cross power spectrum emulator. All emulation products are publicly available at http://www.hep.anl.gov/cosmology/CosmicEmu/emu.html.

79 ASTRONOMY AND ASTROPHYSICS↗

Scaled Vecchia Approximation for Fast Computer-Model Emulation

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments, enabling interpolation between input settings, but direct GP inference is computationally infeasible for large datasets. We adapt and extend a powerful class of GP methods from spatial statistics to enable the scalable analysis and emulation of large computer experiments. Specifically, we apply Vecchia’s ordered conditional approximation in a transformed input space, with each input scaled according to how strongly it relates to the computer-model response. The scaling is learned from the data by estimating parameters in the GP covariance function using Fisher scoring. Our methods are highly scalable, enabling estimation, joint prediction, and simulation in near-linear time in the number of model runs. In several numerical examples, our approach substantially outperformed existing methods.

97 MATHEMATICS AND COMPUTING↗

Multi-objective Bayesian optimization of ferroelectric materials with interfacial control for memory and energy storage applications

Optimization of materials’ performance for specific applications often requires balancing multiple aspects of materials’ functionality. Even for the cases where a generative physical model of material behavior is known and reliable, this often requires search over multidimensional function space to identify low-dimensional manifold corresponding to the required Pareto front. In this work, we introduce the multi-objective Bayesian optimization (MOBO) workflow for the ferroelectric/antiferroelectric performance optimization for memory and energy storage applications based on the numerical solution of the Ginzburg–Landau equation with electrochemical or semiconducting boundary conditions. MOBO is a low computational cost optimization tool for expensive multi-objective functions, where we update posterior surrogate Gaussian process models from prior evaluations and then select future evaluations from maximizing an acquisition function. Using the parameters for a prototype bulk antiferroelectric (PbZrO 3 ), we first develop a physics-driven decision tree of target functions from the loop structures. We further develop a physics-driven MOBO architecture to explore multidimensional parameter space and build Pareto-frontiers by maximizing two target functions jointly—energy storage and loss. This approach allows for rapid initial materials and device parameter selection for a given application and can be further expanded toward the active experiment setting. The associated notebooks provide both the tutorial on MOBO and allow us to reproduce the reported analyses and apply them to other systems (https://github.com/arpanbiswas52/MOBO_AFI_Supplements).

36 MATERIALS SCIENCE↗

K2-291b: A Rocky Super-Earth in a 2.2 day Orbit

K2-291 is a solar-type star with a radius of R {sub *} = 0.899 ± 0.034 R {sub ⊙} and mass of M{sub *} = 0.934 ± 0.038 M {sub ⊙}. From the K2 C13 data, we found one super-Earth planet (R {sub p} = 1.589{sub −0.072}{sup +0.095} R {sub ⊕}) transiting this star on a short period orbit (P = 2.225177{sub −6.8e--5}{sup +6.6e--5} days). We followed this system up with adaptive-optic imaging and spectroscopy to derive stellar parameters, search for stellar companions, and determine a planet mass. From our 75 radial velocity measurements using High Resolution Echelle Spectrometer on Keck I and High Accuracy Radial velocity Planet Searcher in the northern hemisphere on Telescopio Nazionale Galileo, we constrained the mass of K2-291 b to M {sub p} = 6.49 ± 1.16 M {sub ⊕}. We found it necessary to model correlated stellar activity radial velocity signals with a Gaussian process (GP) in order to more accurately model the effect of stellar noise on our data; the addition of the GP also improved the precision of this mass measurement. With a bulk density of ρ = 8.84{sub −2.03}{sup +2.50} g cm{sup −3}, the planet is consistent with an Earth-like rock/iron composition and no substantial gaseous envelope. Such an envelope, if it existed in the past, was likely eroded away by photoevaporation during the first billion years of the star’s lifetime.

79 ASTRONOMY AND ASTROPHYSICS↗

Efficient sampling for spatial uncertainty qualification in multibody system dynamics applications.

We present two methods for efficiently sampling the response (trajectory space) of multibody systems operating under spatial uncertainty, when the latter is assumed to be representable with Gaussian processes. In this case, the dynamics (time evolution) of the multibody systems depends on spatially indexed uncertain parameters that span infinite-dimensional spaces. This places a heavy computational burden on existing methodologies, an issue addressed herein with two new conditional sampling approaches. When a single instance of the uncertainty is needed in the entire domain, we use a fast Fourier transform technique. When the initial conditions are fixed and the path distribution of the dynamical system is relatively narrow, we use an incremental sampling approach that is fast and has a small memory footprint. Both methods produce the same distributions as the widely used Cholesky-based approaches. We illustrate this convergence at a smaller computational effort and memory cost for a simple non-linear vehicle model.

97 MATHEMATICS AND COMPUTING↗

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.

36 MATERIALS SCIENCE↗

MOOSE ProbML: Parallelized probabilistic machine learning and uncertainty quantification for computational energy applications

Here, this paper presents the development and demonstration of massively parallel probabilistic machine learning (ML) and uncertainty quantification (UQ) capabilities within the Multiphysics Object-Oriented Simulation Environment (MOOSE), an open-source computational platform for parallel finite element and finite volume analyses. In addressing the computational expense and uncertainties inherent in complex multiphysics simulations, this paper integrates Gaussian process (GP) variants, active learning, Bayesian inverse UQ, adaptive forward UQ, Bayesian optimization, evolutionary optimization, and Markov chain Monte Carlo (MCMC) within MOOSE. It also elaborates on the interaction among key MOOSE systems — Sampler, MultiApp, Reporter, and Surrogate — in enabling these capabilities. The modularity offered by these systems enables development of a multitude of probabilistic ML and UQ algorithms in MOOSE. Example code demonstrations include parallel active learning and parallel Bayesian inference via active learning. The impact of these developments is illustrated through five applications relevant to computational energy applications: UQ of nuclear fuel fission product release, using parallel active learning Bayesian inference; very rare events analysis in nuclear microreactors using active learning; advanced manufacturing process modeling using multi-output GPs (MOGPs) and dimensionality reduction; fluid flow using deep GPs (DGPs); and tritium transport model parameter optimization for fusion energy, using batch Bayesian optimization. These capabilities are part of the MOOSE framework.

97 - MATHEMATICS AND COMPUTING↗

Prediction of hydrogen adsorption in nanoporous materials from the energy distribution of adsorption sites

We present a fast and accurate, semi-analytical method for predicting hydrogen adsorption in nanoporous materials. For any temperature and pressure, the adsorbed amount is calculated as an integral over the energy density of adsorption sites (guest-host interactions) plus an average guest-guest term. The guest-host interaction energy is calculated using a classical force field with hydrogen modelled as a single-site probe. The guest-guest interaction energy is approximated using an average coordination number, which is regressed using Gaussian Process Regression (GPR). Local adsorption at each site is then modelled using a Langmuir isotherm, which when weighted with its probability density gives an accurate description of hydrogen adsorption. The method is tested on 933 metal-organic frameworks (MOFs) from the Computation-Ready Experimental (CoRE) MOF database at 77 K from 10 –5 to 100 bar, and the results are compared against GCMC predictions. To demonstrate the utility of the method, we calculated hydrogen adsorption isotherms for 12,914 existing MOF structures, at two different temperatures at a speed about 100 times that of GCMC simulations and analyzed the results. Here, we found 13 MOFs with predicted deliverable capacities exceeding the DOE target of 50 g/L for adsorption at 100 bar, 77 K and desorption at 5 bar, 160 K.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ProbabilisticRecalibration of Forecasts

In this work, we present a scheme by which a probabilistic forecasting system whose predictions have a poor probabilistic calibration may be recalibrated through the incorporation of past performance information in order to produce a new forecasting system that is demonstrably superior to the original, inasmuch as one may use it to win wagers consistently against someone who is using the original system. The scheme utilizes Gaussian process (GP) modeling to estimate a probability distribution over the probability integral transform (PIT) of a scalar predictand. The GP density estimate gives closed-form access to information entropy measures that are associated with the estimated distribution, which allows the prediction of winnings in wagers against the base forecasting system. A separate consequence of the procedure is that the recalibrated forecast has a uniform expected PIT distribution. One distinguishing feature of the procedure is that it is appropriate even if the PIT values are not i.i.d. The recalibration scheme is formulated in a framework that exploits the deep connections among information theory, forecasting, and betting. We demonstrate the effectiveness of the scheme in two case studies: a laboratory experiment with a nonlinear circuit and seasonal forecasts of the intensity of the El Nino-Southern Oscillation phenomenon.

54 ENVIRONMENTAL SCIENCES↗

Predictions of Boron Phase Stability Using an Efficient Bayesian Machine Learning Interatomic Potential

Thermodynamic phase stability of three elemental boron allotropes, i.e., α-B, β-B, and γ-B, was investigated using a Bayesian interatomic potential trained via a sparse Gaussian process (SGP). SGP potentials trained with datasets from on-the-fly active learning achieve quantum mechanical level accuracy when employed in molecular dynamics simulations to predict wide-ranging thermodynamic, structural, and vibrational properties. The simulated phase diagram (500~1400 K and 0~16 GPa) agrees with experimental measurements. The SGP-based MD simulations also successfully predicted that the B13 defect is critical in stabilizing β-B below 700 K. At higher temperatures, the entropy becomes the dominant factor, making β-B the more stable phase over α-B. Furthermore, this Letter demonstrates that SGP potentials based on a training set consisting of defect-free-only systems could make correct predictions of defect-related phenomena in solid-state crystals, paving the path to investigate crystal phase stability and transitions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A DATA-DRIVEN MODEL FOR SPECTRA: FINDING DOUBLE REDSHIFTS IN THE SLOAN DIGITAL SKY SURVEY

We present a data-driven method-heteroscedastic matrix factorization, a kind of probabilistic factor analysis-for modeling or performing dimensionality reduction on observed spectra or other high-dimensional data with known but non-uniform observational uncertainties. The method uses an iterative inverse-variance-weighted least-squares minimization procedure to generate a best set of basis functions. The method is similar to principal components analysis (PCA), but with the substantial advantage that it uses measurement uncertainties in a responsible way and accounts naturally for poorly measured and missing data; it models the variance in the noise-deconvolved data space. A regularization can be applied, in the form of a smoothness prior (inspired by Gaussian processes) or a non-negative constraint, without making the method prohibitively slow. Because the method optimizes a justified scalar (related to the likelihood), the basis provides a better fit to the data in a probabilistic sense than any PCA basis. We test the method on Sloan Digital Sky Survey (SDSS) spectra, concentrating on spectra known to contain two redshift components: these are spectra of gravitational lens candidates and massive black hole binaries. We apply a hypothesis test to compare one-redshift and two-redshift models for these spectra, utilizing the data-driven model trained on a random subset of all SDSS spectra. This test confirms 129 of the 131 lens candidates in our sample and all of the known binary candidates, and turns up very few false positives.

79 ASTRONOMY AND ASTROPHYSICS↗