Search NASA⌕ Search

SEARCH · Search NASA

Results for “Constrained Gaussian process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A comparison of Gaussian processes and neural networks for computer model emulation and calibration

The Department of Energy relies on complex physics simulations for prediction in domains like cosmology, nuclear theory, and materials science. These simulations are often extremely computationally intensive, with some requiring days or weeks for a single simulation. In order to assure their accuracy, these models are calibrated against observational data in order to estimate inputs and systematic biases. Because of their great computational complexity, this process typically requires the construction of an emulator, a fast approximation to the simulation. In this paper, two emulator approaches are compared: Gaussian process regression and neural networks. Their emulation accuracy and calibration performance on three real problems of Department of Energy interest is considered. On these problems, the Gaussian process emulator tends to be more accurate with narrower, but still well-calibrated uncertainty estimates. The neural network emulator is accurate, but tends to have large uncertainty on its predictions. Finally, as a result, calibration with the Gaussian process emulator produces more constrained posteriors that still perform well in prediction.

97 MATHEMATICS AND COMPUTING↗

Constraining the Milky Way’s ultraviolet-to-infrared SED with Gaussian process regression

ABSTRACT Improving our knowledge of global Milky Way (MW) properties is critical for connecting the detailed measurements only possible from within our Galaxy to our understanding of the broader galaxy population. We here train Gaussian process regression (GPR) models on SDSS (Sloan Digital Sky Survey) galaxies to map from galaxy properties (stellar mass, apparent axial ratio, star formation rate, bulge-to-total ratio, disc scale length, and bar vote fraction) to ultraviolet (UV; GALEX FUV/NUV), optical (SDSS ugriz), and infrared (IR; 2MASS JHKs and WISE W1/W2/W3/W4) fluxes and uncertainties. With these models, we estimate the photometric properties of the MW, resulting in a full UV-to-IR spectral energy distribution (SED) as it would be measured externally, viewed face-on. We confirm that the MW lies in the green valley in optical diagnostic diagrams, but show for the first time that the MW is in the star-forming region in standard UV and IR diagnostics – characteristic of the population of red spiral galaxies. Although our GPR method predicts one band at a time, the resulting MW UV–IR SED is consistent with SEDs of local spirals with characteristics broadly similar to the MW, suggesting that these independent predictions can be combined reliably. Our UV–IR SED will be invaluable for reconstructing the MW’s star formation history using the same tools employed for external galaxies, allowing comparisons of results from in situ measurements to those from the methods used for extragalactic objects.

79 ASTRONOMY AND ASTROPHYSICS↗

Model-independent constraints on Ωm and H ( z ) from the link between geometry and growth

ABSTRACT We constrain the expansion history of the Universe and the cosmological matter density fraction in a model-independent way by exclusively making use of the relationship between background and perturbations under a minimal set of assumptions. We do so by employing a Gaussian process to model the expansion history of the Universe from present time to the recombination era. The expansion history and the cosmological matter density are then constrained using recent measurements from cosmic chronometers, Type-Ia supernovae, baryon acoustic oscillations, and redshift-space distortion data. Our results show that the evolution in the reconstructed expansion history is compatible with the Planck 2018 prediction at all redshifts. The current data considered in this study can constrain a Gaussian process on H(z) to an average $9.4 {{\ \rm per\ cent}}$ precision across redshift. We find Ωm = 0.224 ± 0.066, lower but statistically compatible with the Planck 2018 cosmology. Finally, the combination of future DESI measurements with the CMB measurement considered in this work holds the promise of $8 {{\ \rm per\ cent}}$ average constraints on a model-independent expansion history as well as a five-fold tighter Ωm constraint using the methodology developed in this work.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Gaussian process inference for neutron spin echo measurement

Neutron spin echo (NSE) spectroscopy provides unique access to microscopic dynamics, but its application is often constrained by low neutron flux, long acquisition times, and significant noise. Here, we present a Bayesian inference approach based on Gaussian process regression (GPR) to reconstruct high-quality spin echo signals from sparse and noisy data by exploiting correlations in reciprocal space. Benchmarks on synthetic datasets and validation with experimental NSE measurements of dendrimers show that GPR suppresses noise, interpolates missing intensity values, and accommodates irregular observations. The method improves accuracy, shortens acquisition times, and enables high-throughput and real-time studies. Beyond NSE, the framework is broadly applicable to other low signal-to-noise ratio scattering techniques, thereby extending the scope of neutron spectroscopy.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗

aphBO-2GP-3B: a budgeted asynchronous parallel multi-acquisition functions for constrained Bayesian optimization on high-performing computing architecture

High-fidelity complex engineering simulations are often predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in high-performance cluster (HPC) architecture. Optimization problems associated with these applications is a challenging problem due to the high computational cost of the high-fidelity simulations. In this paper, an asynchronous parallel constrained Bayesian optimization method is proposed to efficiently solve the computationally expensive simulation-based optimization problems on the HPC platform, with a budgeted computational resource, where the maximum number of simulations is a constant. The advantage of this method are three-fold. Firstly, the efficiency of the Bayesian optimization is improved, where multiple input locations are evaluated parallel in an asynchronous manner to accelerate the optimization convergence with respect to physical runtime. This efficiency feature is further improved so that when each of the inputs is finished, another input is queried without waiting for the whole batch to complete. Second, the proposed method can handle both known and unknown constraints. Third, the proposed method samples several acquisition functions based on their rewards using a modified GP-Hedge scheme. The proposed framework is termed aphBO-2GP-3B, which means asynchronous parallel hedge Bayesian optimization with two Gaussian processes and three batches. The numerical performance of the proposed framework aphBO-2GP-3B is comprehensively benchmarked using 16 numerical examples, compared against other 6 parallel Bayesian optimization variants and 1 parallel Monte Carlo as a baseline, and demonstrated using two real-world high-fidelity expensive industrial applications. The first engineering application is based on finite element analysis (FEA) and the second one is based on computational fluid dynamics (CFD) simulations.

97 MATHEMATICS AND COMPUTING↗

Constrained Bayesian Optimization of Criticality Experiments at LLNL [Slides]

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. We demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for critical ity safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗

Constrained Bayesian Optimization of Criticality Experiments [Slides]

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. We demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for criticality safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗

Constrained Bayesian optimization of criticality experiments

The design of criticality experiments is typically an iterative process that employs a Monte Carlo transport code. The goal is to find a design that optimizes some variable, like the sensitivity of a response to a cross section, while simultaneously ensuring criticality. The high fidelity of the Monte Carlo code is a great asset, but it makes exploring the design space computationally expensive. Herein, we present how a constrained Bayesian optimization algorithm can be used to efficiently design a criticality experiment. It uses Gaussian processes as a surrogate model to probe the design space and to reduce the number of code executions that are needed to find the optimum. Furthermore, we demonstrate constrained Bayesian optimization with a Pu-239/polyethylene solution system and a TEX experiment that is designed for criticality safety validation of a nuclear waste model at the Hanford Site. For both systems, a global optimum was found within 75 Monte Carlo simulations.

42 ENGINEERING↗

Applying Constrained Bayesian Optimization to the Design of Critical Experiments

Often when planning a criticality experiment, many design configurations are iteratively investigated with a Monte Carlo transport code. The goal is that the experiment will be optimal with respect to some variable, like the fraction of fissions occurring at a certain energy range, while simultaneously being critical. Unfortunately, the Monte Carlo transport simulations are expensive, which can ultimately limit the number of configurations that can be explored. In this work, we present how Gaussian processes (GPs) can be used as a reduced-order model in a constrained Bayesian optimization (CBO) algorithm to design a criticality experiment. The GPs replace the Monte Carlo transport simulations that explore the design space. The CBO algorithm efficiently identifies new points in the design space to run the Monte Carlo transport code while respecting the criticality constraint. It does so in a manner that both improves the accuracy of the GP and finds the approximate global optimum. We demonstrate the performance of CBO with the design of a Thermal Epithermal eXperiment (TEX) for the criticality safety validation of nuclear waste models of the Hanford Tank Farm.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Magellan/PFS Radial Velocities of GJ 9827, a Late K dwarf at 30 pc with Three Transiting Super-Earths

The Kepler mission showed us that planets with sizes between that of Earth and Neptune appear to be the most common type in our Galaxy. These “super-Earths” continue to be of great interest for exoplanet formation, evolution, and composition studies. However, the number of super-Earths with well-constrained mass and radius measurements remains small (40 planets with σ {sub mass} < 25%), due in part to the faintness of their host stars causing ground-based mass measurements to be challenging. Recently, three transiting super-Earth planets were detected by the K2 mission around the nearby star GJ 9827/HIP 115752, at only 30 pc away. The radii of the planets span the “radius gap” detected by Fulton et al. (2017), and all orbit within ∼6.5 days, easing follow-up observations. Here, we report radial velocity (RV) observations of GJ 9827, taken between 2010 and 2016 with the Planet Finder Spectrograph on the Magellan II Telescope. We employ two different RV analysis packages, SYSTEMIC and RadVel, to derive masses and thus densities of the GJ 9827 planets. We also test a Gaussian Process regression analysis but find the correlated stellar noise is not well constrained by the PFS data and that the GP tends to over-fit the RV semi-amplitudes resulting in a lower K value. Our RV observations are not able to place strong mass constraints on the two outer planets (c and d) but do indicate that planet b, at 1.64 R {sub ⊕} and ∼8 M {sub ⊕}, is one of the most massive (and dense) super-Earth planets detected to date.

79 ASTRONOMY AND ASTROPHYSICS↗

Reconstruction of dark energy and expansion dynamics using Gaussian processes

An important issue in cosmology is reconstructing the effective dark energy equation of state directly from observations. With few physically motivated models, future dark energy studies cannot only be based on constraining a dark energy parameter space, as the errors found depend strongly on the parametrisation considered. We present a new non-parametric approach to reconstructing the history of the expansion rate and dark energy using Gaussian Processes, which is a fully Bayesian approach for smoothing data. We present a pedagogical introduction to Gaussian Processes, and discuss how it can be used to robustly differentiate data in a suitable way. Using this method we show that the Dark Energy Survey - Supernova Survey (DES) can accurately recover a slowly evolving equation of state to σ{sub w} = ±0.05 (95% CL) at z = 0 and ±0.25 at z = 0.7, with a minimum error of ±0.025 at the sweet-spot at z ∼ 0.16, provided the other parameters of the model are known. Errors on the expansion history are an order of magnitude smaller, yet make no assumptions about dark energy whatsoever. A code for calculating functions and their first three derivatives using Gaussian processes has been developed and is available for download.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine learning models for PDE constrained optimization

Partial differential equation (PDE)-constrained optimization problems arise in a variety of scientific and engineering applications, such as topology optimization, electrodynamics, fluid dynamics, and structural dynamics. However, these problems are often challenging and computationally expensive to solve, due to the need to solve the PDEs within the optimization loop. One approach to reducing the computational cost of these methods while providing convergence guarantees is through inexact trust region methods; this method uses lower fidelity solutions of the PDE at early stages of the optimization and adjusts the required accuracy of inexact PDE solvers as the optimization progresses. In this work, we explore the use of machine learning based surrogate models with these inexact trust region methods. We first demonstrate the potential of this approach by using Gaussian processes as the surrogate model and test this on a simple PDE-constrained optimization problem. We then document explorations into improving the computational costs of evolutional deep neural network / neural Galerkin methods, with the eventual goal of using these methods with the inexact trust region algorithms. We are able to speed up these approaches, albeit at the cost of lower accuracy.

97 MATHEMATICS AND COMPUTING↗

Reconstructing the Universe: Testing the Mutual Consistency of the Pantheon and SDSS/eBOSS BAO Data Sets with Gaussian Processes

We test the mutual consistency between the baryon acoustic oscillation measurements from the eBOSS SDSS final release and the Pantheon supernova compilation in a model-independent fashion using Gaussian process regression. We also test their joint consistency with the ΛCDM model in a model-independent fashion. We also use Gaussian process regression to reconstruct the expansion history that is preferred by these two data sets. While this methodology finds no significant preference for model flexibility beyond ΛCDM, we are able to generate a number of reconstructed expansion histories that fit the data better than the best-fit ΛCDM model. These example expansion histories may point the way toward modifications to ΛCDM. We also constrain the parameters Ω{sub k} and H {sub 0} r {sub d} both with ΛCDM and with Gaussian process regression. We find that H {sub 0} r {sub d} = 10,030 ± 130 km s{sup −1} and Ω{sub k} = 0.05 ± 0.10 for ΛCDM and that H {sub 0} r {sub d} = 10,040 ± 140 km s{sup −1} and Ω{sub k} = 0.02 ± 0.20 for the Gaussian process case.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Control law design to meet constraints using SYNPAC-synthesis package for active controls

Major features of SYNPAC (Synthesis Package for Active Controls) are described. SYNPAC employs constrained optimization techniques which allow explicit inclusion of design criteria (constraints) in the control law design process. Interrelationships are indicated between this constrained optimization approach, classical and linear quadratic Gaussian design techniques. Results are presented that were obtained by applying SYNPAC to the design of a combined stability augmentation/gust load alleviation control law for the DAST ARW-2.

Adams, W. M., Jr.↗

High-Dimensional Intrinsic Interpolation Using Gaussian Process Regression and Diffusion Maps

This article considers the challenging task of estimating geologic properties of interest using a suite of proxy measurements. The current work recast this task as a manifold learning problem. In this process, this article introduces a novel regression procedure for intrinsic variables constrained onto a manifold embedded in an ambient space. The procedure is meant to sharpen high-dimensional interpolation by inferring non-linear correlations from the data being interpolated. The proposed approach augments manifold learning procedures with a Gaussian process regression. It first identifies, using diffusion maps, a low-dimensional manifold embedded in an ambient high-dimensional space associated with the data. It relies on the diffusion distance associated with this construction to define a distance function with which the data model is equipped. This distance metric function is then used to compute the correlation structure of a Gaussian process that describes the statistical dependence of quantities of interest in the high-dimensional ambient space. The proposed method is applicable to arbitrarily high-dimensional data sets. Here, it is applied to subsurface characterization using a suite of well log measurements. The predictions obtained in original, principal component, and diffusion space are compared using both qualitative and quantitative metrics. Considerable improvement in the prediction of the geological structural properties is observed with the proposed method.

58 GEOSCIENCES↗

Statistical characteristics of cloud variability. Part 2: Implication for parameterizations of microphysical and radiative transfer processes in climate models

The effects of subgrid cloud variability on grid-average microphysical rates and radiative fluxes are examined by use of long-term retrieval products at the Tropical West Pacific, Southern Great Plains, and North Slope of Alaska sites of the Department of Energy's Atmospheric Radiation Measurement program. Four commonly used distribution functions, the truncated Gaussian, Gamma, lognormal, and Weibull distributions, are constrained to have the same mean and standard deviation as observed cloud liquid water content. The probability density functions are then used to upscale relevant physical processes to obtain grid-average process rates. It is found that the truncated Gaussian representation results in up to 30% mean bias in autoconversion rate, whereas the mean bias for the lognormal representation is about 10%. The Gamma and Weibull distribution function performs the best for the grid-average autoconversion rate with the mean relative bias less than 5%. For radiative fluxes, the lognormal and truncated Gaussian representations perform better than the Gamma and Weibull representations. The results show that the optimal choice of subgrid cloud distribution function depends on the nonlinearity of the process of interest, and thus, there is no single distribution function that works best for all parameterizations. Examination of the scale (window size) dependence of the mean bias indicates that the bias in grid-average process rates monotonically increases with increasing window sizes, suggesting the increasing importance of subgrid variability with increasing grid sizes.

54 ENVIRONMENTAL SCIENCES↗

Leveraging transfer learning and leaf spectroscopy for leaf trait prediction with broad spatial, species, and temporal applicability

Accurate and reliable prediction of leaf traits is crucial for understanding plant adaptations to environmental variation, monitoring terrestrial ecosystems, and enhancing comprehension of functional diversity and ecosystem functioning. Currently, various approaches (e.g., statistical, physical models) have been developed to estimate leaf traits through hyperspectral remote sensing and leaf spectroscopy. However, the absence of high-performing, transferable, and stable models across various domains of space, plant functional types (PFTs) and seasons hinder our ability to quantify and comprehend spatiotemporal variations in leaf traits. This study proposes robust and highly transferable models for better predicting leaf traits with hyperspectral reflectance. Initially, three datasets were assembled, pairing common leaf traits — chlorophyll (Chla+b), carotenoids (Ccar), leaf mass per area (LAM), equivalent water thickness (EWT) — with leaf spectra measurements collected across diverse geographic locations in the U.S. and Europe, PFTs, and seasons. Measurements were acquired using spectroradiometers (e.g., ASD FieldSpec 3/4/Pro and SVC HR-1024i) with integrating spheres, leaf clips, and contact probes. Here, we then developed transfer learning-based hybrid models that incorporated the domain knowledge of radiative transfer models (RTMs) through pretraining processes and were well-constrained by fine-tuning with field measurements. Through comparison with other state-of-the-art statistical models, including partial-least squares regression (PLSR) and Gaussian Process Regression (GPR), as well as pure physical models, we found that the proposed transfer learning models achieved better predictive performance and higher transferability. Specifically, compared to other statistical models and pure RTMs, the transfer learning model exhibited higher coefficient of determination (R 2 ) values with range of 0.01 to 0.79, lower normalized root mean square error (NRMSE) with range of 0.06 % to 33.25 % in model performance. Additionally, the models exhibited improved transferability, with higher R 2 values range from 0.04 to 0.32, lower NRMSE range from 0.08 % to 30.81 %. The findings underscore that transfer learning models through integrating domain knowledge from RTMs and limited observations, can harness the advantages of both RTMs and statistical models and serve as a promising approach for effectively predicting leaf traits.

59 BASIC BIOLOGICAL SCIENCES↗