Search NASA⌕ Search

SEARCH · Search NASA

Results for “Constrained Gaussian process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Reexamining the proton-radius problem using constrained Gaussian processes

The “proton radius puzzle” refers to an 8-year-old problem that highlights major inconsistencies in the extraction of the charge radius of the proton from muonic Lamb-shift experiments as compared against experiments using elastic electron scattering. For the latter approach, the determination of the charge radius involves an extrapolation of the experimental form factor to zero momentum transfer. To estimate the proton radius, a novel and powerful nonparametric method based on a constrained Gaussian process is introduced. Furthermore, the constrained Gaussian process models the electric form factor as a function of the momentum transfer. Within a Bayesian paradigm, we develop a model flexible enough to fit the data without any parametric assumptions on the form factor. The Bayesian estimation is guided by imposing only two physical constraints on the form factor: (a) its value at zero momentum transfer (normalization) and (b) its overall shape, assumed to be a monotonically decreasing function of the momentum transfer. Variants of these assumptions are explored to assess their impact.By adopting both constraints and incorporating the whole range of experimental data available we extracted a charge radius of r p = 0.845 ± 0.001 fm, consistent with the muonic experiment. Nevertheless, we show that within our model the extracted radius depends on both the assumed constraints and the range of experimental data used to fit the Gaussian process. For example, if only low-momentum-transfer data are used, relaxing the normalization constraint provides a value compatible with the larger electronic value. We have presented a novel technique to estimate the proton radius from electron-scattering data based on a constrained Gaussian process. We demonstrated that the impact of imposing sensible physical constraints on the form factor is substantial. Also critical is the range of the experimental data used in the extrapolation. We are hopeful that as the technique gets refined, together with the anticipated new results from the PRad experiment, we will get closer to a resolution of the puzzle.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Physics-constrained Gaussian process model for prediction of hydrodynamic interactions between wave energy converters in an array

To improve the efficiency of wave farms and achieve maximum power generation, the layout of wave energy converters (WECs) in an array needs to be carefully designed so that the hydrodynamic interactions can be positively exploited. For this, the hydrodynamic characteristics of the WEC array in different layouts need to be calculated. However, such calculations using numerical models usually entail significant computational cost, especially for large arrays of WECs. To address the computational challenge, a physics-constrained Gaussian process (GP) model is proposed to replace the original expensive numerical model and predict the hydrodynamic characteristics of the WECs for any array layout. By exploring the relationship between the WEC array (i.e., the input) and different hydrodynamic characteristics (i.e., the output), here we summarize a set of physical constraints/features, including invariance, symmetry, and additivity. This prior knowledge about the input-output relationship is then directly embedded in the constructed GP model through the design of physics-constrained kernels. In particular, a double-sum invariant kernel is first developed to incorporate the invariance and symmetry features, and then an additive kernel is developed to incorporate the additive feature of the problem. The invariant kernel and the additive kernel are then integrated to construct the physics-constrained GP model. Compared to the standard GP model, the proposed physics-constrained GP models require less training data to achieve the desired accuracy in predicting the hydrodynamic characteristics and are also less vulnerable to the curse of dimensionality (i.e., good scalability for large arrays) due to the use of an additive kernel. The efficiency, accuracy, and scalability of the proposed approach are demonstrated through an application to predict the hydrodynamic characteristics for WEC arrays of different sizes and layouts.

16 TIDAL AND WAVE POWER↗

A Survey of Constrained Gaussian Process: Approaches and Implementation Challenges

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a larger effort in scientific machine learning, many recent works have incorporated physical constraints or other a priori information within Gaussian process regression to supplement limited data and regularize the behavior of the model. We provide an overview and survey of several classes of Gaussian process constraints, including positivity or bound constraints, monotonicity and convexity constraints, differential equation constraints provided by linear PDEs, and boundary condition constraints. We compare the strategies behind each approach as well as the differences in implementation, concluding with a discussion of the computational challenges introduced by constraints.

97 MATHEMATICS AND COMPUTING↗

Gaussian process regression constrained by boundary value problems

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and boundary conditions, but for which only scattered observations of the source term are available. Scattered observations of the solution may also be used in the regression. The framework combines co-kriging with the linear transformation of a Gaussian process together with the use of kernels given by spectral expansions in eigenfunctions of the boundary value problem. Furthermore, it benefits from a reduced-rank property of covariance matrices. We demonstrate that the resulting framework yields more accurate and stable solution inference as compared to physics-informed Gaussian process regression without boundary condition constraints.

42 ENGINEERING↗

Analytic Neural Network Gaussian Process Enabled Chance-Constrained Voltage Regulation for Active Distribution Systems with PVs, Batteries and EVs

This paper proposes an analytic neural network Gaussian process (NNGP)-based chance-constrained real-time voltage regulation method for active distribution systems with photovoltaics (PVs), batteries, and electric vehicles (EVs). NNGP can utilize historical measurement data to achieve real-time probabilistic node voltage estimation through Bayesian inference. Then, NNGP is fully analytically embedded into the optimal power flow model to perform voltage regulation and adapt to various topological changes. The uncertainties of voltage estimations are easily considered via the chance constraint, and it has been shown that the adoption of this chance constraint can significantly improve the reliability of voltage regulation under various scenarios. The comparison results with other methods, carried out on a real 759-node distribution system located in western Colorado, U.S., show that the proposed method can achieve accurate voltage estimation across different topologies and reliably perform voltage regulation considering PVs, batteries, and EVs.

active distribution systems↗

Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Physics-constrained machine learning is emerging as an important topic in the field of machine learning for physics. One of the most significant advantages of incorporating physics constraints into machine learning methods is that the resulting model requires significantly less data to train. By incorporating physical rules into the machine learning formulation itself, the predictions are expected to be physically plausible. Gaussian process (GP) is perhaps one of the most common methods in machine learning for small datasets. In this paper, we investigate the possibility of constraining a GP formulation with monotonicity on three different material datasets, where one experimental and two computational datasets are used. The monotonic GP is compared against the regular GP, where a significant reduction in the posterior variance is observed. The monotonic GP is strictly monotonic in the interpolation regime, but in the extrapolation regime, the monotonic effect starts fading away as one goes beyond the training dataset. Imposing monotonicity on the GP comes at a small accuracy cost, compared to the regular GP. The monotonic GP is perhaps most useful in applications where data are scarce and noisy, and monotonicity is supported by strong physical evidence.

36 MATERIALS SCIENCE↗

Detailed examination of astrophysical constraints on the symmetry energy and the neutron skin of 208 Pb with minimal modeling assumptions

We report the symmetry energy and its density dependence are pivotal for many nuclear physics and astrophysics applications, as they determine properties ranging from the neutron-skin thickness of nuclei to the crust thickness and the radius of neutron stars. Recently, PREX-II reported a value of 0.283 ± 0.071 fm for the neutron-skin thickness of 208 Pb, $R^{^{208}Pb}_{skin}$, implying a symmetry-energy slope parameter L of 106 ± 37 MeV, larger than most ranges obtained from microscopic calculations and other nuclear experiments. We use a nonparametric equation of state representation based on Gaussian processes to constrain the symmetry energy S 0 , L, and $R^{^{208}Pb}_{skin}$ directly from observations of neutron stars with minimal modeling assumptions. The resulting astrophysical constraints from heavy pulsar masses, LIGO/Virgo, and NICER favor smaller values of the neutron skin and L, as well as negative symmetry incompressibilities. Combining astrophysical data with chiral effective field theory (χEFT) and PREX-II constraints yields S 0 = 33.0$^{+2.0}_{-1.8}$ MeV, L = 53$^{+14}_{-15}$ MeV, and $R^{^{208}Pb}_{skin}$ = 0.17 $^{+0.04}_{-0.04}$ fm. We also examine the consistency of several individual χEFT calculations with astrophysical observations and terrestrial experiments. We find that there is only mild tension between χ EFT, astrophysical data, and PREX-II's $R^{^{208}Pb}_{skin}$ measurement (p value = 12.3%) and that there is excellent agreement between χEFT, astrophysical data, and other nuclear experiments.

74 ATOMIC AND MOLECULAR PHYSICS↗

Astrophysical Constraints on the Symmetry Energy and the Neutron Skin of 208 Pb with Minimal Modeling Assumptions

The symmetry energy and its density dependence are crucial inputs for many nuclear physics and astrophysics applications, as they determine properties ranging from the neutron-skin thickness of nuclei to the crust thickness and the radius of neutron stars. Recently, PREX-II reported a value of 0.283 ± 0.071 fm for the neutron-skin thickness of 208 Pb, implying a slope parameter L = 106 ± 37 MeV, larger than most ranges obtained from microscopic calculations and other nuclear experiments. We use a nonparametric equation of state representation based on Gaussian processes to constrain the symmetry energy S 0 , L, and $R^{^{208}Pb}_{skin}$ directly from observations of neutron stars with minimal modeling assumptions. The resulting astrophysical constraints from heavy pulsar masses, LIGO/Virgo, and NICER clearly favor smaller values of the neutron skin and L, as well as negative symmetry incompressibilities. Finally, combining astrophysical data with PREX-II and chiral effective field theory constraints yields S 0 = $33.0^{+2.0}_{-1.8}$ MeV , L = $53^{+14}_{-15}$ MeV, and $R^{^{208}Pb}_{skin} = 0.17^{+0.04}_{-0.04}$ fm.

79 ASTRONOMY AND ASTROPHYSICS↗

Reconstructing probability distributions with Gaussian processes

Modern cosmological analyses constrain physical parameters using Markov Chain Monte Carlo (MCMC) or similar sampling techniques. Oftentimes, these techniques are computationally expensive to run and require up to thousands of CPU hours to complete. Here we present a method for reconstructing the log-probability distributions of completed experiments from an existing chain (or any set of posterior samples). Here, the reconstruction is performed using Gaussian process regression for interpolating the log-probability. This allows for easy resampling, importance sampling, marginalization, testing different samplers, investigating chain convergence, and other operations. As an example use case, we reconstruct the posterior distribution of the most recent Planck 2018 analysis. We then resample the posterior, and generate a new chain with 40 times as many points in only 30 min. Our likelihood reconstruction tool is made publicly available online.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Photometry as a Proxy for Stellar Activity in Radial Velocity Analyses

Stellar activity remains a limiting factor in measuring precise planet parameters from radial velocity spectroscopy, not least in the search for Earth-mass planets orbiting in the habitable zones of Sun-like stars. One approach to mitigate stellar activity is to use combined analyses of both radial velocity and time-series photometry. We present an analysis of simultaneous disk-integrated photometry and radial velocity data of the Sun in order to determine the useful limits of a combined analysis. We find that simple periodogram or autocorrelation analysis of solar photometry give the correct rotation period <50% of the time. We therefore use a Gaussian process to investigate the time variability of solar photometry and to directly compare simultaneous photometry with radial velocity data. We find that the hyperparameter posteriors are relatively stable over 70 yr of solar photometry and the amplitude tracks the solar cycle. We observe good agreement between the hyperparameter posteriors for the simultaneous photometry and radial velocity data. Our primary conclusion is a recommendation to include an additional prior in Gaussian process fits to constrain the evolutionary timescale to be greater than the recurrence timescale (i.e., the rotation period) to recover more physically plausible and useful results. Our results indicate that such simultaneous monitoring may be a useful tool in enhancing the precision of radial velocity surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Incorporating physical constraints into Gaussian process surrogate models (LDRD Project Summary)

This report summarizes work done under the Laboratory Directed Research and Development (LDRD) project titled "Incorporating physical constraints into Gaussian process surrogate models?' In this project, we explored a variety of strategies for constraint implementations. We considered bound constraints, monotonicity and related convexity constraints, Gaussian processes which are constrained to satisfy linear operator constraints which represent physical laws expressed as partial differential equations, and intrinsic boundary condition constraints. We wrote three papers and are currently finishing two others. We developed initial software implementations for some approaches. This report summarizes the work done under this LDRD.

97 MATHEMATICS AND COMPUTING↗