Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian process modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Dark energy survey year 3 results: Cosmology with peaks using an emulator approach

ABSTRACT We constrain the matter density Ωm and the amplitude of density fluctuations σ8 within the ΛCDM cosmological model with shear peak statistics and angular convergence power spectra using mass maps constructed from the first three years of data of the Dark Energy Survey (DES Y3). We use tomographic shear peak statistics, including cross-peaks: peak counts calculated on maps created by taking a harmonic space product of the convergence of two tomographic redshift bins. Our analysis follows a forward-modelling scheme to create a likelihood of these statistics using N-body simulations, using a Gaussian process emulator. We take into account the uncertainty from the remaining, largely unconstrained ΛCDM parameters (Ωb, ns, and h). We include the following lensing systematics: multiplicative shear bias, photometric redshift uncertainty, and galaxy intrinsic alignment. Stringent scale cuts are applied to avoid biases from unmodelled baryonic physics. We find that the additional non-Gaussian information leads to a tightening of the constraints on the structure growth parameter yielding $S_8~\equiv ~\sigma _8\sqrt{\Omega _{\mathrm{m}}/0.3}~=~0.797_{-0.013}^{+0.015}$ (68 per cent confidence limits), with a precision of 1.8 per cent, an improvement of 38 per cent compared to the angular power spectra only case. The results obtained with the angular power spectra and peak counts are found to be in agreement with each other and no significant difference in S8 is recorded. We find a mild tension of $1.5 \, \sigma$ between our study and the results from Planck 2018, with our analysis yielding a lower S8. Furthermore, we observe that the combination of angular power spectra and tomographic peak counts breaks the degeneracy between galaxy intrinsic alignment AIA and S8, improving cosmological constraints. We run a suite of tests concluding that our results are robust and consistent with the results from other studies using DES Y3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Combined full shape analysis of BOSS galaxies and eBOSS quasars using an iterative emulator

ABSTRACT Standard full-shape clustering analyses in Fourier space rely on a fixed power spectrum template, defined at the fiducial cosmology used to convert redshifts into distances, and compress the cosmological information into the Alcock–Paczynski parameters and the linear growth rate of structure. In this paper, we propose an analysis method that operates directly in the cosmology parameter space and varies the power spectrum template accordingly at each tested point. Predictions for the power spectrum multipoles from the TNS model are computed at different cosmologies in the framework of $\Lambda \rm {CDM}$. Applied to the final eBOSS QSO and LRG samples together with the low-z DR12 BOSS galaxy sample, our analysis results in a set of constraints on the cosmological parameters Ωcdm, H0, σ8, Ωb, and ns. To reduce the number of computed models, we construct an iterative process to sample the likelihood surface, where each iteration consists of a Gaussian process regression. This method is validated with mocks from N-body simulations. From the combined analysis of the (e)BOSS data, we obtain the following constraints: σ8 = 0.877 ± 0.049 and $\Omega _{\rm m}=0.304^{+0.016}_{-0.010}$ without any external prior. The eBOSS quasar sample alone shows a 3.1σ discrepancy compared to the Planck prediction.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗
DOE OSTI2024

GP-BayesOpInf

SAND2025-01851O GP-BayesOpInf is a software tool that uses algorithms to combine Gaussian process regression, principal component analysis, and linear Bayesian inference to produce a probabilistic reduced-order model for time-dependent systems. Numerical examples include the compressible Euler equations for an ideal gas, a heat diffusion process with a nonlinear reaction term, and a set of ordinary differential equations describing a compartmental model in epidemiology. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗
DOE OSTI2022

Industrial battery operation and utilization in the presence of electrical load uncertainty using Bayesian decision theory

Behind the meter battery storage is becoming increasing popular in all sectors, though enthusiasm has recently lagged in the industrial sector. Even though there may be many factors contributing to this including lack of innovation, prohibitive costs, and undesirable rate structures, a difficulty arises in accounting for uncertainty of electrical load in industrial facilities while still attempting to utilize battery storage as much as possible all while trying to achieve fiscal profitability. Here this study utilizes Gaussian process regression and Bayesian decision theory to organize load data and quantify electrical load uncertainty to properly and effectively discharge industrial battery storage. The study employs a simulation model to set battery load setpoints for the span of the utility billing period according to the degree of risk aversion. This combination of economic analysis according to utility billing period and utilization of degree of risk aversion to make decisions on the uncertainty of the data has not before been applied to battery storage. The method resulted in an annual average reduction of peak demand by 3.8 % at the lowest amount of savings and lowest risk aversion. The highest risk aversion resulted in an annual average reduction of peak demand of 7.5 %. The maximum reduction of peak load in any month was 13.8 % in the month of December with a relatively high risk aversion. With a the highest amount risk aversion tested, the model reduced demand ten of the twelve months of the year.

25 ENERGY STORAGE↗
DOE OSTI2022

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗
DOE OSTI2023

Covariate Dependent Sparse Functional Data Analysis

This study proposes a method to incorporate covariate information into sparse functional data analysis. The method aims at cases where each subject has a limited number of longitudinal measurements and is associated with static covariates. This research is motivated by several use cases in practice. One representative example is void swelling, a nuclear-specific material degradation mechanism. Void swelling is affected by many covariates, including alloy composition and irradiation type. How to accurately model the complicated joint effects of such covariates on the swelling process is the key to mitigating the effect of swelling and ensuring safe operation. Unlike most of the existing methods, the proposed method can handle high-dimensional covariates with the informative covariate identification procedure and sparse and irregularly spaced measurements, that is, does not require complete or dense observations. The main innovation of the proposed method is that we model the variation coming from covariates and the variation left conditioned on covariates, such that the functional principal component analysis and Gaussian process can be conducted in a unified manner. Further, we also propose a systematic approach to identify important covariates in the hypothesis testing context. The methodology is demonstrated on applications in nuclear engineering and healthcare and simulation studies.

42 ENGINEERING↗
DOE OSTI2022

Active learning of reactive Bayesian force fields applied to heterogeneous catalysis dynamics of H/Pt

Abstract Atomistic modeling of chemically reactive systems has so far relied on either expensive ab initio methods or bond-order force fields requiring arduous parametrization. Here, we describe a Bayesian active learning framework for autonomous “on-the-fly” training of fast and accurate reactive many-body force fields during molecular dynamics simulations. At each time-step, predictive uncertainties of a sparse Gaussian process are evaluated to automatically determine whether additional ab initio training data are needed. We introduce a general method for mapping trained kernel models onto equivalent polynomial models whose prediction cost is much lower and independent of the training set size. As a demonstration, we perform direct two-phase simulations of heterogeneous H 2 turnover on the Pt(111) catalyst surface at chemical accuracy. The model trains itself in three days and performs at twice the speed of a ReaxFF model, while maintaining much higher fidelity to DFT and excellent agreement with experiment.

42 ENGINEERING↗
DOE OSTI2021

Astrophysical Constraints on the Symmetry Energy and the Neutron Skin of 208 Pb with Minimal Modeling Assumptions

The symmetry energy and its density dependence are crucial inputs for many nuclear physics and astrophysics applications, as they determine properties ranging from the neutron-skin thickness of nuclei to the crust thickness and the radius of neutron stars. Recently, PREX-II reported a value of 0.283 ± 0.071 fm for the neutron-skin thickness of 208 Pb, implying a slope parameter L = 106 ± 37 MeV, larger than most ranges obtained from microscopic calculations and other nuclear experiments. We use a nonparametric equation of state representation based on Gaussian processes to constrain the symmetry energy S 0 , L, and $R^{^{208}Pb}_{skin}$ directly from observations of neutron stars with minimal modeling assumptions. The resulting astrophysical constraints from heavy pulsar masses, LIGO/Virgo, and NICER clearly favor smaller values of the neutron skin and L, as well as negative symmetry incompressibilities. Finally, combining astrophysical data with PREX-II and chiral effective field theory constraints yields S 0 = $33.0^{+2.0}_{-1.8}$ MeV , L = $53^{+14}_{-15}$ MeV, and $R^{^{208}Pb}_{skin} = 0.17^{+0.04}_{-0.04}$ fm.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Detailed examination of astrophysical constraints on the symmetry energy and the neutron skin of 208 Pb with minimal modeling assumptions

We report the symmetry energy and its density dependence are pivotal for many nuclear physics and astrophysics applications, as they determine properties ranging from the neutron-skin thickness of nuclei to the crust thickness and the radius of neutron stars. Recently, PREX-II reported a value of 0.283 ± 0.071 fm for the neutron-skin thickness of 208 Pb, $R^{^{208}Pb}_{skin}$, implying a symmetry-energy slope parameter L of 106 ± 37 MeV, larger than most ranges obtained from microscopic calculations and other nuclear experiments. We use a nonparametric equation of state representation based on Gaussian processes to constrain the symmetry energy S 0 , L, and $R^{^{208}Pb}_{skin}$ directly from observations of neutron stars with minimal modeling assumptions. The resulting astrophysical constraints from heavy pulsar masses, LIGO/Virgo, and NICER favor smaller values of the neutron skin and L, as well as negative symmetry incompressibilities. Combining astrophysical data with chiral effective field theory (χEFT) and PREX-II constraints yields S 0 = 33.0$^{+2.0}_{-1.8}$ MeV, L = 53$^{+14}_{-15}$ MeV, and $R^{^{208}Pb}_{skin}$ = 0.17 $^{+0.04}_{-0.04}$ fm. We also examine the consistency of several individual χEFT calculations with astrophysical observations and terrestrial experiments. We find that there is only mild tension between χ EFT, astrophysical data, and PREX-II's $R^{^{208}Pb}_{skin}$ measurement (p value = 12.3%) and that there is excellent agreement between χEFT, astrophysical data, and other nuclear experiments.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Machine learning-assisted profiling of a kinked ladder polymer structure using scattering

Ladder polymers consisting of fused rings in the backbone have very limited conformational freedom, which results in very different properties from traditional linear polymers. However, accurately determining their size and chain conformations from solution scattering remains a challenge. Their chain conformations of kinked ladder polymers are largely governed by the structures and relative orientations or configurations of the repeat units, unlike conventional polymer chains whose bending angles between repeat units follow a unimodal Gaussian distribution. Meanwhile, traditional scattering models for polymer chains do not account for these unique structural features. This work introduces a novel approach that integrates machine learning with Monte Carlo simulations to construct a model that can describe the geometry of a type of kinked CANAL ladder polymers. We first develop a Monte Carlo simulation model for sampling the configuration space of CANAL ladder polymers, where each repeat unit is modeled as a biaxial segment. Then, we establish a machine learning-assisted scattering analysis framework based on Gaussian Process Regression. Finally, we conduct small-angle neutron scattering experiments on a CANAL ladder polymer solution to apply our approach. Our method uncovers structural features of such ladder polymers that conventional methods fail to capture.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2025

The Atacama Cosmology Telescope: DR6 power spectrum foreground model and validation

We discuss the model of astrophysical emission at millimeter wavelengths used to characterize foregrounds in the multi-frequency power spectra of the Atacama Cosmology Telescope (ACT) Data Release 6 (DR6), expanding on Louis et al. (2025) (2503.14452). We detail several tests to validate the capability of the DR6 parametric foreground model to describe current observations and complex simulations, and show that cosmological parameter constraints are robust against model extensions and variations. We demonstrate consistency of the model with pre-DR6 ACT data and observations from Planck and the South Pole Telescope. We evaluate the implications of using different foreground templates and extending the model with new components and/or free parameters. In all scenarios, the DR6 ΛCDM and ΛCDM+N eff cosmological parameters shift by less than 0.5σ relative to the baseline constraints. Some foreground parameters shift more; we estimate their systematic uncertainties associated with modeling choices. From our constraint on the kinematic Sunyaev-Zel'dovich power, we obtain a conservative limit on the duration of reionization of Δz rei < 4.4, assuming a reionization midpoint consistent with optical depth measurements and a minimal low-redshift contribution, with varying assumptions for this component leading to tighter limits. Finally, we analyze realistic non-Gaussian, correlated microwave sky simulations containing Galactic and extragalactic foreground fields, built independently of the DR6 parametric foreground model. Processing these simulations through the DR6 power spectrum and likelihood pipeline, we recover the input cosmological parameters of the underlying cosmic microwave background field, a new demonstration for small-scale CMB analysis. These tests validate the robustness of the ACT DR6 foreground model and cosmological parameter constraints.

CMBR experiments↗
DOE OSTI2024

Thinking Bayesian for plasma physicists

Bayesian statistics offers a powerful technique for plasma physicists to infer knowledge from the heterogeneous data types encountered. To explain this power, a simple example, Gaussian Process Regression, and the application of Bayesian statistics to inverse problems are explained. The likelihood is the key distribution because it contains the data model, or theoretic predictions, of the desired quantities. By using prior knowledge, the distribution of the inferred quantities of interest based on the data given can be inferred. Because it is a distribution of inferred quantities given the data and not a single prediction, uncertainty quantification is a natural consequence of Bayesian statistics. The benefits of machine learning in developing surrogate models for solving inverse problems are discussed, as well as progress in quantitatively understanding the errors that such a model introduces.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Near-Infrared Spectroscopy can Predict Anatomical Abundance in Corn Stover

Feedstock heterogeneity is a key challenge impacting the deconstruction and conversion of herbaceous lignocellulosic biomass to biobased fuels, chemicals, and materials. Upstream processing to homogenize biomass feedstock streams into their anatomical components via air classification allows for a more tailored approach to subsequent mechanical and chemical processing. Here, we show that differing corn stover anatomical tissues respond differently to pretreatment and enzymatic hydrolysis and therefore, a one-size-fits-all approach to chemical processing biomass is inappropriate. To inform on-line downstream processing, a robust and high-throughput analytical technique is needed to quantitatively characterize the separated biomass. Predictive correlation of near-infrared spectra to biomass chemical composition is such a technique. Here, we demonstrate the capability of models developed using an “off-the-shelf,” industrially relevant spectrometer with limited spectral range to make strong predictions of both cell wall chemical composition and the relative abundance of anatomical components of the corn stover, the latter for the first time ever. Gaussian process regression (GPR) yields stronger correlations (average R 2 v = 88% for chemical composition and 95% for anatomical relative abundance) than the more commonly used partial least squares (PLS) regression (average R 2 v = 84% for chemical composition and 92% for anatomical relative abundance). In nearly all cases, both GPR and PLS outperform models generated using neural networks. These results highlight the potential for coupling NIRS with predictive models based on GPR due to the potential to yield more robust correlations.

09 BIOMASS FUELS↗
DOE OSTI2022

Development of advanced machine learning models for analysis of plutonium surrogate optical emission spectra

This work investigates and applies machine learning paradigms seldom seen in analytical spectroscopy for quantification of gallium in cerium matrices via processing of laser-plasma spectra. Ensemble regressions, support vector machine regressions, Gaussian kernel regressions, and artificial neural network techniques are trained and tested on cerium-gallium pellet spectra. A thorough hyperparameter optimization experiment is conducted initially to determine the best design features for each model. The optimized models are evaluated for sensitivity and precision using the limit of detection (LoD) and root mean-squared error of prediction (RMSEP) metrics, respectively. Gaussian kernel regression yields the superlative predictive model with an RMSEP of 0.33% and an LoD of 0.015% for quantification of Ga in a Ce matrix. This study concludes that these machine learning methods could yield robust prediction models for rapid quality control analysis of plutonium alloys.

Rao, Ashwin P. (ORCID:0000000319312568)↗
DOE OSTI2023

DRIPS: A framework for dimension reduction and interpolation in parameter space

Reduced-order models are often used to describe the behavior of complex systems, whose simulation with a full model is too expensive, or to extract salient features from the full model’s output. We introduce a new model-reduction framework DRIPS (dimension reduction and interpolation in parameter space) that combines the offline local model reduction with the online parameter interpolation of reduced-order bases (ROBs). The offline step of this framework relies on dynamic mode decomposition (DMD) to build a low-rank linear surrogate model, equipped with a local ROB, for quantities of interest derived from the training data generated by repeatedly solving the (nonlinear) high-fidelity model for multiple parameter points. The online step consists of the construction of a parametric reduced-order model for each target/test point in the parameter space, with the interpolation of ROBs done on a Grassman manifold and the interpolation of reduced-order operators done on a matrix manifold. The DMD component enables DRIPS to model (typically low-dimensional) quantities of interest directly, without having to access the (typically high-dimensional and possibly nonlinear) operators in a high-fidelity model that governs the dynamics of the underlying high-dimensional state variables, as required in projection-based reduced-order modeling. A series of numerical experiments suggests that DRIPS yields a model reduction, which is computationally more efficient than the commonly used projection-based proper orthogonal decomposition; it does so without requiring a prior knowledge of the governing equation for quantities of interest. Furthermore, for the nonlinear systems considered, DRIPS is more accurate than Gaussian-process interpolation (Kriging).

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Discovering Active Subspaces for High-Dimensional Computer Models

Dimension reduction techniques have long been an important topic in statistics, and active subspaces (AS) have received much attention this past decade in the computer experiments literature. The most common approach towards estimating the AS is to use Monte Carlo with numerical gradient evaluation. While sensible in some settings, this approach has obvious drawbacks. Recent research has demonstrated that active subspace calculations can be obtained in closed form, conditional on a Gaussian process (GP) surrogate, which can be limiting in high-dimensional settings for computational reasons. In this paper, we produce the relevant calculations for a more general case when the model of interest is a linear combination of tensor products. These general equations can be applied to the GP, recovering previous results as a special case, or applied to the models constructed by other regression techniques including multivariate adaptive regression splines (MARS). Furthermore, using a MARS surrogate has many advantages including improved scaling, better estimation of active subspaces in high dimensions and the ability to handle a large number of prior distributions in closed form. In one real-world example, we obtain the active subspace of a radiation-transport code with 240 inputs and 9,372 model runs in under half an hour.

97 MATHEMATICS AND COMPUTING↗