Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian Process Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Sequential Bayesian Experimental Design for Calibration of Expensive Simulation Models

Simulation models of critical systems often have parameters that need to be calibrated using observed data. For expensive simulation models, calibration is done using an emulator of the simulation model built on simulation output at different parameter settings. Using intelligent and adaptive selection of parameters to build the emulator can drastically improve the efficiency of the calibration process. The article proposes a sequential framework with a novel criterion for parameter selection that targets learning the posterior density of the parameters. The emergent behavior from this criterion is that exploration happens by selecting parameters in uncertain posterior regions while simultaneously exploitation happens by selecting parameters in regions of high posterior density. Furthermore, the advantages of the proposed method are illustrated using several simulation experiments and a nuclear physics reaction model.

97 MATHEMATICS AND COMPUTING↗

Predictive machine learning approaches for the microstructural behavior of multiphase zirconium alloys

Abstract Zirconium alloys are widely used in harsh environments characterized by high temperatures, corrosivity, and radiation exposure. These alloys, which have a hexagonal closed packed (h.c.p.) structure thermo-mechanically degrade, when exposed to severe operating environments due to hydride formation. These hydrides have a different crystalline structure, than the matrix, which results in a multiphase alloy. To accurately model these materials at the relevant physical scale, it is necessary to fully characterize them based on a microstructural fingerprint, which is defined here as a combination of features that include hydride geometry, parent and hydride texture and crystalline structure of these multiphase alloys. Hence, this investigation will develop a reduced order modeling approach, where this microstructural fingerprint is used to predict critical fracture stress levels that are physically consistent with microstructural deformation and fracture modes. Machine Learning (ML) methodologies based on Gaussian Process Regression, random forests, and multilayer perceptrons (MLP) were used to predict material fracture critical stress states. MLPs, or neural networks, had the highest accuracy on held-out test sets across three predetermined strain levels of interest. Hydride orientation, grain orientation or texture, and hydride volume fraction had the greatest effect on critical fracture stress levels and had partial dependencies that were highly significant, and in comparison hydride length and hydride spacing have less effects on fracture stresses. Furthermore, these models were also used accurately predicted material response to nominal applied strains as a function of the microstructural fingerprint.

36 MATERIALS SCIENCE↗

Adaptive, Active Learning, and Multifidelity Monte Carlo Methods in the MOOSE Stochastic Tools Module

MOOSE is an open-source computational platform for constructing multi-physics models and executing them in a massively parallel fashion. It has a stochastic tools module (STM) for forward/inverse uncertainty quantification (UQ) and surrogate modeling. This presentation details some recent developments to the STM with respect to the implementation of adaptive, active learning, and multifidelity Monte Carlo methods for forward UQ of computational models. Specifically, the adaptive Monte Carlo methods include Markov Chain Monte Carlo (MCMC)-driven algorithms like adaptive importance sampling and parallelized subset simulation for statistical QoI estimation, rare events analysis, and stochastic gradient-free optimization. The active learning methods include Gaussian Process (GP) surrogates and their training via Adam optimization, design of acquisition functions, and integration with samplers like Monte Carlo, adaptive importance, and parallelized subset simulation. These active learning methods are also designed to work in a batch mode, wherein, the required calls to the full computational model are executed in parallel whenever a user-specified batch size is met. The multifidelity methods in STM are broadly divided into two categories: hierarchical, where a defined hierarchy exists among the low-fidelity models, and peer, where all the low-fidelity models are treated equally. A GP surrogate is used to learn the differences between the low- and high-fidelity models in both multifidelity categories, and acquisition functions from the active learning classes are used to decide whether to rely on a low-fidelity model or call the expensive high-fidelity model. Alongside the software description and usage, applications are also presented to nuclear engineering computational models including a TRISO nuclear fuel particle, a reactor pressure vessel, and a heat-pipe microreactor.

97 MATHEMATICS AND COMPUTING↗

Forward treatment planning for modulated electron radiotherapy (MERT) employing Monte Carlo methods

Purpose: This paper describes the development of a forward planning process for modulated electron radiotherapy (MERT). The approach is based on a previously developed electron beam model used to calculate dose distributions of electron beams shaped by a photon multi leaf collimator (pMLC). Methods: As the electron beam model has already been implemented into the Swiss Monte Carlo Plan environment, the Eclipse treatment planning system (Varian Medical Systems, Palo Alto, CA) can be included in the planning process for MERT. In a first step, CT data are imported into Eclipse and a pMLC shaped electron beam is set up. This initial electron beam is then divided into segments, with the electron energy in each segment chosen according to the distal depth of the planning target volume (PTV) in beam direction. In order to improve the homogeneity of the dose distribution in the PTV, a feathering process (Gaussian edge feathering) is launched, which results in a number of feathered segments. For each of these segments a dose calculation is performed employing the in-house developed electron beam model along with the macro Monte Carlo dose calculation algorithm. Finally, an automated weight optimization of all segments is carried out and the total dose distribution is read back into Eclipse for display and evaluation. One academic and two clinical situations are investigated for possible benefits of MERT treatment compared to standard treatments performed in our clinics and treatment with a bolus electron conformal (BolusECT) method. Results: The MERT treatment plan of the academic case was superior to the standard single segment electron treatment plan in terms of organs at risk (OAR) sparing. Further, a comparison between an unfeathered and a feathered MERT plan showed better PTV coverage and homogeneity for the feathered plan, with V{sub 95%} increased from 90% to 96% and V{sub 107%} decreased from 8% to nearly 0%. For a clinical breast boost irradiation, the MERT plan led to a similar homogeneity in the PTV compared to the standard treatment plan while the mean body dose was lower for the MERT plan. Regarding the second clinical case, a whole breast treatment, MERT resulted in a reduction of the lung volume receiving more than 45% of the prescribed dose when compared to the standard plan. On the other hand, the MERT plan leads to a larger low-dose lung volume and a degraded dose homogeneity in the PTV. For the clinical cases evaluated in this work, treatment plans using the BolusECT technique resulted in a more homogenous PTV and CTV coverage but higher doses to the OARs than the MERT plans. Conclusions: MERT treatments were successfully planned for phantom and clinical cases, applying a newly developed intuitive and efficient forward planning strategy that employs a MC based electron beam model for pMLC shaped electron beams. It is shown that MERT can lead to a dose reduction in OARs compared to other methods. The process of feathering MERT segments results in an improvement of the dose homogeneity in the PTV.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SUPERPOSITION OF POLYTROPES IN THE INNER HELIOSHEATH

This paper presents a possible generalization of the equation of state and Bernoulli's integral when a superposition of polytropic processes applies in space and astrophysical plasmas. The theory of polytropic thermodynamic processes for a fixed polytropic index is extended for a superposition of polytropic indices. In general, the superposition may be described by any distribution of polytropic indices, but emphasis is placed on a Gaussian distribution. The polytropic density–temperature relation has been used in numerous analyses of space plasma data. This linear relation on a log–log scale is now generalized to a concave-downward parabola that is able to describe the observations better. The model of the Gaussian superposition of polytropes is successfully applied in the proton plasma of the inner heliosheath. The estimated mean polytropic index is near zero, indicating the dominance of isobaric thermodynamic processes in the sheath, similar to other previously published analyses. By computing Bernoulli's integral and applying its conservation along the equator of the inner heliosheath, the magnetic field in the inner heliosheath is estimated, B ∼ 2.29 ± 0.16 μG. The constructed normalized histogram of the values of the magnetic field is similar to that derived from a different method that uses the concept of large-scale quantization, bringing incredible insights to this novel theory.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing multi-dimensional composition spaces in search of strong metallic alloys

Refractory complex concentrated alloys (RCCA) offer exceptionally high-temperature strength compared to pure metals and dilute alloys, but predictive theory for RCCA design is lacking. We present large-scale molecular Dynamics (MD) simulations of crystal plasticity to explore alloy compositions for maximum mechanical strength, focusing on Fe-Ta-W and Nb-Ta-Mo-W alloy families modeled with Embedded Atom Model (EAM) and Spectral Neighbor Analysis Potentials (SNAP). To efficiently guide the search for strong alloy compositions, we employ iterative optimization using Gaussian process regression. Many simulated RCCA compositions exhibit pronounced cocktail strengthening, with strengths surpassing their strongest constituent metal, tungsten. Contrary to expectations, the highest strength is found on binary edges of the RCCA composition space. Detailed analyses of atomistic simulations reveal that, similar to pure BCC metals, plastic response in RCCA is primarily governed by screw dislocations. However, at large strains, dislocation multiplication and interactions (Taylor hardening) become the dominant mechanisms contributing to RCCA strength.

Materials science↗

PARAMETER ESTIMATION FROM TIME-SERIES DATA WITH CORRELATED ERRORS: A WAVELET-BASED METHOD AND ITS APPLICATION TO TRANSIT LIGHT CURVES

We consider the problem of fitting a parametric model to time-series data that are afflicted by correlated noise. The noise is represented by a sum of two stationary Gaussian processes: one that is uncorrelated in time, and another that has a power spectral density varying as 1/f{sup g}amma. We present an accurate and fast [O(N)] algorithm for parameter estimation based on computing the likelihood in a wavelet basis. The method is illustrated and tested using simulated time-series photometry of exoplanetary transits, with particular attention to estimating the mid-transit time. We compare our method to two other methods that have been used in the literature, the time-averaging method and the residual-permutation method. For noise processes that obey our assumptions, the algorithm presented here gives more accurate results for mid-transit times and truer estimates of their uncertainties.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An extended-source spatial acquisition process based on maximum likelihood criterion for planetary optical communications

This paper describes an extended-source spatial acquisition process based on the maximum likelihood criterion for interplanetary optical communications. The objective is to use the sun-lit Earth image as a receiver beacon and point the transmitter laser to the Earth-based receiver to establish a communication path. The process assumes the existence of a reference image. The uncertainties between the reference image and the received image are modeled as additive white Gaussian disturbances. It has been shown that the optimal spatial acquisition requires solving two nonlinear equations to estimate the coordinates of the transceiver from the received camera image in the transformed domain. The optimal solution can be obtained iteratively by solving two linear equations. Numerical results using a sample sun-lit Earth as a reference image demonstrate that sub-pixel resolutions can be achieved in a high disturbance environment. Spatial resolution is quantified by Cramer-Rao lower bounds.

Yan, Tsun-Yee↗

Simulation of Charge Collection to Spacecraft Surfaces: Freja Satellite

As spacecraft travel through plasma, spacecraft surfaces become charged by the collection of charged particles. This process is referred to as Surface Charging. These charges can be detrimental to the vehicle's electronic subsystems as they present a threat of electrostatic discharge (ESD) to onboard circuitry. The process of Surface Charging is complex and is affected by many elements. The charging of each surface is unique. The potential of an individual surface is dependent upon many variables including but not limited to the surface's geometry, material and its location. Each surface also has unique interactions with the surrounding plasma. Other factors that play large roles in the charging process is the density and temperature of plasma ions and electrons. Using Nascap-2k, a model of the Freja satellite has been constructed, and its auroral plasma environment has been imitated to simulate surface charging characteristics. The charging process of the Freja satellite has been modeled iteratively with incremental changes in both the Maxwellian electron temperature (eV) as well as the Gaussian electron energy (eV). This study provides an analysis of the sensitivity between spacecraft surface charging and these two primary variables of electron differential flux.

Wolfley, Olivia H.↗

Simulation of Charge Collection to Spacecraft Surfaces: Freja Satellite

As spacecraft travel through space plasma, spacecraft surfaces become charged by the collection of charged particles. This process is referred to as Surface Charging. These charges can be detrimental to the vehicle's electronic subsystems as they present a threat of electrostatic discharge (ESD) to onboard circuitry. The process of Surface Charging is complex and is affected by many elements. The charging of each surface is unique. The potential of an individual surface is dependent upon many variables including but not limited to the surface's geometry, material and its location. Each surface also has unique interactions with the surrounding plasma. Other factors that play large roles in the charging process is the density and temperature of plasma ions and electrons. Using Nascap-2k, a model of the Freja satellite has been constructed, and its auroral plasma environment has been imitated to simulate surface charging characteristics. The charging process of the Freja satellite has been modeled iteratively with incremental changes in both the Maxwellian electron temperature (eV) as well as the Gaussian electron energy (eV). This study provides an analysis of the sensitivity between spacecraft surface charging and these two primary variables of electron differential flux.

Wolfley, Olivia Hope↗

Rough surface scattering results based on bandpass autocorrelation forms

Surface-height autocorrelation forms such as Gaussian and exponential are often used in studies of near-normal incidence rough-surface scattering. Such models require the existence of a constant, or DC, value in the spectrum. The consequences of autocorrelation forms that correspond to spectral processes that are essentially bandpass in nature are examined. One such process is that of ocean wind waves. In this case, the spectral components do not extend down to zero frequency. The physical optics backscatter theory is reexamined relative to such autocorrelation functions. Experimental results obtained from a wavetank are compared to the autocorrelation model used in the analysis. The analysis indicates that Gaussian correlation length or mean-square slope is not an appropriate parameter for narrowband conditions and that significant slope is a more relevant parameter. Inherent in the deep-phase assumption is some form of slope dependency. The analysis given (and variants thereof) can be used to provide insight into the physical effects of separate spectral components and of spectral directionality.

Miller, Lee S.↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reinforcement Learning via Gaussian Processes with Neural Network Dual Kernels

While deep neural networks (DNNs) and Gaussian Processes (GPs) are both popularly utilized to solve problems in reinforcement learning, both approaches feature undesirable drawbacks for challenging problems. DNNs learn complex non-linear embeddings, but do not naturally quantify uncertainty and are often data-inefficient to train. GPs infer posterior distributions over functions, but popular kernels exhibit limited expressivity on complex and high-dimensional data. Fortunately, recently discovered conjugate and neural tangent kernel functions encode the behavior of overparameterized neural networks in the kernel domain. We demonstrate that these kernels can be efficiently applied to regression and reinforcement learning problems by analyzing a baseline case study.We apply GPs with neural network dual kernels to solve reinforcement learning tasks for the first time. We demonstrate, using the well understood mountain-car problem, that GPs empowered with dual kernels perform at least as well as those using the conventional radial basis function kernel. Finally, we conjecture that by inheriting the probabilistic rigor of GPs and the powerful embedding properties of DNNs, GPs using NN dual kernels will empower future reinforcement learning models on difficult domains.

97 MATHEMATICS AND COMPUTING↗

A Simple Model of the Variability of Soil Depths

Soil depth tends to vary from a few centimeters to several meters, depending on many natural and environmental factors. Here, we hypothesize that the cumulative effect of these factors on soil depth, which is chiefly dependent on the process of biogeochemical weathering, is particularly affected by soil porewater (i.e., solute) transport and infiltration from the land surface. Taking into account evidence for a non-Gaussian distribution of rock weathering rates, we propose a simple mathematical model to describe the relationship between soil depth and infiltration flux. The model was tested using several areas in mostly semi-arid climate zones. The application of this model demonstrates the use of fundamental principles of physics to quantify the coupled effects of the five principal soil-forming factors of Dokuchaev.

54 ENVIRONMENTAL SCIENCES↗

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗

High-speed spiral imaging technique for an atomic force microscope using a linear quadratic Gaussian controller

This paper demonstrates a high-speed spiral imaging technique for an atomic force microscope (AFM). As an alternative to traditional raster scanning, an approach of gradient pulsing using a spiral line is implemented and spirals are generated by applying single-frequency cosine and sine waves of slowly varying amplitudes to the X and Y-axes of the AFM’s piezoelectric tube scanner (PTS). Due to these single-frequency sinusoidal input signals, the scanning process can be faster than that of conventional raster scanning. A linear quadratic Gaussian controller is designed to track the reference sinusoid and a vibration compensator is combined to damp the resonant mode of the PTS. An internal model of the reference sinusoidal signal is included in the plant model and an integrator for the system error is introduced in the proposed control scheme. As a result, the phase error between the input and output sinusoids from the X and Y-PTSs is reduced. The spirals produced have particularly narrow-band frequency measures which change slowly over time, thereby making it possible for the scanner to achieve improved tracking and continuous high-speed scanning rather than being restricted to the back and forth motion of raster scanning. As part of the post-processing of the experimental data, a fifth-order Butterworth filter is used to filter noises in the signals emanating from the position sensors and a Gaussian image filter is used to filter the images. A comparison of images scanned using the proposed controller (spiral) and the AFM PI controller (raster) shows improvement in the scanning rate using the proposed method.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SUGAR: An improved empirical model of Type Ia supernovae based on spectral features

Type Ia supernovae (SNe Ia) are widely used to measure the expansion of the Universe. Improving distance measurements of SNe Ia is one technique to better constrain the acceleration of expansion and determine its physical nature. This document develops a new SNe Ia spectral energy distribution (SED) model, called the SUpernova Generator And Reconstructor (SUGAR), which improves the spectral description of SNe Ia, and consequently could improve the distance measurements. This model was constructed from SNe Ia spectral properties and spectrophotometric data from the Nearby Supernova Factory collaboration. In a first step, a principal component analysis-like method was used on spectral features measured at maximum light, which allowed us to extract the intrinsic properties of SNe Ia. Next, the intrinsic properties were used to extract the average extinction curve. Third, an interpolation using Gaussian processes facilitated using data taken at different epochs during the lifetime of an SN Ia and then projecting the data on a fixed time grid. Finally, the three steps were combined to build the SED model as a function of time and wavelength. This is the SUGAR model. Results. The main advancement in SUGAR is the addition of two additional parameters to characterize SNe Ia variability. The first is tied to the properties of SNe Ia ejecta velocity and the second correlates with their calcium lines. The addition of these parameters, as well as the high quality of the Nearby Supernova Factory data, makes SUGAR an accurate and efficient model for describing the spectra of normal SNe Ia as they brighten and fade. The performance of this model makes it an excellent SED model for experiments like the Zwicky Transient Facility, the Large Synoptic Survey Telescope, or the Wide Field Infrared Survey Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

Theoretical Analysis of the EPR Spectrum Saturation Effect with Account for Spectral Diffusion in a System with a Gaussian Distribution of Spin Resonance Frequencies

We have analyzed the effect of saturation of the EPR spectrum for the model situation when a set of resonance frequencies of spin packets is described by a Gaussian distribution and spectral diffusion, which is a random process without correlation, exists. We have obtained the form of the spectrum for arbitrary values of magnetic–resonant parameters: relaxation times for the longitudinal and transverse components of the magnetization vector of the system, the spectral diffusion rate, the dispersion of the Gaussian distribution of resonance frequency, and the magnetic induction of the microwave field. We have derived an analytic expression for the saturation curve of the EPR spectrum. Detailed analysis of the dependence of the spectrum saturation curve on the spin system parameters is performed for the optimal case when the microwave field frequency coincides with the average frequency of the Gaussian distribution for resonance frequencies. The value of the microwave field induction at which the peak of the saturation curve is attained has been determined for arbitrary values of the paramagnetic relaxation time, spectral diffusion rate, and dispersion of the Gaussian spin frequency distribution. We have formulated the algorithm for determining the spin–lattice relaxation time using the experimentally determined microwave field induction for which the saturation curve passes through the peak. It should be noted that numerical calculations have been performed for parameters typical of EPR spectroscopy. The general analytic expression derived for the shape of the spectrum in the saturation conditions and qualitative conclusions concerning the effect of spectral diffusion on the saturation of stationary spectra obtained in this study can also be used in other fields of spectroscopy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗