Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian Process Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Sensitivity study of a full-scale industrial spray-injected fluidized bed reactor

The industrial fluidized bed reactor (FBR) described here is designed to convert an aqueous solid laden stream into a consistent solid product material. Additionally, the FBR is heated to 650 °C and the aqueous reactant is spray-atomized into the fluidized bed, converting it into a granular solid through a series of heterogeneous chemical reactions. The objective of this study is to use the MFiX two-fluid model as a screening tool to investigate the effects of off-nominal conditions for the purpose of establishing performance guidelines. This information will be helpful to assess whether the identified boundaries of the system are steep or gradual. Initially, 13 independent operating parameters were sampled in a one-at-a-time manner using high, low, and base values and ranked against a set of performance criteria. Five operating parameters were found to have the largest effect (bed particle size, bed particle density, coal particle size, spray feed flow rate, and fluidizing gas flow rate) on three quantities of interest—bed differential temperature, solids velocity, and bed voidage. Latin hypercube sampling was used to generate a minimal number of random values for various combinations of input parameters. The spray feed flow rate was the most significant parameter for the temperature differences, and the coal particle and bed particle size were significant contributors. The bed particle size had the largest effect on the low velocity of the bed particles, with the coal particle size as a contributing second effect. The high solid packing shows the coal particle size with the largest effect, and significant secondary contributions from the feed flow rate and fluidizing gas flow rate. Finally, the fits to the five-dimensional Gaussian Process models were 0.7797, 0.8664, and 0.9440 for the temperature, velocity, and solids packing respectively.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Spatial and temporal prediction of radiation dose rates near Fukushima Daiichi Nuclear Power Plant

In this paper, we have developed a methodology to estimate the spatiotemporal distribution of radiation air dose rates around the Fukushima Daiichi Nuclear Power Plant (FDNPP). In our exploratory data analysis, we found that (1) the temporal evolution of dose rates is composed of a log-linear decay trend and fluctuations of air dose rates that are spatially correlated among adjacent monitoring posts; and (2) the slope of the log-linear environmental decay trend can be represented as a function of the apparent initial dose rates, coordinate position, land-use type, and soil type. From these observations, we first estimated the log-linear decay trend at each location based on these predictors, using the random forest method. We then developed a modified Kalman filter coupled with a Gaussian process model to estimate the dose-rate time series at a given location and time. We applied this method to the Fukushima evacuation zone (as of March 2017), which included 17 monitoring post locations (with monitoring datasets collected between 2014 and 2018) and generated a time series of dose-rate maps. Our results show that this approach allows us to produce accurate spatial and temporal predictions of radiation dose-rate maps using limited spatiotemporal measurements.

61 RADIATION PROTECTION AND DOSIMETRY↗

Adaptive Learning for Reliability Analysis using Support Vector Machines

A novel algorithm is presented for adaptive learning of an unknown function that separates two regions of a domain.In the context of reliability analysis these two regions represent the failure domain, where a set of constraints or requirements are violated, and a safe domain where they are satisfied. The Limit State Function (LSF) separates these two regions. Evaluating the constraints for a given parameter point requires the evaluation of a computational model that may well be expensive. For this reason we wish to construct a meta-model that can estimate the LSFas accurately as possible, using only a limited amount of training data. This work presents an adaptive strategy employing a Support Vector Machine (SVM) as a meta-model to provide a semi-algebraic approximation of the LSF.We describe an optimization process that is used to select informative parameter points to add to training data at each iteration to improve the accuracy of this approximation. A formulation is introduced for bounding the predictions of the meta-model; in this way we seek to incorporate this aspect of Gaussian Process Models (GPMs) within anSVM meta-model. Finally, we apply our algorithm to two benchmark test cases, demonstrating performance that is comparable with, if not superior, to a standard technique for reliability analysis that employs GPMs

Adaptive learning↗

Fast Characterization of Inducible Regions of Atrial Fibrillation Models With Multi-Fidelity Gaussian Process Classification

Computational models of atrial fibrillation have successfully been used to predict optimal ablation sites. A critical step to assess the effect of an ablation pattern is to pace the model from different, potentially random, locations to determine whether arrhythmias can be induced in the atria. In this work, we propose to use multi-fidelity Gaussian process classification on Riemannian manifolds to efficiently determine the regions in the atria where arrhythmias are inducible. We build a probabilistic classifier that operates directly on the atrial surface. We take advantage of lower resolution models to explore the atrial surface and combine seamlessly with high-resolution models to identify regions of inducibility. We test our methodology in 9 different cases, with different levels of fibrosis and ablation treatments, totalling 1,800 high resolution and 900 low resolution simulations of atrial fibrillation. When trained with 40 samples, our multi-fidelity classifier that combines low and high resolution models, shows a balanced accuracy that is, on average, 5.7% higher than a nearest neighbor classifier. We hope that this new technique will allow faster and more precise clinical applications of computational models for atrial fibrillation. All data and code accompanying this manuscript will be made publicly available at: https://github.com/fsahli/AtrialMFclass.

59 BASIC BIOLOGICAL SCIENCES↗

Discovering the Unknowns: A First Step

This article aims at discovering the unknown variables in the system through data analysis. The main idea is to use the time of data collection as a surrogate variable and try to identify the unknown variables by modeling gradual and sudden changes in the data. We use Gaussian process modeling and a sparse representation of the sudden changes to efficiently estimate the large number of parameters in the proposed statistical model. The method is tested on a realistic dataset generated using a one-dimensional implementation of a Magnetized Liner Inertial Fusion (MagLIF) simulation model, and encouraging results are obtained.

42 ENGINEERING↗

Scalable statistical inference of photometric redshift via data subsampling

Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for bigger problems. But full probabilistic statistical models often outperform other models in quantifying uncertainties associated with model predictions. We develop a data-driven statistical modeling framework that combines the uncertainties from an ensemble of statistical models learned on smaller subsets of data carefully chosen to account for imbalances in the input space. We demonstrate this method on a photometric redshift estimation problem in cosmology, which seeks to infer a distribution of the redshift—the stretching effect in observing the light of far-away galaxies—given multivariate color information observed for an object in the sky. Our proposed method performs balanced partitioning, graph-based data subsampling across the partitions, and training of an ensemble of Gaussian process models.

data subsampling↗

Leveraging prior mean models for faster Bayesian optimization of particle accelerators

Tuning particle accelerators is a challenging and time-consuming task that can be automated and carried out efficiently using suitable optimization algorithms, such as model-based Bayesian optimization techniques. One of the major advantages of Bayesian algorithms is the ability to incorporate prior information about beam physics and historical behavior into the model used to make control decisions. In this work, we examine incorporating prior accelerator physics information into Bayesian optimization algorithms by utilizing fast executing, neural network models trained on simulated or historical datasets as prior mean functions in Gaussian process models. We show that in ideal cases, this technique substantially increases convergence speed to optimal solutions in high-dimensional tuning parameter spaces. Additionally, we demonstrate that even in non-ideal cases, where prior models of beam dynamics do not exactly match experimental conditions, the use of this technique can still enhance convergence speed. Finally, we demonstrate how these methods can be used to improve optimization in practical applications, such as transferring information gained from beam dynamics simulations to online control of the LCLS injector, and transferring knowledge gained from experimental measurements across different operating modes, such as accelerating different ion species at the ATLAS heavy ion accelerator.

43 PARTICLE ACCELERATORS↗

Accelerating Scientific Simulations with Bi-Fidelity Weighted Transfer Learning

High-fidelity modeling is an essential design tool for many engineering applications. However, for complex systems, computational cost can be a limiting factor. Analyzing parameter sensitivity, uncertainty quantification, and design optimization require many model evaluations. Surrogate models are often used to develop the relationship between model parameters and quantities of interest. However, in the case of complex systems, surrogate models require several degrees of freedom and, thus, a large number of data points to determine the correct dependencies. For many applications, this may be prohibitively expensive. The reduction of computational requirements can be achieved by leveraging low-fidelity models. Low-fidelity models represent the system at a coarser resolution with the advantage of computational efficiency. Therefore, a bi-fidelity modeling paradigm, which augments the accuracy of a low-fidelity model in a computationally efficient manner by invoking limited runs of a high-fidelity model, can be leveraged to sufficiently balance the accuracy and computational requirements. In this work, a bi-fidelity weighted transfer learning method using neural networks was applied to a computational fluid dynamics heat transfer modeling problem. The transfer learning advantage was investigated as a function of hyperparameters. Our main finding is that the use of a bi-fidelity modeling paradigm achieves accuracy close to that of a high-fidelity Gaussian process model while significantly reducing computational cost. The bi-fidelity model achieves comparable performance with 90 high-fidelity samples-that is, 60% less than the samples needed to achieve similar accuracy without the use of bi-fidelity modeling,

Borowiec, Katarzyna↗

Active learning of a crystal plasticity flow rule from discrete dislocation dynamics simulations

Continuum-scale material deformation models, such as crystal plasticity (CP), can significantly enhance their predictive accuracy by incorporating input from lower-scale (i.e. mesoscale) models. The procedure to generate and extract the relevant information is however typically complex and ad hoc, involving decision and intervention by domain experts, leading to long development times. In this study, we develop a principled approach for calibration of continuum-scale models using lower scale information by representing a CP flow rule as a Gaussian process model. This representation allows for efficient parameter space exploration, guided by the uncertainty embedded in the model through a process known as Bayesian optimization (BO). We demonstrate a semi-autonomous BO loop which instantiates discrete dislocation dynamics simulations whose initial conditions are automatically chosen to optimize the uncertainty of a model CP flow rule. Our self-guided computational pipeline efficiently generated a dataset and corresponding model whose error, uncertainty, and physical feature sensitivities were validated with comparison to an independent dataset four times larger, demonstrating a valuable and efficient active learning implementation readily transferable to similar material systems.

36 MATERIALS SCIENCE↗

Quantifying Uncertainties In Neutron-Alpha Scattering With Chiral Nucleon-Nucleon And Three-Nucleon Forces

We report that modern ab initio theory combined with high-quality nucleon-nucleon (NN) and three-nucleon (3N) interactions from chiral effective field theory (EFT) can provide a predictive description of low-energy light-nuclei reactions relevant for astrophysics and fusion-energy applications. However, the high cost of computations has so far impeded a complete analysis of the uncertainty budget of such calculations. Starting from NN potentials up to fifth order (N 4 LO) combined with leading-order 3N forces, we study how the order-by-order convergence of the chiral expansion and confidence intervals for the 3N contact and contact-plus-one-pion-exchange low-energy constants (c E and c D ) contribute to the overall uncertainty budget of many-body calculations of neutron- 4 He (n-α) elastic scattering. We compute structure and reaction observables for three-, four-, and five-nucleon systems within the ab initio frameworks of the no-core shell model and no-core shell model with continuum. Using a small set of design runs, we construct a Gaussian process model (GPM) that acts as a statistical emulator for the theory. With this, we gain insight into how uncertainties in the 3N low-energy constants propagate throughout the calculation and determine the Bayesian posterior distribution of these parameters with Markov-Chain Monte Carlo. We find rapidly converging n-α phase shifts with respect to the chiral order. With the adopted leading-order 3N force, calculations based on the NN interaction at N 4 LO of Entem, Machleidt, and Nosyk are unable to reproduce the experimental phase shifts in the 3/2 - channel within the estimated chiral truncation errors. Closer agreement with empirical data is found when using an older parametrization of the NN interaction at order N 3 LO, and the position and width of the P-wave resonances can be used to reduce the uncertainty of the 3N low-energy constants. The present results point to a lack of spin-orbit strength when the newer parametrization of the chiral NN force up to fifth order is combined with the leading-order 3N force. The inclusion of higher-order 3N-force terms may be required to recover the missing strength. GPMs can act as fast and accurate emulators of ab initio many-body calculations of low-energy scattering and reactions of light nuclei, opening the way to a robust quantification of theoretical uncertainties grounded in the description of the underlying chiral Hamiltonian.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Computationally Efficient Use of Derivatives in Emulation of Complex Computational Models

We will investigate the use of derivative information in complex computer model emulation when the correlation function is of the compactly supported Bohman class. To this end, a Gaussian process model similar to that used by Kaufman et al. (2011) is extended to a situation where first partial derivatives in each dimension are calculated at each input site (i.e. using gradients). A simulation study in the ten-dimensional case is conducted to assess the utility of the Bohman correlation function against strictly positive correlation functions when a high degree of sparsity is induced.

97 MATHEMATICS AND COMPUTING↗

CAMERA: A method for cost-aware, adaptive, multifidelity, efficient reliability analysis

Estimating probability of failure in aerospace systems is a critical requirement for flight certification and qualification. Failure probability estimation involves resolving tails of probability distributions, and Monte Carlo sampling methods are intractable when expensive high-fidelity simulations have to be queried. Here, we propose a method to use models of multiple fidelities that trade accuracy for computational efficiency. Specifically, we propose the use of multifidelity Gaussian process models to efficiently fuse models at multiple fidelity, thereby offering a cheap surrogate model that emulates the original model at all fidelities. Furthermore, we propose a novel sequential acquisition function based experiment design framework that can automatically select samples from appropriate fidelity models to make predictions about quantities of interest at the highest fidelity. We use our proposed approach in an importance sampling setting and demonstrate our method on the failure level set and probability estimation on synthetic test functions and two real-world applications, namely, the reliability analysis of a gas turbine engine blade using a finite element method and a transonic aerodynamic wing test case using Reynolds-averaged Navier-Stokes equations. We show that our method predicts the failure boundary and probability more accurately and at a fraction of the computational cost compared with using just a single expensive high-fidelity model. Finally, we show that our sequential approach is guaranteed to asymptotically converge to the true failure boundary with high probability.

97 MATHEMATICS AND COMPUTING↗

BOOTS: Bayesian Optimization for Optimal Test Selection

BOOTS is a package for optimal selection of candidate operating points in large-scale manufacturing applications. It is designed to optimally select operating points to maximize predicted values of product quality and resource efficiency according to a data-driven model. The package is based on the use of a multi-input multi-output (MIMO) Gaussian process model to describe the relationships between inputs (operating points) and outputs (product quality and resource efficiency). This package does not provide any site- or process-specific information.

Villez, Kris [Oak Ridge National Laboratory (ORNL)↗

Reexamining the proton-radius problem using constrained Gaussian processes

The “proton radius puzzle” refers to an 8-year-old problem that highlights major inconsistencies in the extraction of the charge radius of the proton from muonic Lamb-shift experiments as compared against experiments using elastic electron scattering. For the latter approach, the determination of the charge radius involves an extrapolation of the experimental form factor to zero momentum transfer. To estimate the proton radius, a novel and powerful nonparametric method based on a constrained Gaussian process is introduced. Furthermore, the constrained Gaussian process models the electric form factor as a function of the momentum transfer. Within a Bayesian paradigm, we develop a model flexible enough to fit the data without any parametric assumptions on the form factor. The Bayesian estimation is guided by imposing only two physical constraints on the form factor: (a) its value at zero momentum transfer (normalization) and (b) its overall shape, assumed to be a monotonically decreasing function of the momentum transfer. Variants of these assumptions are explored to assess their impact.By adopting both constraints and incorporating the whole range of experimental data available we extracted a charge radius of r p = 0.845 ± 0.001 fm, consistent with the muonic experiment. Nevertheless, we show that within our model the extracted radius depends on both the assumed constraints and the range of experimental data used to fit the Gaussian process. For example, if only low-momentum-transfer data are used, relaxing the normalization constraint provides a value compatible with the larger electronic value. We have presented a novel technique to estimate the proton radius from electron-scattering data based on a constrained Gaussian process. We demonstrated that the impact of imposing sensible physical constraints on the form factor is substantial. Also critical is the range of the experimental data used in the extrapolation. We are hopeful that as the technique gets refined, together with the anticipated new results from the PRad experiment, we will get closer to a resolution of the puzzle.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Optimizing Long-term Monitoring of Radiation Air Dose Rates - 19169

Radiation air dose rates near the Fukushima Daiichi Nuclear Power Plant (NPP) have been steadily decreasing over the past seven years since the accident in March 2011. After seven years, the radiation monitoring program is expected to transition from short-term emergency responses to long-term monitoring. The objectives of long-term monitoring are often different from early emergency responses, since extensive data accumulation has led to an understanding of contaminant distributions and mobility. The main long-term monitoring objectives are (1) to confirm system stability and the continuing reduction of contaminant and hazard levels, (2) to provide assurance for the public, (3) to accumulate the basic datasets for scientific knowledge and future preparation, and (4) to detect changes or anomalies in contaminant mobility (if they occur), or any unexpected processes or events. In this work, we have developed a methodology for optimizing the sampling locations of radiation air dose-rate monitoring. Three steps are taken in order to determine sampling locations in a systematic manner: (1) prioritizing the critical locations, such as schools or regulatory requirement locations, (2) diversifying locations across the key environmental controls that are known to influence contaminant mobility and distributions, and (3) capturing the heterogeneity of radiation air dose rates across the domain. In the second step, we use a Gaussian mixture model to identify the representative locations in multiple environmental variables, such as elevation and land-cover types. In the third step, we use a Gaussian process model to capture and estimate the heterogeneity of air dose rates across the domain. We use the integrated dose-rate map from the Bayesian geostatistical method as the reference map and distribute the sampling in such a way as to capture the heterogeneity of the reference map. Although we assume hypothetical sets of measurement locations to evaluate the performance of the methodology and algorithms, we have demonstrated this approach using real, spatially extensive datasets, including the integrated air-dose-rate map of 2016. Our results have shown that this approach allows us to add sampling locations in a systematic manner. Increasing the number of sampling locations can better capture the heterogeneity of dose rates, although the estimation error does not decrease further after a certain number of samples. We have also found that when there are restrictions such as pre-existing monitoring locations or the ones along roads, the spatial estimation becomes poor even with the same number of monitoring locations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Efficient calibration for imperfect computer models

Many computer models contain unknown parameters which need to be estimated using physical observations. Furthermore, the calibration method based on Gaussian process models may lead to unreasonable estimate for imperfect computer models. In this work, we extend their study to calibration problems with stochastic physical data. We propose a novel method, called the L 2 calibration, and show its semiparametric efficiency. The conventional method of the ordinary least squares is also studied. Theoretical analysis shows that it is consistent but not efficient. Here, numerical examples show that the proposed method outperforms the existing ones.

97 MATHEMATICS AND COMPUTING↗

Optimizing long-term monitoring of radiation air-dose rates after the Fukushima Daiichi Nuclear Power Plant

Radiation air dose rates near the Fukushima Daiichi Nuclear Power Plant (FDNPP) have been steadily decreasing over the past eight years since the release of radioactive elements in March 2011. Currently, the radiation monitoring program is expected to transition to long-term monitoring after most of the remediation activities are completed. The main long-term monitoring objectives are to (1) confirm the continuing reduction of contaminant and hazard levels, (2) provide assurance for the public, (3) accumulate the basic datasets for scientific knowledge and future preparation, and (4) detect changes or anomalies in contaminant mobility (if they occur), or any unexpected processes or events. In this work, we have developed a methodology for optimizing the monitoring locations of radiation air dose-rate monitoring. Our approach consists of three steps in order to determine monitoring locations in a systematic manner: (1) prioritizing the critical locations, such as schools or regulatory requirement locations, (2) diversifying locations that cover the key environmental controls that are known to influence contaminant mobility and distributions, and (3) capturing the heterogeneity of radiation air-dose rates across the domain. Therefore, for the second step, we use a Gaussian mixture model to identify the representative locations among multiple environmental variables, such as elevation and land-cover types. For the third step, we use a Gaussian process model to capture and estimate the heterogeneity of air-dose rates across the domain. Employing an integrated dose-rate map derived from Bayesian geostatistical methods as a reference map, we distribute the monitoring locations in such a way as to capture the heterogeneity of the reference map. Our results have shown that this approach allows us to select monitoring locations in a systematic manner such that the heterogeneity of air dose rates is captured by the minimal number of monitoring locations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Global Sensitivity Analysis for Statistical Model Parameters

Global sensitivity analysis (GSA) is typically used to analyze the influence of uncertain parameters in mathematical models and simulations. In principle, tools from GSA may be extended to analyze the influence of parameters in statistical models. Such analyses may enable reduced or parsimonious modeling and greater predictive capability. Yet, difficulties such as parameter correlation, model stochasticity, multivariate model output, and unknown parameter distributions prohibit a direct application of GSA tools to statistical models. By leveraging a loss function associated with the statistical model, we introduce a novel framework to address these difficulties and enable efficient GSA for statistical model parameters. Theoretical and computational properties are considered and hihglighted on a synthetic example. The framework is applied to a Gaussian process model from the literature, which depends on 95 parameters. Noninfluential parameters are discovered through GSA, and a reduced model with equal or stronger predictive capability is constructed by using only 79 parameters.

97 MATHEMATICS AND COMPUTING↗