Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian Process Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Cholesky-based experimental design for Gaussian process and kernel-based emulation and calibration.

Gaussian processes and other kernel-based methods are used extensively to construct approximations of multivariate data sets. The accuracy of these approximations is dependent on the data used. This paper presents a computationally efficient algorithm to greedily select training samples that minimize the weighted L p error of kernel-based approximations for a given number of data. The method successively generates nested samples, with the goal of minimizing the error in high probability regions of densities specified by users. The algorithm presented is extremely simple and can be implemented using existing pivoted Cholesky factorization methods. Training samples are generated in batches which allows training data to be evaluated (labeled) in parallel. For smooth kernels, the algorithm performs comparably with the greedy integrated variance design but has significantly lower complexity. Numerical experiments demonstrate the efficacy of the approach for bounded, unbounded, multi-modal and non-tensor product densities. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data using Bayesian inference.

97 MATHEMATICS AND COMPUTING↗

Limitations of the clump-correlation theories of shear-induced turbulence suppression

The clump theory, primarily constructed by Dupree [Phys. Fluids 15, 334 (1972)] based on the moment approach and then generalized to the correlation theory [Y. Z. Zhang and S. M. Mahajan, Phys. Fluids B 5, 2000 (1993)], has long served as a basis for constructing theories of turbulence suppression by shear flow. In order to reveal the “intrinsic approximation” invoked in the clump-correlation theory, we examine a model based on two dimensional magnetized drift waves. After a rigorous derivation of the exact response function—a key to average the Green function of the system—we show that the Dupree, Zhang-Mahajan approach is recovered as the lowest order approximation in a small dimensionless parameter $Υ$ which is a triple product of the correlation time, wave number, and fluctuating drift velocity. The clump-correlation theory, thus, constitutes the Gaussian and lowest order non-Markovian process for a homogeneous stationary turbulence. Lastly we also provide, especially for the tokamak community, a readily usable formula to evaluate the effectiveness of shear-flow suppression; this formula pertains regardless of the specific model of correlation time.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Oxide-cladding aluminum nitride photonic crystal slab: Design and investigation of material dispersion and fabrication induced disorder

Photonic crystal slabs with a lower-index material surrounding the core layer are an attractive choice to circumvent the drawbacks in the fabrication of membranes suspended in air. In this work we propose a photonic crystal (PhC) slab structure composed of a triangular pattern of air holes in a multilayer thin film of aluminum nitride embedded in silicon dioxide layers designed for operating around 450 nm wavelengths. We show the design of an ideal structure and analyze the effects of material dispersion based on a first-order correction perturbation theory approach using dielectric functions obtained by experimental measurements of the thin film materials. Numerical methods were used to investigate the effects of fabrication induced disorder of typical nanofabrication processes on the bandgap size and spectral response of the proposed device. Deviation in holes radii and positions were introduced in the proposed PhC slab model with a Gaussian distribution profile. Impacts of slope in holes sidewalls that might result from the dry etching of AlN were also evaluated. The results show that for operation at the midgap frequency, slope in holes sidewalls is more critical than displacements in holes sizes and positions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Machine learning with bond information for local structure optimizations in surface science

Local optimization of adsorption systems inherently involves different scales: within the substrate, within the molecule, and between the molecule and the substrate. In this work, we show how the explicit modeling of different characteristics of the bonds in these systems improves the performance of machine learning methods for optimization. Furthermore, we introduce an anisotropic kernel in the Gaussian process regression framework that guides the search for the local minimum, and we show its overall good performance across different types of atomic systems. The method shows a speed-up of up to a factor of two compared with the fastest standard optimization methods on adsorption systems. Additionally, we show that a limited memory approach is not only beneficial in terms of overall computational resources but can also result in a further reduction of energy and force calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Discussion of “Bayesian design of experiments for industrial and scientific applications via gaussian processes”

First, we would like to commend Dr. Woods on his thought-provoking paper and insightful presentation at the 4th Annual Stu Hunter conference. We think that the material presented highlights some important needs in the area of design of experiments for generalized linear models (GLMs). In addition, we agree with Dr. Woods that design of experiements of GLMs does implicitly require expert judgement about model parameters, and hence using a Bayesian approach to capture this knowledge is a natural strategy to summarize what is known with the opportunity to incorporate associated uncertainty about that information.

97 MATHEMATICS AND COMPUTING↗

Analysis of dynamic system response to product random processes

The response of dynamic systems to the product of two independent Gaussian random processes is developed by use of the Fokker-Planck and associated moment equations. The development is applied to the amplitude modulated process which is used to model atmospheric turbulence in aeronautical applications. The exact solution for the system response is compared with the solution obtained by the quasi-steady approximation which omits the dynamic properties of the random amplitude modulation. The quasi-steady approximation is valid as a limiting case of the exact solution for the dynamic response of linear systems to amplitude modulated processes. In the nonlimiting case the quasi-steady approximation can be invalid for dynamic systems with low damping.

Sidwell, K.↗

Special Issue: Geostatistics and Machine Learning

Abstract Recent years have seen a steady growth in the number of papers that apply machine learning methods to problems in the earth sciences. Although they have different origins, machine learning and geostatistics share concepts and methods. For example, the kriging formalism can be cast in the machine learning framework of Gaussian process regression. Machine learning, with its focus on algorithms and ability to seek, identify, and exploit hidden structures in big data sets, is providing new tools for exploration and prediction in the earth sciences. Geostatistics, on the other hand, offers interpretable models of spatial (and spatiotemporal) dependence. This special issue on Geostatistics and Machine Learning aims to investigate applications of machine learning methods as well as hybrid approaches combining machine learning and geostatistics which advance our understanding and predictive ability of spatial processes.

58 GEOSCIENCES↗

Asymmetry in serial femtosecond crystallography data

Serial crystallography is an increasingly important approach to protein crystallography that exploits both X-ray free-electron laser (XFEL) and synchrotron radiation. Serial crystallography recovers complete X-ray diffraction data by processing and merging diffraction images from thousands of randomly oriented non-uniform microcrystals, of which all observations are partial Bragg reflections. Random fluctuations in the XFEL pulse energy spectrum, variations in the size and shape of microcrystals, integrating over millions of weak partial observations and instabilities in the XFEL beam position lead to new types of experimental errors. The quality of Bragg intensity estimates deriving from serial crystallography is therefore contingent upon assumptions made while modeling these data. Here it is observed that serial femtosecond crystallography (SFX) Bragg reflections do not follow a unimodal Gaussian distribution and it is recommended that an idealized assumption of single Gaussian peak profiles be relaxed to incorporate apparent asymmetries when processing SFX data. The phenomenon is illustrated by re-analyzing data collected from microcrystals of the Blastochloris viridis photosynthetic reaction center and comparing these intensity observations with conventional synchrotron data. The results show that skewness in the SFX observations captures the essence of the Wilson plot and an empirical treatment is suggested that can help to separate the diffraction Bragg intensity from the background.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning in nuclear materials research

Nuclear materials are often demanded to function for extended time in extreme environments, including high radiation fluxes with associated transmutations, high temperature and temperature gradients, mechanical stresses, and corrosive coolants. They also have a wide range of microstructural and chemical makeups, resulting in multifaceted and often out-of-equilibrium interactions. Machine learning (ML) is increasingly being used to tackle these complex time-dependent interactions and aid researchers in developing models and making predictions, sometimes with better accuracy than traditional modeling that focuses on one or two parameters at a time. Conventional practices of acquiring new experimental data in nuclear materials research are often slow and expensive, limiting the opportunity for data-centric ML, but new methods are changing that paradigm. Here we review high-throughput computational and experimental data approaches, especially robotic experimentation and active learning that is based on Gaussian process and Bayesian optimization. We show ML examples in structural materials (e.g., reactor pressure vessel (RPV) alloys and radiation detecting scintillating materials) and highlight new techniques of high-throughput sample preparation and characterizations, and automated radiation/environmental exposures and real-time online diagnostics. Herein, this review suggests that ML models of material constitutive relations in plasticity, damage, and even electronic and optical responses to radiation are likely to become powerful tools as they develop. Finally, we speculate on how the recent trends of using natural language processing (NLP) to aid the collection and analysis of literature data, interpretable artificial intelligence (AI), and the use of streamlined scripting, database, workflow management, and cloud computing platforms that will soon make the utilization of ML techniques as commonplace as the spreadsheet curve-fitting practices of today.

36 MATERIALS SCIENCE↗

Random field optimization

Herein we present a new modeling paradigm for optimization that we call random field optimization. Random fields are a powerful modeling abstraction that aims to capture the behavior of random variables that live on infinite-dimensional spaces (e.g., space and time) such as stochastic processes (e.g., time series, Gaussian processes, and Markov processes), random matrices, and random spatial fields. This paradigm involves sophisticated mathematical objects (e.g., stochastic differential equations and space-time kernel functions) and has been widely used in neuroscience, geoscience, physics, civil engineering, and computer graphics. Despite of this, however, random fields have seen limited use in optimization; specifically, existing optimization paradigms that involve uncertainty (e.g., stochastic programming and robust optimization) mostly focus on the use of finite random variables. This trend is rapidly changing with the advent of statistical optimization (e.g., Bayesian optimization) and multi-scale optimization (e.g., integration of molecular sciences and process engineering). Our work extends a recently-proposed abstraction for infinite-dimensional optimization problems by capturing more general uncertainty representations. Moreover, we discuss solution paradigms for this new class of problems based on finite transformations and sampling, and identify open questions and challenges.

97 MATHEMATICS AND COMPUTING↗

Sparse modeling of space- and time-varying diffraction response of a progressively loaded aluminum alloy

Highlights: • Plasticity induces crystal orientation and lattice spacing heterogeneity. • High energy x-ray diffraction spot broadening typically accompanies plasticity. • Method quantifies spot broadening in difficult, mixed microstructure data. • Algorithm finds sparse combination of entries from dictionary of peak functions. • Approach showed asymmetric plastic response in preprocessed AA7075 T651 sample. - Abstract: High energy X-ray diffraction data collected in situ during loading experiments permits probing of the crystal structure of a plastically deforming material sample. An elastoplastic deformation is associated with heterogeneity in both crystal orientation and lattice spacing—each manifesting as azimuthal broadening and radial broadening of diffraction peaks respectively. Quantifying the spreading effect is challenging, especially in cases where the sample has a granularity between that of a single crystal and fine grain or powder material. The approach developed in this paper begins by modeling the intensity signal in the vicinity of a Debye-Scherrer ring as a sparse, nonnegative superposition of Gaussian basis functions drawn from an over-complete dictionary. Processing automatically selects from the dictionary basis functions whose widths and amplitudes are representative of the data. The chosen basis functions are used to compute scalar measures of radial and azimuthal broadening for the set of diffraction peaks composing a Debye-Scherrer ring. To demonstrate the utility of the approach, we show that analysis of diffraction peak shape information from an aluminum alloy 7075 T651 (AA7075 T651) sample provides insight into the origin of material state that would have otherwise have been difficult if not impossible to extract using conventional methods. Furthermore, the extracted information revealed a deformation response linked to the processing history of the sample.

36 MATERIALS SCIENCE↗

Simplified model of statistically stationary spacecraft rotation and associated induced gravity environments

A stochastic model of spacecraft motion was developed based on the assumption that the net torque vector due to crew activity and rocket thruster firings is a statistically stationary Gaussian vector process. The process had zero ensemble mean value, and the components of the torque vector were mutually stochastically independent. The linearized rigid-body equations of motion were used to derive the autospectral density functions of the components of the spacecraft rotation vector. The cross-spectral density functions of the components of the rotation vector vanish for all frequencies so that the components of rotation were mutually stochastically independent. The autospectral and cross-spectral density functions of the induced gravity environment imparted to scientific apparatus rigidly attached to the spacecraft were calculated from the rotation rate spectral density functions via linearized inertial frame to body-fixed principal axis frame transformation formulae. The induced gravity process was a Gaussian one with zero mean value. Transformation formulae were used to rotate the principal axis body-fixed frame to which the rotation rate and induced gravity vector were referred to a body-fixed frame in which the components of the induced gravity vector were stochastically independent. Rice's theory of exceedances was used to calculate expected exceedance rates of the components of the rotation and induced gravity vector processes.

Fichtl, G. H.↗

Statistics of Cirrus Horizontal Inhomogeneity in the Southern Great Plains

Variability of cloud properties on scales smaller than that of a GCM grid is potentially important both for realistic parameterizations of microphysical processes and for the prediction of the large-scale radiative effects of clouds, have suggested that a simple model of marine stratocumulus variability, based on the assumption of Gaussian variation statistics of cloud depth, can explain the liquid water path histogram shapes observed in Landsat data. In advance of ARM SGP MMCR ice water path climatologies, we have examined aircraft ice water content statistics for cirrus clouds observed over Coffeyville, Kansas during FIRE 2. We find similar associations of histogram shape and cloud cover for these clouds, and we show that a simple modification of the model for cirrus combined with observed mean cloud depths, their standard deviations, and ambient thermodynamic conditions predicts both the histogram shape and cirrus cloud cover fairly well. This suggests that subgrid variability of cloud properties may be similar for vastly different cloud types, and that a universal parameterization of the effects of subgrid variability in GCMs as a function of only a few parameters may be a realistic goal.

Smith, S. A.↗

Radiation Transport in Random Media With Large Fluctuations

Strongly heterogeneous media arise in several applications that include radiation shields, nuclear fuel, BWR moderators, clouds, planetary and stellar atmospheres, turbulent gases and plasmas. Neutral and charged particle transport computations in such media have relied heavily on formulating transport equations with spatially random coefficients (physical data) and developing solution methods to deal with the additional stochastic dimensions. Attempts at developing approximate closures that yield only low order statistical information (e.g., mean and variance of the flux) have proved to be highly restrictive under real physics conditions or rely on techniques that require fluctuation amplitudes to be small for robustness. Recently, stochastic spectral methods such as polynomial chaos and stochastic collocation have been developed for aleatoric uncertainty quantification and sensitivity analysis, and successfully applied in radiation transport work. Advances in UQ techniques have tended to focus on efficiently handling large numbers of uncertain variables but the rigorous stochastic basis of the approach also promotes its use in situations where stochasticity is due to spatial heterogeneity and the associated uncertainty is large. Here we apply these techniques to radiation transport in media with spatially randomly varying cross sections without restriction on fluctuation amplitudes. Specifically, we represent the cross sections as a lognormal spatial random process with specified mean, variance and covariance function and use a Karhunen-Loeve (KL) decomposition to generate cross section realizations that are strictly positive. Woodcock Monte Carlo (WMC) is then used to simulate transport using random sampling of cross sections and deterministic sampling based on a stochastic collocation technique. Numerical results for the mean and variance in the scalar flux and leakage currents are obtained for weak and strong random variations. We focus in this work on demonstrating the approach and defer application to specific problems to a future investigation. We have demonstrated that a combination of stochastic spectral representation and Woodcock Monte Carlo simulation allows efficient computation of radiation transport in strongly random media. The use of a lognormal distribution to represent the fluctuations in medium properties facilitates enforcement of strict positivity of cross section realizations, a condition that has challenged standard approaches that assume Gaussian fluctuations. The fact that the lognormal random process is a memoryless nonlinear transformation of a Gaussian process further enables efficient and accurate reconstruction of the random cross section realizations using a Karhunen-Loeve representation of the cross section. Finally, the robustness of this model enables fluctuations of arbitrarily large amplitude to be studied, using both random sampling Monte Carlo and more efficient stochastic collocation techniques. The present work is being extended to allow reconstruction of probability density functions of output variables using polynomial chaos representation, and to accommodate general cross section covariance functions. Also, techniques are being explored to more judiciously select ceiling cross sections to enhance the efficiency of Woodcock Monte Carlo for transport in random media. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Reheating, multifield inflation and the fate of the primordial observables

We study the effects of perturbative reheating on the evolution of the curvature perturbation ζ, in two-field inflation models. We use numerical methods to explore the sensitivity of f{sub NL}, n{sub ζ} and r to the reheating process, and present simple qualitative arguments to explain our results. In general, if a large non-Gaussian signal exists at the start of reheating, it will remain non-zero at the end of reheating. Unless all isocurvature modes have completely decayed before the start of reheating, we find that the non-linearity parameter, f{sub NL}, can be sensitive to the reheating timescale, and that this dependence is most appreciable for 'runaway' inflationary potentials that only have a minimum in one direction. For potentials with a minimum in both directions, f{sub NL} can also be sensitive to reheating if a mild hierarchy exists between the decay rates of each field. Within the class of models studied, we find that the spectral index n{sub ζ}, is fairly insensitive to large changes in the field decay rates, indicating that n{sub ζ} is a more robust inflationary observable, unlike the non-linearity parameter f{sub NL}. Our results imply that the statistics of ζ, especially f{sub NL}, can only be reliably used to discriminate between models of two-field inflation if the physics of reheating are properly accounted for.

79 ASTRONOMY AND ASTROPHYSICS↗

Gaussian Process Regression for Aggregate Baseline Load Forecasting

Demand response (DR) is one of the most effective ways to maintain the reliability and improve the flexibility of power systems. Accurate forecasts of baseline loads are essential for DR programs. In the era of big data, machine learning-based approaches present a unique opportunity for baseline load forecasting. Thus, this paper presents a machine learning-based approach using a relatively less explored algorithm, Gaussian process regression (GPR), to forecast aggregate baseline loads. As such, a dataset was generated using a set of EnergyPlus simulations. Using the generated dataset, a GPR-based forecasting model was developed. In addition, support vector regression (SVR)-, artificial neural network (ANN)-, and averaging-based models were developed as baseline models for comparison. These models were compared in terms of accuracy, simplicity, and integrity. The prediction performance of the models showed that the GPR-based model is more accurate and reliable than the others. Such high performance shows the potential of the GPR in baseline load forecasting. GPR, therefore, can be used for DR applications.

Amasyali, Kadir↗

Translocation of a Polymer Chain across a Nanopore: A Brownian Dynamics Simulation Study

We carried out Brownian dynamics simulation studies of the translocation of single polymer chains across a nanosized pore under the driving of an applied field (chemical potential gradient). The translocation process can be either dominated by the entropic barrier resulted from restricted motion of flexible polymer chains or by applied forces (or chemical gradient across the wall), we focused on the latter case in our studies. Calculation of radius of gyrations at the two opposite sides of the wall shows that the polymer chains are not in equilibrium during the translocation process. Despite this fact, our results show that the one-dimensional diffusion and the nucleation model provide an excellent description of the dependence of average translocation time on the chemical potential gradients, the polymer chain length and the solvent viscosity. In good agreement with experimental results and theoretical predictions, the translocation time distribution of our simple model shows strong non-Gaussian characteristics. It is observed that even for this simple tubelike pore geometry, more than one peak of translocation time distribution can be generated for proper pore diameter and applied field strengths. Both repulsive Weeks-Chandler-Anderson and attractive Lennard-Jones polymer-nanopore interaction were studied, attraction facilitates the translocation process by shortening the total translocation time and dramatically improve the capturing of polymer chain. The width of the translocation time distribution was found to decrease with increasing temperature, increasing field strength, and decreasing pore diameter.

Tian, Pu↗