Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gaussian Processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Comparison of Sequential Designs of Computer Experiments in High Dimensions

We continue a long line of research in applying the design and analysis of computer experiments to the study of real world systems. The problem we consider is that of fitting a Gaussian process model for a computer model in applications where the simulation output is a function of a high dimensional input vector. Our computer experiments are designed sequentially as we learn about the model. We perform an empirical comparison of the effectiveness and efficiency of several statistical criteria that have been used in sequential experimental designs. The specific application that motivates this work comes from climatology.

97 MATHEMATICS AND COMPUTING↗

Bayesian calibration of the Community Land Model using surrogates

We present results from the Bayesian calibration of hydrological parameters of the Community Land Model (CLM), which is often used in climate simulations and Earth system models. A statistical inverse problem is formulated for three hydrological parameters, conditional on observations of latent heat surface fluxes over 48 months. Our calibration method uses polynomial and Gaussian process surrogates of the CLM, and solves the parameter estimation problem using a Markov chain Monte Carlo sampler. Posterior probability densities for the parameters are developed for two sites with different soil and vegetation covers. Our method also allows us to examine the structural error in CLM under two error models. We find that surrogate models can be created for CLM in most cases. The posterior distributions are more predictive than the default parameter values in CLM. Climatologically averaging the observations does not modify the parameters' distributions significantly. The structural error model reveals a correlation time-scale which can be used to identify the physical process that could be contributing to it. While the calibrated CLM has a higher predictive skill, the calibration is under-dispersive.

54 ENVIRONMENTAL SCIENCES↗

Towards 3rd generation organic tandem solar cells with 20% efficiency: Accelerated discovery and rational design of carbon-based photovoltaic materials through massive distributed volunteer computing

Clean, affordable, and renewable energy sources are urgently needed to satisfy the 10s of terawatts (TW) energy need of human beings. Solar cells are one promising choice to replace traditional energy sources. Our broad efforts have expanded the knowledge of possible donor materials for organic photovoltaics, while increasing access of our results to the world through the Clean Energy Project database (www.molecularspace.org). Machine learning techniques, including Gaussian Processes have been used to calibrate frontier molecular orbital energies, and OPV bulk properties (open-circuit voltage, percent conversion efficiencies, and short-circuit current). This grant allowed us to delve into the solid-state properties of OPVs (charge-carrier dynamics). One particular example allowed us to predict charge-carrier dynamics and make predictions about future hydrogen-bonded materials.

14 SOLAR ENERGY↗

Solution of the Generalized Linear Boltzmann Equation for Multidimensional Stochastic Media

The generalized linear Boltzmann equation is a recently developed framework based on non-classical transport theory for modeling the expected value of particle flux in an arbitrary stochastic medium. Provided with a non-classical cross-section for a given statistical description of a medium, any transport problem in that medium may be solved. Previous work has only considered one-dimensional media without finite boundary conditions and discrete binary mixtures of materials. In this work the solution approach for the GLBE in multidimensional media with finite boundaries is outlined. The discrete ordinates method with an implicit discretization of the pathlength variable is used to leverage sweeping methods for the transport operator. In addition, several convenient approximations for non-classical cross-sections are introduced. The solution approach is verified against random realizations of a Gaussian process medium in a square enclosure.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Harnessing the power of ab initio calculations, distributed computing and machine learning to efficiently locate extreme molecules for use in carbon-based solar cells (Final Technical Report)

The use of high-throughput virtual screening (HTVS) tools is a powerful tool to expedite the materials discovery of commercially relevant materials. In previous years, our group has developed a molecular discovery platform to generate libraries in order to obtain suitable candidates for different applications, starting from the Harvard Clean Energy Project. This platform is suitable to test in-silico on traditional supercomputing clusters and shared resources, for example, in the IBM World Community Grid. In this project, we used the molecular discovery platform to create and screen a library of candidates of organic photovoltaic (OPVs) molecules. Based on a set of candidates created with combinations of molecular moieties, we were able to filter, by conformation stability, the energy of electronic orbitals and approximated power conversion efficiencies (PCE). To improve the predictions of orbital energies calculated and the PCEs, we used Gaussian Process regression and two sets of molecules. These sets correspond to electronic structure calculations of a higher level of theory and experimental PCE values, respectively. Finally, we selected a subset of the best candidates (molecules with a PCE higher than 10%) to understand its absorbance properties with TD-DFT. This project has demonstrated the capabilities of our molecular discovery platform for HTVS. Finally, machine learning can help us to introduce more complex effects included in bulk conditions and computational intensive calculations on models.

14 SOLAR ENERGY↗

Probabalistic Modeling of Minibangs and Megabands (Final Report)

This project was original proposed as a fundamental advance in the treatment of probabilistic modeling as it applies to nuclear fission calculations of nuclear database inputs and produced particle distributions in heavy-ion collisions. However, funding decisions made within LLNL and the DOE Office of Science led to the project proceeding through three distinct stages. The first two, probabilistic calculations of the fission and jet energy loss relate follow directly from the proposed research. The fission task led to the development of a proof-of-principle Gaussian Process Emulator for time-dependent generator coordinate method (TDGCM) calculation for the fission of Pu-240. To study energy loss in heavy-ion collisions with a probabilistic model, we generated a training data set using the Pythia event generator superimposed on a heavy-ion background with a single quench-factor parameter. We then used kernel density estimation (KDE) to recover the distribution of quench-factors for a calibration data set. In the third stage, we proceeded to work through collaborations, collecting new data within the ATLAS experiment at the Large Hadron Collider (LHC), and further developing bayesian methodology within the Jet Energy-loss Tomography with a Statistically and Computationally Advanced Program Envelope (JETSCAPE) Collaboration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

We Know Where We Don't Know: 3D Bayesian CNNs for Credible Geometric Uncertainty

Deep learning has been successfully applied to the segmentation of 3D Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify untrustworthy predictions. Recent UQ architectures include Monte Carlo dropout networks (MCDNs), which approximate deep Gaussian processes, and Bayesian neural networks (BNNs), which learn the distribution of the weight space. BNNs are advantageous over MCDNs for UQ but are thought to be computationally infeasible in high dimension, and neither architecture has produced interpretable geometric uncertainty maps. We propose a novel 3D Bayesian convolutional neural network (BCNN), the first deep learning method which generates statistically credible geometric uncertainty maps and scales for application to 3D data. We present experimental results on CT scans of graphite electrodes and laser-welded metals and show that our BCNN outperforms an MCDN in recent uncertainty metrics. The geometric uncertainty maps generated by our BCNN capture distributions of sigmoid values that are interpretable as confidence intervals, critical for applications that rely on deep learning for high-consequence decisions.

97 MATHEMATICS AND COMPUTING↗

Optimization of Geometric Perturbations on a Rod Moving Through a High Explosive Target

After completing a study to ensure the simulation results were converged, several high resolution 3D Smoothed Particle Hydrodynamic (SPH) simulations of copper rods impacting a high explosive (LX14) target were performed. This was then formulated into an optimization problem: I wanted to find the optimum shape and location of a perturbation on the rod that would maximize its erosion after it left the target. The shape of the perturbation was modeled as a 2D Gaussian bump and parameterized by its location along the rod axis (z 0 ) and amplitude (A). The final mass of the coherent part of the rod as it leaves the target was used as a metric to represent the erosion of the rod, and the optimization was formulated to maximize this metric with respect to the aforementioned design variables. Due to the expensive nature of the high-fidelity 3D SPH simulations, a surrogate model needed to be chosen so that many function calls to the optimizer would be feasible. Thus, a strategic full factorial sampling plan was chosen to build a dataset, which consisted of 24 high-fidelity simulations. Two surrogate models, a third order polynomial regression model and a Gaussian Process Model, were analyzed using a 14%/86% test/train holdout technique. The root mean square and R2 score of the test set was used to determine the best model, and the third order polynomial regression model was chosen as the surrogate model. Finally, the Nelder-Mead Simplex and Basin-hopping optimization algorithms were implemented, and it was found that the two algorithms gave slightly different optimum values. Nelder-Mead gave an optimum point of [z* 0 ;A*] = [9:9;0:4] and Basin-Hopping gave an optimum value of x* = [z* 0 ;A*] = [9:2;0:1].

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Multitask Recommender Systems for Cancer Drug Response

The problem we are currently trying to address is that there are many types of cancer drugs and many types of cancers and there is not always experimental data for a specific cancer type and cancer drug interaction. While there is a large possible set of feasible drug and cancer combinations, testing each pair is not realistic due to the high monetary cost of cell-based assays. Thus, this leaves researchers with a difficult choice of what drugs they should test on specific cancer types. This issue is known as the cold-start problem. Our focus is on developing recommender systems capable of addressing the cold-start problem as it relates to interaction between cancer types and cancer drugs. One of the most effective ways to address the cold-start problem is through large data analysis, however due to the cost prohibitive nature of cancer research the largest available data set size is the Genomics of Drug Sensitivity in Cancer with 494,973 genomic associations. To achieve optimal model performance on the cold-start problem, it is advantageous to employ multitask algorithms that are capable of transferring information between cancer datasets. The aim of this report is to draw from adaptations and state of the art developments in both algorithms for recommender systems and multitask learning to model the interaction between cancer cell lines and cancer drugs. Cancer cell lines are defined by the US National Cancer Institute as "cancer cells that keep dividing and growing over time, under certain conditions in a laboratory". This paper will focus on evaluating the performance of Neural Collaborative Filtering and Gaussian Processes, as well as their multitask adaptations, on cancer datasets from CCLE, NCI60, GDSC and CTRP. These methods will be evaluated on model performance in regression prediction but also in interpretability.

60 APPLIED LIFE SCIENCES↗

Bayesian Model Calibration for Extrapolative Prediction via Gibbs Posteriors

The current standard Bayesian approach to model calibration, which assigns a Gaussian process prior to the discrepancy term, often suffers from issues of unidentifiability and computational complexity and instability. When the goal is to quantify uncertainty in physical parameters for extrapolative prediction, then there is no need to perform inference on the discrepancy term. With this in mind, we introduce Gibbs posteriors as an alternative Bayesian method for model calibration, which updates the prior with a loss function connecting the data to the parameter. The target of inference is the physical parameter value which minimizes the expected loss. We propose to tune the loss scale of the Gibbs posterior to maintain nominal frequentist coverage under assumptions of the form of model discrepancy, and present a bootstrap implementation for approximating coverage rates. Our approach is highly modular, allowing an analyst to easily encode a wide variety of such assumptions. Furthermore, we provide a principled method of combining posteriors calculated from data subsets. We apply our methods to data from an experiment measuring the material properties of tantalum.

36 MATERIALS SCIENCE↗

Comprehensive Margin Assessment of the ASME Section III, Division 5, Class A Primary Load Design Rules

This report provides a comprehensive margin assessment of the ASME Section III, Division 5, Subsection HB, Subpart B rules for the design of high temperature reactor components against load controlled stress limits. These rules, often called the Code primary load design rules, provide protection against creep rupture and plastic collapse under steady conditions. The method adopted here is to compare the deterministic ASME design life, according to the primary load design rules, against the expected, statistical service life of the component, considering creep rupture as the relevant failure mode. The report provides the design margin of the ASME rules in terms of the probability of premature failure -- the probability that the component fails in service before reaching the ASME design life. To complete this assessment, the report describes the development of a statistical creep life assessment procedure accounting for variations in the component loading, material creep rate, and the material rupture time. This includes a novel method for correlating creep rupture data using a Gaussian process accounting for heat-to-heat variation in the Larson-Miller time-temperature parameter. The report applies the complete margin assessment process to quantify the design margin inherent in the ASME primary load design rules as a function of temperature for relevant component geometries and materials. The overall conclusion is that the ASME rules are conservative, providing designs with very small probability of premature failure, but some optimization of the Code design rules is possible to provide a more uniform design margin.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Comprehensive Material Characterization and Simultaneous Model Calibration for Improved Computational Simulation Credibility

Computational simulation is increasingly relied upon for high-consequence engineering decisions, and a foundational element to solid mechanics simulations is a credible material model. Our ultimate vision is to interlace material characterization and model calibration in a real-time feedback loop, where the current model calibration results will drive the experiment to load regimes that add the most useful information to reduce parameter uncertainty. The current work investigated one key step to this Interlaced Characterization and Calibration (ICC) paradigm, using a finite load-path tree to incorporate history/path dependency of nonlinear material models into a network of surrogate models that replace computationally-expensive finite-element analyses. Our reference simulation was an elastoplastic material point subject to biaxial deformation with a Hill anisotropic yield criterion. Training data was generated using either a space-filling or adaptive sampling method, and surrogates were built using either Gaussian process or polynomial chaos expansion methods. Surrogate error was evaluated to be on the order of 10 ⁻5 and 10 ⁻3 percent for the space-filling and adaptive sampling training data, respectively. Direct Bayesian inference was performed with the surrogate network and with the reference material point simulator, and results agreed to within 3 significant figures for the mean parameter values, with a reduction in computational cost over 5 orders of magnitude. These results bought down risk regarding the surrogate network and facilitated a successful FY22-24 full LDRD proposal to research and develop the complete ICC paradigm.

36 MATERIALS SCIENCE↗

Optimization of artificial viscosity in production codes based on Gaussian Regression surrogate models

To accurately model flows with shock waves using staggered-grid Lagrangian hydrodynamics, artificial viscosity has to be introduced to convert kinetic energy into internal energy, thereby increasing the entropy across shocks. Determining the appropriate strength of the artificial viscosity is an art and strongly depends on the particular problem and experience of the researcher. The objective of this study is to pose the problem of finding the appropriate strength of artificial viscosity as an optimization problem and solve this problem using machine learning (ML) tools, specifically using surrogate models based on Gaussian Process regression and Bayesian analysis. We describe the optimization method and discuss various practical details of its implementation. The shock-containing problems for which we apply this method all have been implemented in the LANL code FLAG. First, we apply ML to find optimal values to isolated shock problems of different strengths. Second, we apply ML to optimize viscosity for a 1D propagating detonation problem based on Zel’dovich-von Neumann-Doring (ZND) detonation theory using a reactive burn model. We compare results for default (currently used values in FLAG) and optimized values of artificial viscosity for these problems demonstrating the potential for significant improvement in the accuracy of computations.

42 ENGINEERING↗

Inferring Water Content from Neutron Die-away Curves for Planetary Science Applications

Signatures of liquid water on planetary bodies may provide evidence for past, present, or future life elsewhere in the solar system. Multiple current and upcoming planetary science missions are prioritizing the search for water, using innovative technologies and creative algorithms. For this project, we explore the capabilities of an instrument similar to the Dragonfly spacecraft to map water content on the surface of Titan, the largest moon of Saturn. We simulate Dragonfly’s neutron observations for a variety of soil compositions and develop multiple techniques to extract water content from the resultant neutron data. Additionally, we supplement neutron observations with gamma spectroscopy in an attempt to further refine water content estimates. This work is part of a larger study to employ Gaussian process regression to estimate a map of water content along the surface of Titan. Using the estimated map, an algorithm based on prediction difference mapping is employed to optimally move multiple Dragonfly detectors around the surface of Titan, fully autonomously.

79 ASTRONOMY AND ASTROPHYSICS↗

An ICME Modeling Framework for Titanium/Tungsten-Carbide Metal Matrix Composites

This report describes a collaborative project to develop a validated, predictive model for the high temperature mechanical properties of a titanium-matrix, tungsten-carbide/cobalt-reinforced metal matrix composite. The modeling approach was to first develop a detailed, microstructural model linking the material structure and the interfacial debonding properties to the effective properties of the material. The project then completed a throughput simulation campaign to generate a large number of simulations for discrete microstructures and different debonding parameters. Finally, the project trained a fast, Gaussian process surrogate model against this simulation database to provide a quick model linking the material compositions, structure, and processing parameters to the resulting material properties. This model was validated against high temperature tensile test data on a few particular composite compositions. The tests validate the model predictions for ultimate tensile strength and uniform elongation/ductility, meaning the final surrogate model can now be used to tune the material composition and processing parameters to identify optimal composite compositions for particular applications.

36 MATERIALS SCIENCE↗

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗

ML based control systems for nuclear physics experiments

The Experimental Physics Software and Computing Infrastructure (EPSCI) group at Jefferson Lab is leading the use of machine learning (ML) to enhance control systems in nuclear physics experiments. Collaborating closely with domain experts and data scientists, we have developed an ML-based control system that uses a Gaussian process to dynamically adjust the high voltage of the GlueX Central Drift Chamber. This results in stable detector performance by adapting to environmental changes, thereby reducing the offline calibration effort. Furthermore, we are developing ML-driven systems for optimizing the polarization of photon beams and polarized cryotargets. These systems will maintain the optimal microwave frequency in cryogenic targets and make real-time adjustments to diamond radiators for polarized photon sources, tasks traditionally handled by human operators. By automating these functions, we aim to optimize the polarization, reduce downtime, and minimize human error. This talk will highlight the development of reliable ML-based control systems and the policies to ensure they are both effective and trustworthy.

Jeske, Torri↗

Addressing Experimental Challenges in Probing Dark Energy with Accuracy and Precision with the Rubin Observatory Legacy Survey of Space & Time (LSST)

With support from this award, the Stanford group under the leadership of PI Patricia Burchat focused on pixel-level algorithms that are key to the investigation of dark energy with the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). The work was carried out through strong engagement in the DOE-supported LSST Dark Energy Science Collaboration (DESC), for which the PI served as Deputy Spokesperson (07/2019 - 07/2021) and Technical Coordinator (07/2021 - 07/2023). Members of the Burchat group are Full DESC members and are among scientists who have been accepted to join the Rubin Observatory System Integration, Test, and Commissioning (SIT-Com) effort. The specific intellectual focus of the group was the optimization of gravitational lensing as a probe of the evolution of the distribution of dark matter in space and time to learn about the nature of dark energy. The Stanford group pursued an integrated research program to understand in detail, and then remediate or calibrate, systematic effects that could limit the sensitivity of the LSST to cosmic shear as a dark energy probe -- particularly those related to our understanding of the atmospheric point spread function (PSF), challenges associated with blended galaxy images, and impacts of residual camera artifacts. Key to this work was developing, enhancing, and validating the fidelity of simulations that play a key role in the development of our understanding of subtle systematic biases and then using these simulations to develop techniques to characterize and mitigate biases, and associated algorithms for implementation in the LSST or DESC science pipelines. The group’s work included contributions to the open-source GalSim simulation package, which is widely used in the community; simulations and studies of spatial correlations of atmospheric PSFs; studies of temporal correlations of the atmospheric PSF; impacts of chromatic PSFs on cosmic shear calibration; continued studies of anisotropic Gaussian process interpolation of PSF models across the focal plane; and measuring and mitigating impacts of residual camera artifacts on cosmic shear. A primary impact of this work is that it increases the scientific discovery potential of the DOE and NSF investments in the Rubin Observatory Legacy Survey of Space \& Time, by addressing challenges in interpreting astronomical images through more accurate descriptions of the blurring of images due to the atmosphere. Specifically, this work impacts our ability to understand the fundamental nature of dark energy.

Burchat, Patricia Rose↗