SEARCH · Search NASA

Results for “Bayesian inverse”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

284 records · Page 16

All sources NASA NTRS DOE OSTI

NASA NTRS2021

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. The combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

Robert S. Schrom↗

DOE OSTI2022

Calorimeter with Bayesian unfolding of spectra of high-flux broadband x rays

We report the development of a multipurpose differential x-ray calorimeter with a broad energy bandwidth. The absorber architecture is combined with a Bayesian unfolding algorithm to unfold high energy x-ray spectra generated in high-intensity laser–matter interactions. Particularly, we show how to extract absolute energy spectra and how our unfolding algorithm can reconstruct features not included in the initial guess. The performance of the calorimeter is evaluated via Monte Carlo generated data. The method accuracy to reconstruct electron temperatures from bremsstrahlung is shown to be 5% for electron temperatures from 1 to 50 MeV. We study bremsstrahlung generated in solid target interaction showing an electron temperature of 0.56 ± 0.04 MeV for a 700 μm Ti titanium target and 0.53 ± 0.03 MeV for a 50 μm target. We investigate bremsstrahlung from a target irradiated by laser-wakefield accelerated electrons showing an endpoint energy of 551 ± 5 MeV, inverse Compton generated x rays with a peak energy of 1.1 MeV, and calibrated radioactive sources. The total energy range covered by all these sources ranges from 10 keV to 551 MeV.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Cosmic Inference: Constraining Parameters with Observations and a Highly Limited Number of Simulations

We look at cosmological probes that pose an inverse problem where the measurement result is obtained through observations, and the objective is to infer values of model parameters that characterize the underlying physical system-our universe, from these observations and theoretical forward-modeling. The only way to accurately forward-model physical behavior on small scales is via expensive numerical simulations, which are further “emulated” due to their high cost. Emulators are commonly built with a set of simulations covering the parameter space with Latin hypercube sampling and an interpolation procedure; the aim is to establish an approximately constant prediction error across the hypercube. In this paper, we provide a description of a novel statistical framework for obtaining accurate parameter constraints. The proposed framework uses multi-output Gaussian process emulators that are adaptively constructed using Bayesian optimization methods with the goal of maintaining a low emulation error in the region of the hypercube preferred by the observational data. In this paper, we compare several approaches for constructing multi-output emulators that enable us to take possible inter-output correlations into account while maintaining the efficiency needed for inference. Using a Lyα forest flux power spectrum, we demonstrate that our adaptive approach requires considerably fewer-by a factor of a few in the Lyα P(k) case considered here-simulations compared to the emulation based on Latin hypercube sampling, and that the method is more robust in reconstructing parameters and their Bayesian credible intervals.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

PyAlbany: A Python interface to the C++ multiphysics solver Albany

Albany is a parallel C++ finite element library for solving forward and inverse problems involving partial differential equations (PDEs). In this paper we introduce PyAlbany, a newly developed Python interface to the Albany library. PyAlbany can be used to effectively drive Albany enabling fast and easy analysis and post-processing of applications based on PDEs that are pre-implemented in Albany. PyAlbany relies on the library PyBind11 to bind Python with C++ Albany code. Here we detail the implementation of PyAlbany and showcase its capabilities through a number of examples targeting a heat-diffusion problem. In particular we consider the following: (1) the generation of samples for a Monte Carlo application, (2) a scalability study, (3) a study of parameters on the performance of a linear solver, and finally (4) a tool for performing eigenvalue decompositions of matrix-free operators for a Bayesian inference application.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Statistical Uncertainty in Paleoclimate Proxy Reconstructions

A quantitative analysis of any environment older than the instrumental record relies on proxies. Uncertainties associated with proxy reconstructions are often underestimated, which can lead to artificial conflict between different proxies, and between data and models. In this paper, using ordinary least squares linear regression as a common example, we describe a simple, robust and generalizable method for quantifying uncertainty in proxy reconstructions. We highlight the primary controls on the magnitude of uncertainty, and compare this simple estimate to equivalent estimates from Bayesian, nonparametric and fiducial statistical frameworks. We discuss when it may be possible to reduce uncertainties, and conclude that the unexplained variance in the calibration must always feature in the uncertainty in the reconstruction. This directs future research toward explaining as much of the variance in the calibration data as possible. We also advocate for a “data-forward” approach, that clearly decouples the presentation of proxy data from plausible environmental inferences.

58 GEOSCIENCES↗

DOE OSTI2023

Summary report of the 4th IAEA Technical Meeting on Fusion Data Processing, Validation and Analysis (FDPVA)

The objective of the Fourth Technical Meeting on Fusion Data Processing, Validation and Analysis was to provide a platform during which a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolating needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics and synthetic diagnostics data analysis (including image processing, regression analysis, inverse problems, deep learning, machine learning, big data and physics-based models for control) reported at the meeting. The progress in these areas highlight trends observed in current major fusion confinement devices. A special focus is dedicated on data analysis requirements for ITER and DEMO with a particular attention paid to artificial intelligence for automatization and improving reliability of control processes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Search for very-short-baseline oscillations of reactor antineutrinos with the SoLid detector

In this paper we report the first scientific result based on antineutrinos emitted from the BR2 reactor at SCK CEN. The SoLid experiment uses a novel type of highly granular detector whose basic detection unit combines two scintillators, polyvinyl toluene (PVT) and Li 6 F : ZnS ( Ag ) , to measure antineutrinos via their inverse- β -decay products. An advantage of PVT is its highly linear response as a function of deposited particle energy. The full-scale detector comprises 12 800 voxels and operates over a very short 6.3–8.9 m baseline from the reactor core. The detector segmentation and its three-dimensional imaging capabilities facilitate the extraction of the positron energy from the rest of the visible energy, allowing the latter to be utilized for signal-background discrimination. We present a result obtained from 280 reactor-on days (55 MW mean power) and 172 reactor-off days, respectively, of live data taking. A total of 29 479 ± 603 (stat) antineutrino candidates have been selected, corresponding to an average rate of 105 events per day and a signal-to-background ratio of 0.27. A search for disappearance of antineutrinos to a sterile state has been conducted using complementary model-dependent frequentist and Bayesian fits, providing constraints on the allowed region of the reactor antineutrino anomaly.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2002

Chemical Compositions and Abundance Anomalies in Stellar Coronae ADP99

We have been investigating different statistical methods for analysing the metal abundances of sources with low S/N. A Bayesian technique has been developed that determines the most probable line-to-continuum ratio in the source, thereby leading to the metallicity. This method is a promising approach with which to mine the ASCA archive. Some of this work has now been published in conference proceedings. The flavour of the project has changed very slightly in the last year owing to the increasing availability of several good quality Chandra HETG and LETG spectra for stars for which we had reduced and analysed ASCA data. The Chandra grating spectra in principle provide a means of calibrating the results from the low resolution ASCA spectra and we have started some work toward that goal. One paper concerning abundance ratios in active stars is appearing shortly in conference proceedings and is being readied for publication in a main-stream astrophysical journal. This paper demonstrates for the first time that abundance anomalies cannot be categorized simply in terms of First Ionization Potential (FIP) or inverse-FIP based effects. Different Ne enhancements are found in different star types but a link between enhancement factors and stellar properties is not obvious. The publication noted as in preparation in an earlier report, finding strong Ne enhancements in active stars, is now published. These results will again be used to "calibrate" low resolution results for which line ratio techniques cannot be employed.

Drake, Jeremy↗

DOE OSTI2020

sMF-BO-2CoGP: A sequential multi-fidelity constrained Bayesian optimization framework for design applications

Bayesian optimization (BO) is an effective surrogate-based method that has been widely used to optimize simulation-based applications. While the traditional Bayesian optimization approach only applies to single-fidelity models, many realistic applications provide multiple levels of fidelity with various levels of computational complexity and predictive capability. In this work, we propose a multi-fidelity Bayesian optimization method for design applications with both known and unknown constraints. The proposed framework, called sMF-BO-2CoGP, is built on a multi-level CoKriging method to predict the objective function. An external binary classifier, which we approximate using a separate CoKriging model, is used to distinguish between feasible and infeasible regions. Finally, the sMF-BO-2CoGP method is demonstrated using a series of analytical examples and a flip-chip application for design optimization to minimize the deformation due to warping under thermal loading conditions.

42 ENGINEERING↗

NASA NTRS2005

What Does Reflection from Cloud Sides Tell Us About Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from Cloudsat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimensional (3D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 micrometers) and one with liquid water efficient absorption of solar radiation (2.1 micrometers). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, Alexander↗

DOE OSTI2020

An active learning high-throughput microstructure calibration framework for solving inverse structure–process problems in materials informatics

Determining a process–structure–property relationship is the holy grail of materials science, where both computational prediction in the forward direction and materials design in the inverse direction are essential. Problems in materials design are often considered in the context of process–property linkage by bypassing the materials structure, or in the context of structure–property linkage as in microstructure-sensitive design problems. However, there is a lack of research effort in studying materials design problems in the context of process–structure linkage, which has a great implication in reverse engineering. In this paper, given a target microstructure, we propose an active learning high-throughput microstructure calibration framework to derive a set of processing parameters, which can produce an optimal microstructure that is statistically equivalent to the target microstructure. The proposed framework is formulated as a noisy multi-objective optimization problem, where each objective function measures a deterministic or statistical difference of the same microstructure descriptor between a candidate microstructure and a target microstructure. Furthermore, to significantly reduce the physical waiting wall-time, we enable the high-throughput feature of the microstructure calibration framework by adopting an asynchronously parallel Bayesian optimization to exploit high-performance computing resources. Case studies in additive manufacturing and grain growth are used to demonstrate the applicability of the proposed framework, where kinetic Monte Carlo (kMC) simulation is used as a forward predictive model, such that for a given target microstructure, the target processing parameters that produced this microstructure are successfully recovered.

36 MATERIALS SCIENCE↗

NASA NTRS2006

What does Reflection from Cloud Sides tell us about Vertical Distribution of Cloud Droplet Sizes?

Cloud development, the onset of precipitation and the effect of aerosol on clouds depend on the structure of the cloud profiles of droplet size and phase. Aircraft measurements of cloud profiles are limited in their temporal and spatial extent. Satellites were used to observe cloud tops not cloud profiles with vertical profiles of precipitation-sized droplets anticipated from CloudSat. The recently proposed CLAIM-3D satellite mission (cloud aerosol interaction mission in 3-D) suggests to measure profiles of cloud microphysical properties by retrieving them from the solar and infrared radiation reflected or emitted from cloud sides. Inversion of measurements from the cloud sides requires rigorous understanding of the 3-dimentional(3-D) properties of clouds. Here we discuss the reflected sunlight from the cloud sides and top at two wavelengths: one nonabsorbing to solar radiation (0.67 microns) and one with liquid water efficient absorption of solar radiation (2.1 microns). In contrast to the plane-parallel approximation, a conventional approach to all current operational retrievals, 3-D radiative transfer is used for interpreting the observed reflectances. General properties of the radiation reflected from the sides of an isolated cloud are discussed. As a proof of concept, the paper shows a few examples of radiation reflected from cloud fields generated by a simple stochastic cloud model with the prescribed vertically resolved microphysics. To retrieve the information about droplet sizes, we propose to use the probability density function of the droplet size distribution and its first two moments instead of the assumption about fixed values of the droplet effective radius. The retrieval algorithm is based on the Bayesian theorem that combines prior information about cloud structure and microphysics with radiative transfer calculations.

Marshak, A.↗

DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗