Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Optimal Pulse Processing, Pile-Up Decomposition, and Applications of Silicon Drift Detectors at LCLS

Silicon drift detectors (SDDs) revolutionized spectroscopy in fields as diverse as geology and dentistry. For a subset of experiments at ultrafast, X-ray free-electron lasers (FELs), SDDs can make substantial contributions. Often the unknown spectrum is interesting, carrying science data, or the background measurement is useful to identify unexpected signals. Many measurements involve only several discrete photon energies known a priori, allowing single-event decomposition of pile-up and spectroscopic photon counting. We designed a pulse function and demonstrated that the signal amplitude (i.e., proportional to the detected energy and obtained from fitting with the pulse function), rise time, and pulse height are interrelated, and at short peaking times, the pulse height and pulse area are not optimal estimators for detected energy; instead, the signal amplitude and rise time are obtained for each pulse by fitting, thus removing the need for pulse shaping. By avoiding pulse shaping, rise times of tens of nanoseconds resulted in reduced pulse pile-up and allowed decomposition of remaining pulse pile-up at photon separation times down to hundreds of nanoseconds while yielding time-of-arrival information with the precision of 10 ns. Waveform fitting yields simultaneously high energy resolution and high counting rates (two orders of magnitude higher than current digital pulse processors). At pulsed sources or high photon rates, photon pile-up still occurs. We showed that pile-up spectrum fitting is relatively simple and preferable to pile-up spectrum deconvolution. We then developed a photon pile-up statistical model for constant intensity sources, extended it to variable intensity sources (typical for FELs), and used it to fit a complex pileup spectrum. We subsequently developed a Bayesian pile-up decomposition method that allows decomposing pile-up of single events with up to six photons from six monochromatic lines with 99% accuracy. The usefulness of SDDs will continue into the X-ray FEL era of science. Their successors, the ePixS hybrid pixel detectors, already offer hundreds of pixels, each with a similar performance to an SDD, in a compact, robust and affordable package.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Autonomous organic synthesis for redox flow batteries via flexible batch Bayesian optimization

Traditional trial-and-error methods for materials discovery are inefficient to meet the urgent demands posed by the rapid progression of climate change. This urgency has driven the increasing interest in integrating robotics and machine learning into materials research to accelerate experimental learning. However, idealized decision-making frameworks to achieve maximum sampling efficiency are not always compatible with high-throughput experimental workflows inside a laboratory. For multi-step chemical processes, differences in hardware capacities can complicate the digital framework by introducing constraints on the maximum number of samples in each step of the experiment, hence causing varying batch sizes in variable selection within the same batch. Therefore, designing flexible sampling algorithms is necessary to accommodate the multi-step synthesis with practical constraints unique to each high-throughput workflow. In this work, we designed and employed three strategies on a high-throughput robotic platform to optimize the sulfonation reaction of redox-active molecules used in flow batteries. Our strategies adapt to the multi-step experimental workflow, where their formulation and heating steps are separate, causing varying batch size requirements. By strategically sampling using clustering and mixed-variable batch Bayesian optimization, we were able to iteratively identify optimal conditions that maximize the yields. Our work presents a flexible approach that allows tailoring the machine learning decision-making to suit the practical constraints in individual high-throughput experimental platforms, followed by performing resource-efficient yield optimization using available open-source Python libraries.

Tamura, Clara [Univ. of Washington, Seattle, WA (U↗

Extreme-Scale Bayesian Inference for Uncertainty Quantification of Complex Simulations

Uncertainty quantification (UQ)—that is, quantifying uncertainties in complex mathematical models and their large-scale computational implementations—is widely viewed as one of the outstanding challenges facing the field of CS&E over the coming decade. The EUREKA project set to address the most difficult class of UQ problems: those for which both the underlying PDE model as well as the uncertain parameters are of extreme scale. In the project we worked on these extreme-scale challenges in the following four areas: 1. Scalable parallel algorithms for sampling and characterizing the posterior distribution that exploit the structure of the underlying PDEs and parameter-to-observable map. These include structure-exploiting versions of the randomized maximum likelihood method, which aims to overcome the intractability of employing conventional MCMC methods for solving extreme-scale Bayesian inversion problems by appealing to and adapting ideas from large-scale PDE-constrained optimization, which have been very successful at exploring high-dimensional spaces. 2. Scalable parallel algorithms for construction of prior and likelihood functions based on learning methods and non-parametric density estimation. Constructing problem-specific priors remains a critical challenge in Bayesian inference, and more so in high dimensions. Another challenge is construction of likelihood functions that capture unmodeled couplings between observations and parameters. We will create parallel algorithms for non-parametric density estimation using high dimensional N-body methods and combine them with supervised learning techniques for the construction of priors and likelihood functions. 3. Bayesian inadequacy models, which augment physics models with stochastic models that represent their imperfections. The success of the Bayesian inference framework depends on the ability to represent the uncertainty due to imperfections of the mathematical model of the phenomena of interest. This is a central challenge in UQ, especially for large-scale models. We propose to develop the mathematical tools to address these challenges in the context of extreme-scale problems. 4. Parallel scalable algorithms for Bayesian optimal experimental design (OED). Bayesian inversion yields quantified uncertainties in the model parameters, which can be propagated forward through the model to yield uncertainty in outputs of interest. This opens the way for designing new experiments to reduce the uncertainties in the model parameters and model predictions. Such experimental design problems have been intractable for large-scale problems using conventional methods; we will create OED algorithms that exploit the structure of the PDE model and the parameter-to-output map to overcome these challenges. Parallel algorithms for these four problems were created, analyzed, prototyped, implemented, tuned, and scaled up for leading-edge supercomputers, including UT-Austin’s own 10 petaflops Stampede system, ANL’s Mira system, and ORNL’s Titan system. While our focus is on fundamental mathematical/computational methods and algorithms, we will assess our methods on model problems derived from several DOE mission applications, including multiscale mechanics and ice sheet dynamics.

97 MATHEMATICS AND COMPUTING↗

UQTk version 2.0 user manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 2.0 ffers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

UQTk Version 3.0.3 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.0.3 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sen- sitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

UQTk (V. 3.0) User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.0 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

UQTk User Manual (V.3.1.0)

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.0 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

UQTk Version 3.1.1 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.1 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

UQTk Version 3.0.4 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.0.4 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

UQTk Version 3.1.2 User Manual

The UQ Toolkit (UQTk) is a collection of libraries and tools for the quantification of uncertainty in numerical model predictions. Version 3.1.2 offers intrusive and non-intrusive methods for propagating input uncertainties through computational models, tools for sensitivity analysis, methods for sparse surrogate construction, and Bayesian inference tools for inferring parameters from experimental data. This manual discusses the download and installation process for UQTk, provides pointers to the UQ methods used in the toolkit, and describes some of the examples provided with the toolkit.

97 MATHEMATICS AND COMPUTING↗

Sparsifying priors for Bayesian uncertainty quantification in model discovery

We propose a probabilistic model discovery method for identifying ordinary differential equations governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, where models are expressed as sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy coefficients, we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities) and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov chain Monte Carlo, and we explore two sparsifying priors: the spike and slab prior, and the regularized horseshoe prior. UQ-SINDy is shown to discover accurate models in the presence of noise and with orders-of-magnitude less data than current model discovery methods, thus providing a transformative method for real-world applications which have limited data.

97 MATHEMATICS AND COMPUTING↗

Machine learning assisted bayesian inference of mix and hot-spot conditions in NIF implosions

Experiments on the National Ignition Facility (NIF) have provided clear evidence of ablator material mixing into the Hot-Spot, leading to degraded performance. However, inferring the amount of mix and Hot-Spot conditions from typical experimental observations (e.g. x-ray spectra and images) is highly challenging. Here, we have developed an analysis method that utilizes machine learning assisted Bayesian inference to find the probability distributions of the Hot-Spot and mix conditions. This approach uses a neural network, trained on an idealized 2-dimensional representation of the Hot-Spot and mix distribution, and Bayesian inference to find the statistical distributions of Hot-Spot conditions that provide a match with observations. We have tested this method with synthetic data from simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Applicability study of Bayesian optimization in core neutronic design using a toy model

At the Japan Atomic Energy Agency (JAEA), an innovative design approach named ARKADIA (Advanced Reactor Knowledge- and AI-aided Design Integration Approach through the whole plant life cycle) for advanced nuclear reactors is currently under development. One task in ARKADIA is to build a system that automatically optimizes core and fuel designs by conducting core neutronic and thermal-hydraulic calculations, fuel integrity evaluations, and plant dynamic analyses. This system will be implemented to automatically find an optimal design that minimizes (or maximizes) objective function defined by core performance while varying the core and fuel design parameters such as fuel pin diameter, core height and diameter. In this study, as the first step of system development, we focused only on core neutronic design and conducted a study of automatic optimization. As the optimization algorithm, Bayesian optimization (BO), an effective method for optimization problems with expensive computational cost of objective function, was utilized. The applicability of BO was studied based on single- and two-objective optimization examples of core neutronic design in a toy model. As a result, in the former, it was shown that BO can give the optimal solution, which matches the reference solution calculated by a brute force calculation well, with a small number of required calculations. Usability on core neutronic designs, where the computational cost per case is high, was confirmed. In the latter, it was found that BO can give a Pareto solutions-set that shows good agreement with the reference solution. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

Gamma-ray burst flares: X-ray flaring. II

We present a catalog of 498 flaring periods found in gamma-ray burst (GRB) light curves taken from the online Swift X-Ray Telescope GRB Catalogue. We analyzed 680 individual light curves using a flare detection method developed and used on our UV/optical GRB Flare Catalog. This method makes use of the Bayesian Information Criterion to analyze the residuals of fitted GRB light curves and statistically determines the optimal fit to the light curve residuals in an attempt to identify any additional features. These features, which we classify as flares, are identified by iteratively adding additional 'breaks' to the light curve. We find evidence of flaring in 326 of the analyzed light curves. For those light curves with flares, we find an average number of ∼1.5 flares per GRB. As with the UV/optical, flaring in our sample is generally confined to the first 1000 s of the afterglow, but can be detected to beyond 10{sup 5} s. Only ∼50% of the detected flares follow the 'classical' definition of Δt/t ≤ 0.5, with many of the largest flares exceeding this value.

79 ASTRONOMY AND ASTROPHYSICS↗

Precipitation and Latent Heating Distributions from Satellite Passive Microwave Radiometry: Method and Uncertainties - Part 1

A revised Bayesian algorithm for estimating surface rain rate, convective rain proportion, and latent heating/drying profiles from satellite-borne passive microwave radiometer observations over ocean backgrounds is described. The algorithm searches a large database of cloud-radiative model simulations to find cloud profiles that are radiatively consistent with a given set of microwave radiance measurements. The properties of these radiatively consistent profiles are then composited to obtain best estimates of the observed properties. The revised algorithm is supported by an expanded and more physically consistent database of cloud-radiative model simulations. The algorithm also features a better quantification of the convective and non-convective contributions to total rainfall, a new geographic database, and an improved representation of background radiances in rain-free regions. Bias and random error estimates are derived from applications of the algorithm to synthetic radiance data, based upon a subset of cloud resolving model simulations, and from the Bayesian formulation itself. Synthetic rain rate and latent heating estimates exhibit a trend of high (low) bias for low (high) retrieved values. The Bayesian estimates of random error are propagated to represent errors at coarser time and space resolutions, based upon applications of the algorithm to TRMM Microwave Imager (TMI) data. Errors in instantaneous rain rate estimates at 0.5 deg resolution range from approximately 50% at 1 mm/h to 20% at 14 mm/h. These errors represent about 70-90% of the mean random deviation between collocated passive microwave and spaceborne radar rain rate estimates. The cumulative algorithm error in TMI estimates at monthly, 2.5 deg resolution is relatively small (less than 6% at 5 mm/day) compared to the random error due to infrequent satellite temporal sampling (8-35% at the same rain rate).

Olson, William S.↗