Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian parameter estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗

On the robustness of a Bayes estimate

This paper examines the robustness of a Bayes estimator with respect to the assigned prior distribution. A Bayesian analysis for a stochastic scale parameter of a Weibull failure model is summarized in which the natural conjugate is assigned as the prior distribution of the random parameter. The sensitivity analysis is carried out by the Monte Carlo method in which, although an inverted gamma is the assigned prior, realizations are generated using distribution functions of varying shape. For several distributional forms and even for some fixed values of the parameter, simulated mean squared errors of Bayes and minimum variance unbiased estimators are determined and compared. Results indicate that the Bayes estimator remains squared-error superior and appears to be largely robust to the form of the assigned prior distribution.

Canavos, G. C.↗

Development and application of marginal likelihood optimization for integral parameter adjustment

When adjusting nuclear data with integral experiments, care must be taken that spurious adjustments are not made by assimilating poorly characterized integral parameters. If there are unaccounted for biases or poorly estimated uncertainties in the calculated and experimental values for an integral parameter, the Bayesian data assimilation may adjust the nuclear data in a manner that does not reflect the physics of the integral parameter. To identify and lessen the impact of these inconsistent integral parameters, in this study we present a Marginal Likelihood Optimization algorithm. In a data-driven way, the marginalized likelihood is used to modulate hyperparameter terms that decrease the influence of inconsistent integral parameters on the adjustment. The advantage of this approach over other methods in the literature is that it incorporates correlation information and does not remove an integral parameter from the adjustment. Herein, we present and motivate the algorithm, and apply it to an integral data assimilation case study.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NEXTorch: A Design and Bayesian Optimization Toolkit for Chemical Sciences and Engineering

Automation and optimization of chemical systems require well-informed decisions on what experiments to run to reduce time, materials, and/or computations. Data-driven active learning algorithms have emerged as valuable tools to solve such tasks. Bayesian optimization, a sequential global optimization approach, is a popular active-learning framework. Past studies have demonstrated its efficiency in solving chemistry and engineering problems. Here we introduce NEXTorch, a library in Python/PyTorch, to facilitate laboratory or computational design using Bayesian optimization. NEXTorch offers fast predictive modeling, flexible optimization loops, visualization capabilities, easy interfacing with legacy software, and multiple types of parameters and data type conversions. It provides GPU acceleration, parallelization, and state-of-the-art Bayesian optimization algorithms and supports both automated an d human-in-the-loop optimization. The comprehensive online documentation introduces Bayesian optimization theory and several examples from catalyst synthesis, reaction condition optimization, parameter estimation, and reactor geometry optimization. NEXTorch is open-source and available on GitHub

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An improved geodetic source model for the 1999 M W 6.3 Chamoli earthquake, India

Here, we introduce a distributed slip model for the 1999 M W 6.3 Chamoli earthquake of north India using interferometric synthetic aperture radar (InSAR) data from both ascending and descending orbits and Bayesian estimation of confidence levels and trade-offs of the model geometry parameters. The results of fault-slip inversion in an elastic half-space show that the earthquake ruptured a |$9 _{ - 2.2}^{\circ + 3.4}$| northeast-dipping plane with a maximum slip of ~1 m. The fault plane is located at a depth of ~|$15.9_{ - 3.0}^{ + 1.1}$| and is ~120 km north of the Main Frontal Thrust, implying that the rupture plane was on the northernmost detachment near the mid-crustal ramp of the Main Himalayan Thrust. The InSAR-determined moment is 3.35 × 10 18 Nm with a shear modulus of 30 GPa, equivalent to M W 6.3, which is smaller than the seismic moment estimates of M W 6.4-6.6. Possible reasons for this discrepancy include the trade-off between moment and depth, uncertainties in seismic moment tensor components for shallow dip-slip earthquakes and the role of earth structure models in the inversions. The released seismic energy from recent earthquakes in the Garhwal region is far less than the accumulated strain energy since the 1803 M S 7.5 earthquake, indicating substantial hazard of future great earthquakes.

58 GEOSCIENCES↗

Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series

Abstract. Improving the quantification of soil thermal and physical properties is key to achieving a better understanding and prediction of soil hydro-biogeochemical processes and their responses to changes in atmospheric forcing. Obtaining such information at numerous locations and/or over time with conventional soil sampling is challenging. The increasing availability of low-cost, vertically resolved temperature sensor arrays offers promise for improving the estimation of soil thermal properties from temperature time series, and the possible indirect estimation of physical properties. Still, the reliability and limitations of such an approach need to be assessed. In the present study, we develop a parameter estimation approach based on a combination of thermal modeling, sliding time windows, Bayesian inference, and Markov chain Monte Carlo simulation to estimate thermal diffusivity and its uncertainty over time, at numerous locations and at an unprecedented vertical spatial resolution (i.e., down to 5 to 10 cm vertical resolution) from soil temperature time series. We provide the necessary framework to assess under which environmental conditions (soil temperature gradient, fluctuations, and trend), temperature sensor characteristics (bias and level of noise), and deployment geometries (sensor number and position) soil thermal diffusivity can be reliably inferred. We validate the method with synthetic experiments and field studies. The synthetic experiments show that in the presence of median diurnal fluctuations ≥ 1.5 ∘C at 5 cm below the ground surface, temperature gradients > 2 ∘C m−1, and a sliding time window of at least 4 d the proposed method provides reliable depth-resolved thermal diffusivity estimates with percentage errors ≤ 10 % and posterior relative standard deviations ≤ 5 % up to 1 m depth. Reliable thermal diffusivity under such environmental conditions also requires temperature sensors to be spaced precisely (with accuracy to a few millimeters), with a level of noise ≤ 0.02 ∘C, and with a bias defined by a standard deviation ≤ 0.01 ∘C. Finally, the application of the developed approach to field data indicates significant repeatability in results and similarity with independent measurements, as well as promise in using a sliding time window to estimate temporal changes in soil thermal diffusivity, as needed to potentially capture changes in bulk density or water content.

54 ENVIRONMENTAL SCIENCES↗

Classification results using spacially correlated Landsat data

Tubbs and Coberly (1978) demonstrated that Landsat multispectral scanner data are not independent random observations, but, are in fact highly correlated. They also demonstrated that the correlation structure for the data is similar to that of a stationary autoregressive process of order one. This paper investigates the effect that serially correlated training data have upon both the estimation of parameters and the classification problem. Results are included for both the Bayesian and maximum likelihood classification procedures.

Tubbs, J. D.↗

Piloted Simulator Evaluation of Maneuvering Envelope Information for Flight Crew Awareness

The implementation and evaluation of an efficient method for estimating safe aircraft maneuvering envelopes are discussed. A Bayesian approach is used to produce a deterministic algorithm for estimating aerodynamic system parameters from existing noisy sensor measurements, which are then used to estimate the trim envelope through efficient high- fidelity model-based computations of attainable equilibrium sets. The safe maneuverability limitations are extended beyond the trim envelope through a robust reachability analysis derived from an optimal control formulation. The trim and maneuvering envelope limits are then conveyed to pilots through three axes on the primary flight display. To evaluate the new display features, commercial airline crews flew multiple challenging approach and landing scenarios in the full motion Advanced Concepts Flight Simulator at NASA Ames Research Center, as part of a larger research initiative to investigate the impact on the energy state awareness of the crew. Results show that the additional display features have the potential to significantly improve situational awareness of the flight crew.

maneuvers↗

Efficient Calibration of Expensive Computational Models

Accounting for uncertainty when calibrating expensive computational models is a common challenge faced by scientists and engineers. Often Bayesian techniques are adopted to estimate a probability density function over the model parameters given noisy empirical data. The methods used to perform this type of probabilistic calibration are computationally prohibitive in that they require a large number of evaluations of the expensive model. In these cases, surrogate modeling -- that is, using a fast-to-evaluate, lower fidelity stand-in for the original computational model -- may be the only option to alleviate this computational burden. However, the upfront cost of generating training data to build a surrogate model can itself be expensive. As such, it is important to be judicious when selecting training points at which the full-fidelity model is evaluated. Here, an active learning approach is proposed that enables efficient selection of training points using approximate samples of the calibrated parameter probability density function. In this way, the training points can be concentrated in regions where the calibration algorithm requires high model accuracy.

active learning↗

Mind the Gap: Addressing Data Gaps and Assessing Noise Mismodeling in LISA

Due to the sheer complexity of the Laser Interferometer Space Antenna (LISA) space mission, data gaps arising from instrumental irregularities and/or scheduled maintenance are unavoidable. Focusing on merger-dominated massive black hole binary signals, we test the appropriateness of the Whittle-likelihood on gapped data in a variety of cases. From first principles, we derive the likelihood valid for gapped data in both the time and frequency domains. Cheap-to-evaluate proxies to p-p plots are derived based on a Fisher-based formalism, and verified through Bayesian techniques. Our tools allow to predict the altered variance in the parameter estimates that arises from noise mismodeling, as well as the information loss represented by the broadening of the posteriors. The result of noise mismodeling with gaps is sensitive to the characteristics of the noise model, with strong low-frequency (red) noise and strong high-frequency (blue) noise giving statistically significant fluctuations in recovered parameters. We demonstrate that the introduction of a tapering window reduces statistical inconsistency errors, at the cost of less precise parameter estimates. We also show that the assumption of independence between inter-gap segments appears to be a fair approximation even if the data set is inherently coherent. However, if one instead assumes fictitious correlations in the data stream, when the data segments are actually independent, then the resultant parameter recoveries could be inconsistent with the true parameters. The theoretical and numerical practices that are presented in this work could readily be incorporated into global-fit pipelines operating on gapped data.

LISA↗

Towards improved characterization of high-risk releases using heterogeneous indoor sensor systems

The sudden release of toxic contaminants that reach indoor spaces can be hazardous to building occupants. For an acutely toxic contaminant, the speed of the emergency response strongly influences the consequences to occupants. The design of a real time sensor system is made challenging both by the urgency and complex nature of the event, and by the imperfect sensors and models available to describe it. In this research, we use Bayesian modeling to combine information from multiple types of sensors to improve the characterization of a release. We discuss conceptual and algorithmic considerations for selecting and fusing information from disparate sensors. To explore system performance, we use both real tracer gas data from experiments in a three story building, along with synthetic data, including information from door position sensors. The added information from door position sensors is found to be useful for many scenarios, but not always. We discuss the physical conditions and design factors that affect these results, such as the influence of the door positions on contaminant transport. We highlight potential benefits of multisensor data fusion, challenges in realizing those benefits, and opportunities for further improvement.

54 ENVIRONMENTAL SCIENCES↗

Non parametric denoising methods based on wavelets: Application to electron microscopy images in low exposure time

The 3D reconstruction of the Cryo-Transmission Electron Microscopy (Cryo-TEM) and Energy Filtering TEM images (EFTEM) hampered by the noisy nature of these images, so that their alignment becomes so difficult. This noise refers to the collision between the frozen hydrated biological samples and the electrons beam, where the specimen is exposed to the radiation with a high exposure time. This sensitivity to the electrons beam led specialists to obtain the specimen projection images at very low exposure time, which resulting the emergence of a new problem, an extremely low signal-to-noise ratio (SNR). This paper investigates the problem of TEM images denoising when they are acquired at very low exposure time. So, our main objective is to enhance the quality of TEM images to improve the alignment process which will in turn improve the three dimensional tomography reconstructions. We have done multiple tests on special TEM images acquired at different exposure time 0.5s, 0.2s, 0.1s and 1s (i.e. with different values of SNR)) and equipped by Golding beads for helping us in the assessment step. We herein, propose a structure to combine multiple noisy copies of the TEM images. The structure is based on four different denoising methods, to combine the multiple noisy TEM images copies. Namely, the four different methods are Soft, the Hard as Wavelet-Thresholding methods, Bilateral Filter as a non-linear technique able to maintain the edges neatly, and the Bayesian approach in the wavelet domain, in which context modeling is used to estimate the parameter for each coefficient. To ensure getting a high signal-to-noise ratio, we have guaranteed that we are using the appropriate wavelet family at the appropriate level. So we have chosen âĂIJsym8âĂİ wavelet at level 3 as the most appropriate parameter. Whereas, for the bilateral filtering many tests are done in order to determine the proper filter parameters represented by the size of the filter, the range parameter and the spatial parameter respectively. The experiments reported in this paper demonstrate the performance of the Bilateral Filtering and the Bayesian approaches in terms of improving the SNRout and the image quality. Taken together, these results suggest that the Bayesian process has a potential to outperform all the used methods, where in the multiple noisy copies structure it gave us the best SNRout without change of the golden beads diameter. The Bayesian approach yielded enhanced average image without needing a huge amount of copies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Determining reference standard strength for neutron-irradiated reduced activation ferritic/martensitic steel F82H by Bayesian method

The deterministic approach widely adopted in the design of structural components relies on systematically defined design limits using empirically determined safety factors. However, this approach is not always appropriate because structures are subjected to a variety of loads in the practical environment, which may result in excessively conservative design limits. In recent years, a more rigorous probabilistic approach that incorporates material strength distributions has become an important solution. In the probabilistic approach, the probability density functions of material strength properties underpin the design criteria. Here, the objective of this study is to identify the density distribution functions that best describe tensile properties of irradiated F82H to define a reference strength for DEMO design. Due to the limited number of existing data, this study specifically employs a Bayesian prediction method based on Monte Carlo simulations to determine a material reference value with statistical reliability and to investigate its effectiveness. For example, the dependence of tensile properties of 300 °C irradiated materials on irradiation damage and the range predicted by 95% Bayesian estimation was evaluated. As a statistical model for the dose dependence of statistical parameters, the normal distribution exhibited a better fit for 0.2% proof strength and tensile strength, whereas the distribution of total elongation data gave comparable reference values for both the normal and Weibull distribution models. Both models gave comparable criteria for the distribution of total elongation data. The Weibull model also gave better results for uniform elongation. The function best describing the model was a logarithmic law for both 0.2% proof strength and tensile strength, while a power law for both total and uniform elongation, which allowed for more comprehensive data prediction of irradiation data with statistical accuracy for DEMO reactor design.

36 MATERIALS SCIENCE↗

DETERMINING AGES OF APOGEE GIANTS WITH KNOWN DISTANCES

We present a sample of 705 local giant stars observed using the New Mexico State University 1 m telescope with the Sloan Digital Sky Survey-III/Apache Point Observatory Galactic Evolution Experiment (APOGEE) spectrograph, for which we estimate stellar ages and the local star formation history (SFH). The high-resolution (R ∼ 22,500), near infrared (1.51–1.7 μm) APOGEE spectra provide measurements of stellar atmospheric parameters (temperature, surface gravity, [M/H], and [α/M]). Due to the smaller uncertainties in surface gravity possible with high-resolution spectra and accurate Hipparcos distance measurements, we are able to calculate the stellar masses to within 30%. For giants, the relatively rapid evolution up the red giant branch allows the age to be constrained by the mass. We examine methods of estimating age using both the mass–age relation directly and a Bayesian isochrone matching of measured parameters, assuming a constant SFH. To improve the SFH prior, we use a hierarchical modeling approach to constrain the parameters of the model SFH using the age probability distribution functions of the data. The results of an α-dependent Gaussian SFH model show a clear age–[α/M] relation at all ages. Using this SFH model as the prior for an empirical Bayesian analysis, we determine ages for individual stars. The resulting age–metallicity relation is flat, with a slight decrease in [M/H] at the oldest ages and a ∼0.5 dex spread in metallicity across most ages. For stars with ages ≲1 Gyr we find a smaller spread, consistent with radial migration having a smaller effect on these young stars than on the older stars.

79 ASTRONOMY AND ASTROPHYSICS↗

PRIME - A Software Toolkit for the Characterization of Partially Observed Epidemics in a Bayesian Framework

PRIME is a modeling framework designed for the “real-time’” characterization and forecasting of partially observed epidemics. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. We include examples using publicly available COVID-19 data.

97 MATHEMATICS AND COMPUTING↗

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy,is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters, within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors' contributions to predictive uncertainty. As a result, the framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem

97 MATHEMATICS AND COMPUTING↗

Development of a framework for sequential Bayesian design of experiments: Application to a pilot-scale solvent-based CO 2 capture process

In this paper, a methodology is developed for sequential design of experiments (SDoE) for process systems and applied to a solvent-based CO 2 capture system. In this approach, the prior knowledge of the system is used to prioritize process data collection at specific operating conditions. These data are then incorporated into a Bayesian inference methodology for updating a stochastic model by refining estimations of its underlying parameters, and the updated model is then used to generate the next set of test runs. Thus, the new knowledge obtained from the data is used to guide subsequent iterations of the experimental runs, ensuring that the overall data collection is maximally informative given that most experimental campaigns, especially at pilot or higher-scale plants, are costly, time-consuming, and resource-limited. The test run objective for this work was to minimize the maximum model prediction uncertainty for key output variables, but the methodology is generic and can be readily applied to other test run objectives. This methodology is applied to an aqueous monoethanolamine (MEA) pilot plant campaign at the National Carbon Capture Center (NCCC) in Wilsonville, Alabama, USA. The SDoE framework was utilized for two iterations, while collecting 18 sets of data representing different process conditions, and this resulted in an overall average reduction in uncertainty of approximately 50% in the prediction of CO 2 capture percentage. Moreover, 11 additional data sets were obtained with variation of absorber packing height for further model validation. This work shows the capability of the SDoE framework to maximize learning given limited resources, allowing for the reduction of model uncertainty, which is of great importance for many applications including reduction of technical risk associated with scale-up and economic analysis.

20 FOSSIL-FUELED POWER PLANTS↗

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy, is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters,within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors’ contributions to predictive uncertainty. The framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗