Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian parameter estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

NEXTorch: A Design and Bayesian Optimization Toolkit for Chemical Sciences and Engineering

Automation and optimization of chemical systems require well-informed decisions on what experiments to run to reduce time, materials, and/or computations. Data-driven active learning algorithms have emerged as valuable tools to solve such tasks. Bayesian optimization, a sequential global optimization approach, is a popular active-learning framework. Past studies have demonstrated its efficiency in solving chemistry and engineering problems. Here we introduce NEXTorch, a library in Python/PyTorch, to facilitate laboratory or computational design using Bayesian optimization. NEXTorch offers fast predictive modeling, flexible optimization loops, visualization capabilities, easy interfacing with legacy software, and multiple types of parameters and data type conversions. It provides GPU acceleration, parallelization, and state-of-the-art Bayesian optimization algorithms and supports both automated an d human-in-the-loop optimization. The comprehensive online documentation introduces Bayesian optimization theory and several examples from catalyst synthesis, reaction condition optimization, parameter estimation, and reactor geometry optimization. NEXTorch is open-source and available on GitHub

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An improved geodetic source model for the 1999 M W 6.3 Chamoli earthquake, India

Here, we introduce a distributed slip model for the 1999 M W 6.3 Chamoli earthquake of north India using interferometric synthetic aperture radar (InSAR) data from both ascending and descending orbits and Bayesian estimation of confidence levels and trade-offs of the model geometry parameters. The results of fault-slip inversion in an elastic half-space show that the earthquake ruptured a |$9 _{ - 2.2}^{\circ + 3.4}$| northeast-dipping plane with a maximum slip of ~1 m. The fault plane is located at a depth of ~|$15.9_{ - 3.0}^{ + 1.1}$| and is ~120 km north of the Main Frontal Thrust, implying that the rupture plane was on the northernmost detachment near the mid-crustal ramp of the Main Himalayan Thrust. The InSAR-determined moment is 3.35 × 10 18 Nm with a shear modulus of 30 GPa, equivalent to M W 6.3, which is smaller than the seismic moment estimates of M W 6.4-6.6. Possible reasons for this discrepancy include the trade-off between moment and depth, uncertainties in seismic moment tensor components for shallow dip-slip earthquakes and the role of earth structure models in the inversions. The released seismic energy from recent earthquakes in the Garhwal region is far less than the accumulated strain energy since the 1803 M S 7.5 earthquake, indicating substantial hazard of future great earthquakes.

58 GEOSCIENCES↗

Probabilistic estimation of depth-resolved profiles of soil thermal diffusivity from temperature time series

Abstract. Improving the quantification of soil thermal and physical properties is key to achieving a better understanding and prediction of soil hydro-biogeochemical processes and their responses to changes in atmospheric forcing. Obtaining such information at numerous locations and/or over time with conventional soil sampling is challenging. The increasing availability of low-cost, vertically resolved temperature sensor arrays offers promise for improving the estimation of soil thermal properties from temperature time series, and the possible indirect estimation of physical properties. Still, the reliability and limitations of such an approach need to be assessed. In the present study, we develop a parameter estimation approach based on a combination of thermal modeling, sliding time windows, Bayesian inference, and Markov chain Monte Carlo simulation to estimate thermal diffusivity and its uncertainty over time, at numerous locations and at an unprecedented vertical spatial resolution (i.e., down to 5 to 10 cm vertical resolution) from soil temperature time series. We provide the necessary framework to assess under which environmental conditions (soil temperature gradient, fluctuations, and trend), temperature sensor characteristics (bias and level of noise), and deployment geometries (sensor number and position) soil thermal diffusivity can be reliably inferred. We validate the method with synthetic experiments and field studies. The synthetic experiments show that in the presence of median diurnal fluctuations ≥ 1.5 ∘C at 5 cm below the ground surface, temperature gradients > 2 ∘C m−1, and a sliding time window of at least 4 d the proposed method provides reliable depth-resolved thermal diffusivity estimates with percentage errors ≤ 10 % and posterior relative standard deviations ≤ 5 % up to 1 m depth. Reliable thermal diffusivity under such environmental conditions also requires temperature sensors to be spaced precisely (with accuracy to a few millimeters), with a level of noise ≤ 0.02 ∘C, and with a bias defined by a standard deviation ≤ 0.01 ∘C. Finally, the application of the developed approach to field data indicates significant repeatability in results and similarity with independent measurements, as well as promise in using a sliding time window to estimate temporal changes in soil thermal diffusivity, as needed to potentially capture changes in bulk density or water content.

54 ENVIRONMENTAL SCIENCES↗

Towards improved characterization of high-risk releases using heterogeneous indoor sensor systems

The sudden release of toxic contaminants that reach indoor spaces can be hazardous to building occupants. For an acutely toxic contaminant, the speed of the emergency response strongly influences the consequences to occupants. The design of a real time sensor system is made challenging both by the urgency and complex nature of the event, and by the imperfect sensors and models available to describe it. In this research, we use Bayesian modeling to combine information from multiple types of sensors to improve the characterization of a release. We discuss conceptual and algorithmic considerations for selecting and fusing information from disparate sensors. To explore system performance, we use both real tracer gas data from experiments in a three story building, along with synthetic data, including information from door position sensors. The added information from door position sensors is found to be useful for many scenarios, but not always. We discuss the physical conditions and design factors that affect these results, such as the influence of the door positions on contaminant transport. We highlight potential benefits of multisensor data fusion, challenges in realizing those benefits, and opportunities for further improvement.

54 ENVIRONMENTAL SCIENCES↗

Non parametric denoising methods based on wavelets: Application to electron microscopy images in low exposure time

The 3D reconstruction of the Cryo-Transmission Electron Microscopy (Cryo-TEM) and Energy Filtering TEM images (EFTEM) hampered by the noisy nature of these images, so that their alignment becomes so difficult. This noise refers to the collision between the frozen hydrated biological samples and the electrons beam, where the specimen is exposed to the radiation with a high exposure time. This sensitivity to the electrons beam led specialists to obtain the specimen projection images at very low exposure time, which resulting the emergence of a new problem, an extremely low signal-to-noise ratio (SNR). This paper investigates the problem of TEM images denoising when they are acquired at very low exposure time. So, our main objective is to enhance the quality of TEM images to improve the alignment process which will in turn improve the three dimensional tomography reconstructions. We have done multiple tests on special TEM images acquired at different exposure time 0.5s, 0.2s, 0.1s and 1s (i.e. with different values of SNR)) and equipped by Golding beads for helping us in the assessment step. We herein, propose a structure to combine multiple noisy copies of the TEM images. The structure is based on four different denoising methods, to combine the multiple noisy TEM images copies. Namely, the four different methods are Soft, the Hard as Wavelet-Thresholding methods, Bilateral Filter as a non-linear technique able to maintain the edges neatly, and the Bayesian approach in the wavelet domain, in which context modeling is used to estimate the parameter for each coefficient. To ensure getting a high signal-to-noise ratio, we have guaranteed that we are using the appropriate wavelet family at the appropriate level. So we have chosen âĂIJsym8âĂİ wavelet at level 3 as the most appropriate parameter. Whereas, for the bilateral filtering many tests are done in order to determine the proper filter parameters represented by the size of the filter, the range parameter and the spatial parameter respectively. The experiments reported in this paper demonstrate the performance of the Bilateral Filtering and the Bayesian approaches in terms of improving the SNRout and the image quality. Taken together, these results suggest that the Bayesian process has a potential to outperform all the used methods, where in the multiple noisy copies structure it gave us the best SNRout without change of the golden beads diameter. The Bayesian approach yielded enhanced average image without needing a huge amount of copies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Determining reference standard strength for neutron-irradiated reduced activation ferritic/martensitic steel F82H by Bayesian method

The deterministic approach widely adopted in the design of structural components relies on systematically defined design limits using empirically determined safety factors. However, this approach is not always appropriate because structures are subjected to a variety of loads in the practical environment, which may result in excessively conservative design limits. In recent years, a more rigorous probabilistic approach that incorporates material strength distributions has become an important solution. In the probabilistic approach, the probability density functions of material strength properties underpin the design criteria. Here, the objective of this study is to identify the density distribution functions that best describe tensile properties of irradiated F82H to define a reference strength for DEMO design. Due to the limited number of existing data, this study specifically employs a Bayesian prediction method based on Monte Carlo simulations to determine a material reference value with statistical reliability and to investigate its effectiveness. For example, the dependence of tensile properties of 300 °C irradiated materials on irradiation damage and the range predicted by 95% Bayesian estimation was evaluated. As a statistical model for the dose dependence of statistical parameters, the normal distribution exhibited a better fit for 0.2% proof strength and tensile strength, whereas the distribution of total elongation data gave comparable reference values for both the normal and Weibull distribution models. Both models gave comparable criteria for the distribution of total elongation data. The Weibull model also gave better results for uniform elongation. The function best describing the model was a logarithmic law for both 0.2% proof strength and tensile strength, while a power law for both total and uniform elongation, which allowed for more comprehensive data prediction of irradiation data with statistical accuracy for DEMO reactor design.

36 MATERIALS SCIENCE↗

DETERMINING AGES OF APOGEE GIANTS WITH KNOWN DISTANCES

We present a sample of 705 local giant stars observed using the New Mexico State University 1 m telescope with the Sloan Digital Sky Survey-III/Apache Point Observatory Galactic Evolution Experiment (APOGEE) spectrograph, for which we estimate stellar ages and the local star formation history (SFH). The high-resolution (R ∼ 22,500), near infrared (1.51–1.7 μm) APOGEE spectra provide measurements of stellar atmospheric parameters (temperature, surface gravity, [M/H], and [α/M]). Due to the smaller uncertainties in surface gravity possible with high-resolution spectra and accurate Hipparcos distance measurements, we are able to calculate the stellar masses to within 30%. For giants, the relatively rapid evolution up the red giant branch allows the age to be constrained by the mass. We examine methods of estimating age using both the mass–age relation directly and a Bayesian isochrone matching of measured parameters, assuming a constant SFH. To improve the SFH prior, we use a hierarchical modeling approach to constrain the parameters of the model SFH using the age probability distribution functions of the data. The results of an α-dependent Gaussian SFH model show a clear age–[α/M] relation at all ages. Using this SFH model as the prior for an empirical Bayesian analysis, we determine ages for individual stars. The resulting age–metallicity relation is flat, with a slight decrease in [M/H] at the oldest ages and a ∼0.5 dex spread in metallicity across most ages. For stars with ages ≲1 Gyr we find a smaller spread, consistent with radial migration having a smaller effect on these young stars than on the older stars.

79 ASTRONOMY AND ASTROPHYSICS↗

PRIME - A Software Toolkit for the Characterization of Partially Observed Epidemics in a Bayesian Framework

PRIME is a modeling framework designed for the “real-time’” characterization and forecasting of partially observed epidemics. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients. The method is designed to help guide medical resource allocation in the early epoch of the outbreak. The estimation problem is posed as one of Bayesian inference and solved using a Markov Chain Monte Carlo technique. The framework can accommodate multiple epidemic waves and can help identify different disease dynamics at the regional, state, and country levels. We include examples using publicly available COVID-19 data.

97 MATHEMATICS AND COMPUTING↗

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy,is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters, within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors' contributions to predictive uncertainty. As a result, the framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem

97 MATHEMATICS AND COMPUTING↗

Development of a framework for sequential Bayesian design of experiments: Application to a pilot-scale solvent-based CO 2 capture process

In this paper, a methodology is developed for sequential design of experiments (SDoE) for process systems and applied to a solvent-based CO 2 capture system. In this approach, the prior knowledge of the system is used to prioritize process data collection at specific operating conditions. These data are then incorporated into a Bayesian inference methodology for updating a stochastic model by refining estimations of its underlying parameters, and the updated model is then used to generate the next set of test runs. Thus, the new knowledge obtained from the data is used to guide subsequent iterations of the experimental runs, ensuring that the overall data collection is maximally informative given that most experimental campaigns, especially at pilot or higher-scale plants, are costly, time-consuming, and resource-limited. The test run objective for this work was to minimize the maximum model prediction uncertainty for key output variables, but the methodology is generic and can be readily applied to other test run objectives. This methodology is applied to an aqueous monoethanolamine (MEA) pilot plant campaign at the National Carbon Capture Center (NCCC) in Wilsonville, Alabama, USA. The SDoE framework was utilized for two iterations, while collecting 18 sets of data representing different process conditions, and this resulted in an overall average reduction in uncertainty of approximately 50% in the prediction of CO 2 capture percentage. Moreover, 11 additional data sets were obtained with variation of absorber packing height for further model validation. This work shows the capability of the SDoE framework to maximize learning given limited resources, allowing for the reduction of model uncertainty, which is of great importance for many applications including reduction of technical risk associated with scale-up and economic analysis.

20 FOSSIL-FUELED POWER PLANTS↗

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy, is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters,within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors’ contributions to predictive uncertainty. The framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Characterization of Partially Observed Epidemics - Application to COVID-19

This report documents a statistical method for the "real-time" characterization of partially observed epidemics. Observations consist of daily counts of symptomatic patients, diagnosed with the disease. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information for the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and is predicated on a model for the distribution of the incubation period. The model parameters are estimated as distributions using a Markov Chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. The method is applied to the COVID-19 pandemic of 2020, using data at the country, provincial (e.g., states) and regional (e.g. county) levels. The epidemiological model includes a stochastic component due to uncertainties in the incubation period. This model-form uncertainty is accommodated by a pseudo-marginal Metropolis-Hastings MCMC sampler, which produces posterior distributions that reflect this uncertainty. We approximate the discrepancy between the data and the epidemiological model using Gaussian and negative binomial error models; the latter was motivated by the over-dispersed count data. For small daily counts we find the performance of the calibrated models to be similar for the two error models. For large daily counts the negative-binomial approximation is numerically unstable unlike the Gaussian error model. Application of the model at the country level (for the United States, Germany, Italy, etc.) generally provided accurate forecasts, as the data consisted of large counts which suppressed the day-to-day variations in the observations. Further, the bulk of the data is sourced over the duration before the relaxation of the curbs on population mixing, and is not confounded by any discernible country-wide second wave of infections. At the state-level, where reporting was poor or which evinced few infections (e.g., New Mexico), the variance in the data posed some, though not insurmountable, difficulties, and forecasts were able to capture the data with large uncertainty bounds. The method was found to be sufficiently sensitive to discern the flattening of the infection and epidemic curve due to shelter-in-place orders after around 90% quantile for the incubation distribution (about 10 days for COVID-19). The proposed model was also used at a regional level to compare the forecasts for the central and north-west regions of New Mexico. Modeling the data for these regions illustrated different disease spread dynamics captured by the model. While in the central region the daily counts peaked in the late April, in the north-west region the ramp-up continued for approximately three more weeks.

59 BASIC BIOLOGICAL SCIENCES↗

Characterization of partially observed epidemics through Bayesian inference: application to COVID-19

We demonstrate a Bayesian method for the "real-time'" characterization and forecasting of partially observed COVID-19 epidemic. Characterization is the estimation of infection spread parameters using daily counts of symptomatic patients.The method is designed to help guide medical resource allocation in the early epoch of the outbreak. The estimation problem is posed as one of Bayesian inference and solved using a Markov chain Monte Carlo technique. The data used in this study was sourced before the arrival of the second wave of infection in July 2020. The proposed modeling approach, when applied at the country level, generally provides accurate forecasts at the regional, state and country level. The epidemiological model detected the flattening of the curve in California, after public health measures were instituted.The method also detected different disease dynamics when applied to specific region of New Mexico

60 APPLIED LIFE SCIENCES↗

Risk Analysis of the Space Shuttle: Pre-Challenger Bayeisan Prediction of Failure

Dalal et al performed a statistical analysis of field and nozzle O-ring data collected prior to the ill-fated launch of the Challenger in January 1986. The purpose of their analysis was to show how statistical analysis could be used to provide information to decisionmakers prior to the launch, information that could have been expected to lead to a decision to abort the launch due to the low temperatures (~30o F.) present at the launch pad on the morning of the scheduled launch. Dalal et al. performed a frequentist analysis of the O-ring data, and found that a logistic regression model provided a relatively good fit to the past data. In the second portion of their paper, Dalal et al. propagated parameter uncertainties through the fitted logistic regression model in order to estimate the probability of shuttle failure due to O-ring failure at the estimated launch temperature of ~30o F. Because their analysis was frequentist in nature, probability distributions representing epistemic uncertainty in the input parameters were not available, and the authors had to resort to an approximate approach based on bootstrap confidence intervals. In this paper, we will re-evaluate the analyses of Dalal et al. from a Bayesian perspective. Markov chain Monte Carlo (MCMC) sampling will be used to sample from the joint posterior distribution of the model parameters, and to sample from the posterior predictive distributions at the estimated launch temperature, a temperature that had not been observed in prior launches of the space shuttle. Uncertainties, which are represented by probability distributions in the Bayesian approach, are propagated through the model to obtain a probability distribution for O-ring failure, and subsequently for shuttle failure as a result of O-ring failure. No approximations are required in the Bayesian approach and the resulting distributions can be input to a decision analysis to obtain expected utility for the decision to launch.

42 ENGINEERING↗

Machine learning based approach to predict ductile damage model parameters for polycrystalline metals

Damage models for ductile materials typically need to be parameterized, often with the appropriate parameters changing for a given material depending on the loading conditions. This can make parameterizing these models computationally expensive, since an inverse problem must be solved for each loading condition. Using standard inverse modeling techniques typically requires hundreds or thousands of high-fidelity computer simulations to estimate the optimal parameters. Additionally, the time of a human expert is required to set up the inverse model. Machine learning has recently emerged as an alternative approach to inverse modeling in these settings, where the machine learning model is trained in an offline manner and new parameters can be quickly generated on the fly, after training is complete. Here, this work utilizes such a workflow to enable the rapid parameterization of a ductile damage model called TEPLA with a machine learning inverse model. The machine learning model can efficiently estimate the model parameters much faster, as compared to previously employed methods, such as Bayesian calibration. The results demonstrate good accuracy on a synthetic test dataset and is validated against experimental data.

36 MATERIALS SCIENCE↗

Statistical method for resolving the photon-photoelectron-counting inversion problem

A statistical inversion method is proposed for the photon-photoelectron-counting statistics in quantum key distribution experiment. With the statistical viewpoint, this problem is equivalent to the parameter estimation for an infinite binomial mixture model. The coarse-graining idea and Bayesian methods are applied to deal with this ill-posed problem, which is a good simple example to show the successful application of the statistical methods to the inverse problem. Numerical results show the applicability of the proposed strategy. The coarse-graining idea for the infinite mixture models should be general to be used in the future.

97 MATHEMATICS AND COMPUTING↗

Minimally Informative Prior Distributions for PSA

A salient feature of Bayesian inference is its ability to incorporate information from a variety of sources into the inference model, via the prior distribution (hereafter simply “the prior”). However, over-reliance on old information can lead to priors that dominate new data. Some analysts seek to avoid this by trying to work with a minimally informative prior distribution. Another reason for choosing a minimally informative prior is to avoid the often-voiced criticism of subjectivity in the choice of prior. Minimally informative priors fall into two broad classes: 1) so-called noninformative priors, which attempt to be completely objective, in that the posterior distribution is determined as completely as possible by the observed data, the most well known example in this class being the Jeffreys prior, and 2) priors that are diffuse over the region where the likelihood function is nonnegligible, but that incorporate some information about the parameters being estimated, such as a mean value. In this paper, we compare four approaches in the second class, with respect to their practical implications for Bayesian inference in Probabilistic Safety Assessment (PSA). The most commonly used such prior, the so-called constrained noninformative prior, is a special case of the maximum entropy prior. This is formulated as a conjugate distribution for the most commonly encountered aleatory models in PSA, and is correspondingly mathematically convenient; however, it has a relatively light tail and this can cause the posterior mean to be overly influenced by the prior in updates with sparse data. A more informative prior that is capable, in principle, of dealing more effectively with sparse data is a mixture of conjugate priors. A particular diffuse nonconjugate prior, the logistic-normal, is shown to behave similarly for some purposes. Finally, we review the so-called robust prior. Rather than relying on the mathematical abstraction of entropy, as does the constrained noninformative prior, the robust prior places a heavy-tailed Cauchy prior on the canonical parameter of the aleatory model.

99 GENERAL AND MISCELLANEOUS↗

Fast, differentiable, and extensible big bang nucleosynthesis package

Here, we introduce light isotope nucleosynthesis with JAX (LINX), a new differentiable public big bang nucleosynthesis code designed for fast parameter estimation. By leveraging JAX, LINX achieves both speed and differentiability, enabling the use of Bayesian inference, including gradient-based methods. We discuss the formalism used in LINX for rapid primordial elemental abundance predictions and give examples of how LINX can be used. When combined with differentiable cosmic microwave background power spectrum emulators, LINX can be used for joint cosmic microwave background and big bang nucleosynthesis analyses without requiring extensive computational resources, including on personal hardware.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗