Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bayesian model calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Bayesian Inference and the Effects of Varying Uncertainty Models in Charring Ablator Calibration and Uncertainty Quantification Problems

The Mars Science Laboratory (MSL) vehicle utilized a heat shield constructed from NASA’s Phenolic-Impregnated Carbon Ablator (PICA) material to protect the main structure from the high enthalpy environment encountered during hypersonic atmospheric entry. During the vehicle’s descent through Martian atmosphere, multiple thermocouples embedded within the heat shield captured in-depth material temperature data that allow for studies to be conducted on current material response reconstruction tools. In the present work, material temperature data obtained from thermocouples within the MISP-4 plug (MEDLI (Mars Science Laboratory Entry, Descent, and Landing Instrument) Integrated Sensor Plug) are utilized in the calibration of Theoretical Ablative Composite for Open Testing (TACOT) model parameters in conjunction with NASA’s Porous material Analysis Toolbox (PATO) through Bayesian inference where uncertainty due to parametric, modeling, and experimental sources is simultaneously quantified. Prior to the study, a sensitivity analysis is performed through computation of the robust Sobol indices in an effort to study the relationship between input space and model response and to reduce the dimensionality of the statistical inverse problem. The Bayesian inference methodology necessitates an a-priori choice to be made for the uncertainty model for which numerous possibilities are available. Across most works, however, only basic additive or multiplicative models are utilized with pre-defined magnitudes of uncertainty based on a-priori knowledge or to-be-calibrated multipliers of static covariance matrix structures. The present effort explores the effects of informed uncertainty models, ones with temporal dependence that are simultaneously calibrated through Bayesian inference, on calibrated results for parameters that make up the uncertain input space.

Sensitivity Analysis↗
NASA NTRS2023

Efficient Calibration of Expensive Computational Models

Accounting for uncertainty when calibrating expensive computational models is a common challenge faced by scientists and engineers. Often Bayesian techniques are adopted to estimate a probability density function over the model parameters given noisy empirical data. The methods used to perform this type of probabilistic calibration are computationally prohibitive in that they require a large number of evaluations of the expensive model. In these cases, surrogate modeling -- that is, using a fast-to-evaluate, lower fidelity stand-in for the original computational model -- may be the only option to alleviate this computational burden. However, the upfront cost of generating training data to build a surrogate model can itself be expensive. As such, it is important to be judicious when selecting training points at which the full-fidelity model is evaluated. Here, an active learning approach is proposed that enables efficient selection of training points using approximate samples of the calibrated parameter probability density function. In this way, the training points can be concentrated in regions where the calibration algorithm requires high model accuracy.

active learning↗
NASA NTRSDate not supplied

Probabilistic Calibration of Expensive Models using Efficiently Trained Surrogates

Calibration of computational models in the presence of uncertainty is often cast as a Bayesian inference problem and solved via sampling methods, e.g., Markov chain Monte Carlo. When the computational model is expensive, this task becomes intractable due to the large number of samples required to accurately estimate the posterior distribution of the calibration parameters. A popular solution to this problem is to use machine learning to develop a faster-to-evaluate, lower-fidelity substitute for the original model to serve as a surrogate while solving the inference problem. Although considered an offline cost, generating training data to construct this surrogate model can still be an expensive task in practice. An active learning algorithm is presented that focuses training on improving surrogate accuracy specifically in and around the bulk of the posterior distribution, as this is where the model is exercised during calibration. Candidate samples are drawn from families of distributions related to an approximation of the posterior. The sample maximizing predictive variance is then selected for evaluation by the original computational model, yielding a label for the training point. Iterating this approach increases efficiency relative to space filling designs (e.g., Latin hypercube sampling) by avoiding low probability points. Practical considerations are discussed, including the benefits of using a sequential Monte Carlo sampling approach, convergence heuristics, and the importance of both exploration and exploitation given that the true posterior is unknown a priori.

uncertainty quantification↗
NASA NTRS1992

Sensor fusion V; Proceedings of the Meeting, Boston, MA, Nov. 15-17, 1992

Topics addressed include 3D object perception, human-machine interface in multisensor systems, sensor fusion architecture, fusion of multiple and distributed sensors, interface and decision models for sensor fusion, computational networks, simple sensing for complex action, multisensor-based control, and metrology and calibration of multisensor systems. Particular attention is given to controlling 3D objects by sketching 2D views, the graphical simulation and animation environment for flexible structure robots, designing robotic systems from sensorimotor modules, cylindrical object reconstruction from a sequence of images, an accurate estimation of surface properties by integrating information using Bayesian networks, an adaptive fusion model for a distributed detection system, multiple concurrent object descriptions in support of autonomous navigation, robot control with multiple sensors and heuristic knowledge, and optical array detectors for image sensors calibration. (No individual items are abstracted in this volume)

Schenker, Paul S.↗
NASA NTRS2002

Bayesian Hierarchical Air-Sea Interaction Modeling: Application to the Labrador Sea

The objectives are to: 1) Organize data from 26 MINIMET drifters in the Labrador Sea, including sensor calibration and error checking of ARGOS transmissions. 2) Produce wind direction, barometer, and sea surface temperature time series. In addition, provide data from historical file of 150 SHARP drifters in the Labrador Sea. 3) Work with data interpretation and data-modeling assimilation issues.

Niiler, Pearn P.↗
NASA NTRS2004

3D Surface Reconstruction and Automatic Camera Calibration

Illustrations in this view-graph presentation are presented on a Bayesian approach to 3D surface reconstruction and camera calibration.Existing methods, surface analysis and modeling,preliminary surface reconstruction results, and potential applications are addressed.

Jalobeanu, Andre↗
NASA NTRS2008

Bayesian Inference in the Modern Design of Experiments

This paper provides an elementary tutorial overview of Bayesian inference and its potential for application in aerospace experimentation in general and wind tunnel testing in particular. Bayes Theorem is reviewed and examples are provided to illustrate how it can be applied to objectively revise prior knowledge by incorporating insights subsequently obtained from additional observations, resulting in new (posterior) knowledge that combines information from both sources. A logical merger of Bayesian methods and certain aspects of Response Surface Modeling is explored. Specific applications to wind tunnel testing, computational code validation, and instrumentation calibration are discussed.

DeLoach, Richard↗
NASA NTRS2003

A Bayesian Approach to Sensor Characterization

The physical model of a generic electro-optic sensor is derived and incorporated into a Bayesian framework for the estimation of key instrument parameters from calibration data. The sensor characterization thus achieved enables optimal subsequent removal of instrument effects from field data, leading to the highest possible accuracy in the retrieved physical quantities.

Timucin, Dogan A.↗
NASA NTRS2021

The M-dwarf Ultraviolet Spectroscopic Sample. I. Determining Stellar Parameters for Field Stars

Accurate stellar properties are essential for precise stellar astrophysics and exoplanetary science. In the M-dwarf regime, much effort has gone into defining empirical relations that can use readily accessible observables to assess physical stellar properties. Often, these relations for the quantity of interest are cast as a nonlinear function of available data; in Bayesian modeling, however, the reverse is needed. In this article, we introduce a new Bayesian framework to self-consistently and simultaneously apply multiple empirical calibrations to fully characterize the mass, luminosity, radius, and effective temperature of a field age M-dwarf. This framework includes a new M-dwarf mass–radius relation with a scatter of 3.1% at fixed mass. We further introduce the M-dwarf Ultraviolet Spectroscopic Sample (MUSS), and apply our methodology to provide consistent stellar parameters for these nearby low-mass stars, selected as having available spectroscopic data in the ultraviolet. These targets are of interest largely as either exoplanet hosts or benchmarks in multiwavelength stellar activity. We use the field MUSS stars to define a low-mass main sequence in the solar neighborhood through Gaussian Process (GP) regression. These results enable us to empirically measure a feature in the GP derivative at M ⊙ that indicates where the MUSS transitions from fully to partly convective interiors.

J. Sebastian Pineda↗
NASA NTRS2023

Modelling the Greenland Ice Sheet's Committed Contribution to Sea Level During the 21st Century

Mass loss from the Greenland Ice Sheet can be partitioned between surface mass balance and discharge due to ice dynamics through its marine-terminating outlet glaciers. A perturbation to a glacier terminus (e.g., a calving event) results in both an instantaneous response in velocity and mass loss and a diffusive response due to the evolution of ice thickness over time. This diffusive response means the total impact of a retreat event can take decades to be fully realized. Here we model the committed response of the Greenland Ice Sheet by applying perturbations to the marine-terminating glacier termini that represent recent observed changes, and simulating the response over the 21st century, while holding the climate forcing constant. The sensitivity of the ice sheet response to model parameter uncertainty is explored within an ensemble framework, and Gravity Recovery and Climate Experiment data is used to constrain the results using a Bayesian calibration approach. We find that the Greenland Ice Sheet's committed contribution to 21st century sea level rise is at least 33.5 [17.5 52.4] mm (25th and 75th percentiles in brackets), with at least 6 mm being attributable directly to terminus retreat that occurred between 2007 and 2015. The spread in our projections is driven by uncertainty in the basal friction coefficient. Our results complement the ISMIP6 Greenland projections, which report the ice sheet response to future forcing, excluding the background response. In this way, we can obtain estimates of Greenland's total contribution to sea level rise in 2100.

Isabel J. Nias↗
NASA NTRSDate not supplied

Stochastic Reconstruction of Thermal Protection Material Properties from Arc-Jet Experiments

Material response models are used to assess reliability using variances in the bond-line temperature predictions based on uncertainties in trajectory, aerothermal environment, and material properties. A key deficiency in the current approach is that input uncertainties are too often subjective, empirical, or ad-hoc, and are not rigorously linked to the arc-jet test data used to develop the TPS material model. While materials such as PICA are well understood, future missions may require more novel materials such as HEEET where unknown uncertainties have real consequences on the ability to assess reliability. A quantifiable estimate of reliability requires an iterative methodology where the parameters driving the variance in bond-line temperature (for example) are systematically identified. A test campaign to collect data or develop new models can then be identified to reduce those input uncertainties. A Bayesian inference loop defines these connections mathematically, i.e., prior knowledge about uncertainty is updated based on observation. While these concepts are well known (and often applied intuitively in a non-rigorous approach), only recent advances in reduced-order modelling have made them computationally viable methods for engineering. By replacing deterministic inverse methods with stochastic approaches, the hope is new materials proposed for future missions can more rapidly be developed with a greater understanding of the TPS material reliability. Two additional steps for the analysis of arc jet test data are discussed. The first is ability to construct a reduced-order model using material response simulations (Icarus/US3D) of the arc-jet test articles, and the second is the inclusion of this surrogate model in the Bayesian inversion process. Both capabilities will be demonstrated using prior PICA arc-jet test data. The quality of a surrogate model will be investigated and the variances on the calibrated material properties will be compared to our current understanding of the PICA material model.

Material response↗
NASA NTRS2019

Deep Learning and Uncertainty Quantification for Climate Resilience

Modeling and monitoring of earth’s processes through physical models and satellite observations at high resolutions is crucial for ensuring society’s ability to adapt to climate change. Deep learning (DL) has been shown to be a valuable tool for generating high resolution data, emulating physical models, and detecting weather patterns which can then be used to inform stakeholders and decision makers. However, both the data and model parameters contain substantial uncertainties that may alter users’ decisions. In this work we present two DL applications on high-resolution climate and satellite datasets using Bayesian neural networks to generate well calibrated uncertainty estimates.

Vandal, Thomas↗
NASA NTRS2019

Uncertainty in Soil Moisture Retrievals: an Ensemble Approach Using SMOS L-Band Microwave Data

The uncertainty of soil moisture (SM) retrievals from satellite brightness temperature (TB) observations depends primarily on the choice of radiative transfer model (RTM) parameters, prior SM information and TB inputs. This paper studies the sensitivity of several (quasi-)operational and experimental SM retrieval products from the Soil Moisture Ocean Salinity (SMOS) mission to these choices at 11 reference sites, located in 7 watersheds across the United States (US). Different literature-based RTM parameter sets cause large biases between retrievals. Whereas typical RTM parameter sets are calibrated for SM retrievals, it is shown that a parameter set carefully optimized for TB forward modeling can also be used for retrieving SM. It is also shown that the inclusion of dynamic prior SM estimates in a Bayesian retrieval scheme can strongly improve SM retrievals, regardless of the choice of RTM parameters, and that the use of multi-angular and multi-polarization TB does not necessarily lead to superior retrievals compared to retrievals based on TB data at a single incidence angle and polarization. The second part of this paper evaluates ensemble uncertainty metrics for SM retrievals obtained by propagating a wide range of RTM parameters through the RTM. As expected for bounded variables, the spread in the ensemble SM retrievals is smallest for wet and dry SM values and highest for intermediate SM values. After removal of the strong long-term mean bias associated with the RTM parameter values for individual ensemble members, the remaining anomaly ensemble SM spread of 0.037 cu m/cu m approximates the actual time series unbiased root-mean-square-difference of 0.042 cu m/cu m between ensemble mean retrievals and in situ reference data across the reference sites. However, the temporal variability in the anomaly ensemble spread reveals higher-order biases in the retrieval error, which should be accounted for when characterizing retrieval error.

Jan Quets↗
NASA NTRS2009

Combining Satellite Microwave Radiometer and Radar Observations to Estimate Atmospheric Latent Heating Profiles

In this study, satellite passive microwave sensor observations from the TRMM Microwave Imager (TMI) are utilized to make estimates of latent + eddy sensible heating rates (Q1-QR) in regions of precipitation. The TMI heating algorithm (TRAIN) is calibrated, or "trained" using relatively accurate estimates of heating based upon spaceborne Precipitation Radar (PR) observations collocated with the TMI observations over a one-month period. The heating estimation technique is based upon a previously described Bayesian methodology, but with improvements in supporting cloud-resolving model simulations, an adjustment of precipitation echo tops to compensate for model biases, and a separate scaling of convective and stratiform heating components that leads to an approximate balance between estimated vertically-integrated condensation and surface precipitation. Estimates of Q1-QR from TMI compare favorably with the PR training estimates and show only modest sensitivity to the cloud-resolving model simulations of heating used to construct the training data. Moreover, the net condensation in the corresponding annual mean satellite latent heating profile is within a few percent of the annual mean surface precipitation rate over the tropical and subtropical oceans where the algorithm is applied. Comparisons of Q1 produced by combining TMI Q1-QR with independently derived estimates of QR show reasonable agreement with rawinsonde-based analyses of Q1 from two field campaigns, although the satellite estimates exhibit heating profile structure with sharper and more intense heating peaks than the rawinsonde estimates. 2

Grecu, Mircea↗
NASA NTRS2008

Hybrid Gibbs Sampling and MCMC for CMB Analysis at Small Angular Scales

A) Gibbs Sampling has now been validated as an efficient, statistically exact, and practically useful method for "low-L" (as demonstrated on WMAP temperature polarization data). B) We are extending Gibbs sampling to directly propagate uncertainties in both foreground and instrument models to total uncertainty in cosmological parameters for the entire range of angular scales relevant for Planck. C) Made possible by inclusion of foreground model parameters in Gibbs sampling and hybrid MCMC and Gibbs sampling for the low signal to noise (high-L) regime. D) Future items to be included in the Bayesian framework include: 1) Integration with Hybrid Likelihood (or posterior) code for cosmological parameters; 2) Include other uncertainties in instrumental systematics? (I.e. beam uncertainties, noise estimation, calibration errors, other).

Gibbs sampling↗
NASA NTRS1989

Filtering information from human experts

The authors propose a model, or filter, for debiasing opinions from multiple experts and combining them into a single consistent estimate of some variable of interest. A distinguishing feature of the approach consists of making the calibration of experts an integral part of filtering. This enables the filter to learn from previous experience with the experts. The theoretical development takes a Bayesian perspective, using de Finetti's (1964) notion of exchangeability. Experimental results with a preliminary computer implementation of the filter show that its estimates are better than those from comparable filters that do not involve calibration.

Mendel, Max B.↗
NASA NTRS2014

A Practical Philosophy of Complex Climate Modelling

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project (CMIP).We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naive predictions. The framework we use for making inferences about reality using simulations is naturally Bayesian (in an informal sense), and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work.

complex simulation↗