Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

SNL will be able to provide well-calibrated models to weapons systems analysts by integrating an engine for constitutive model calibration with the GRANTA materials database

Researchers at Sandia National Laboratories have integrated the GRANTA materials database with the MatCal calibration engine to calibrate material models from characterization data. GRANTA is gaining acceptance across the NNSA Tri-lab complex and is being populated with weapons-specific test data by Sandia experimentalists. To use that data to create material models for use by weapons systems analysts, MatCal has been enabled import calibration data and test conditions from GRANTA to quickly and reproducibly produce a calibrated set of parameters for a given constitutive model. The team is currently working to store the parameters characterizing material behavior in GRANTA to make them accessible by all weapons analysts.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Embedded Model Error Representation for Bayesian Model Calibration

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy, is often the largest contributor to the overall predictive uncertainty. This work builds on a recently developed framework of embedded, internal model correction, in order to represent and quantify structural errors, together with model parameters,within a Bayesian inference context. We focus specifically on a Polynomial Chaos representation with additive modification of existing model parameters, enabling a non-intrusive procedure for efficient approximate likelihood construction, model error estimation, and disambiguation of model and data errors’ contributions to predictive uncertainty. The framework is demonstrated on several synthetic examples, as well as on a chemical ignition problem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Flood hazard model calibration using multiresolution model output

Riverine floods pose a considerable risk to many communities. Improving flood hazard projections has the potential to inform the design and implementation of flood risk management strategies. Current flood hazard projections are uncertain, especially due to uncertain model parameters. Calibration methods use observations to quantify model parameter uncertainty. With limited computational resources, researchers typically calibrate models using either relatively few expensive model runs at high spatial resolutions or many cheaper runs at lower spatial resolutions. This leads to an open question: is it possible to effectively combine information from the high and low resolution model runs? We propose a Bayesian emulation–calibration approach that assimilates model outputs and observations at multiple resolutions. As a case study for a riverine community in Pennsylvania, we demonstrate our approach using the LISFLOOD-FP flood hazard model. Here, the multiresolution approach results in improved parameter inference over the single resolution approach in multiple scenarios. Results vary based on the parameter values and the number of available models runs. Our method is general and can be used to calibrate other high dimensional computer models to improve projections.

multiresolution↗
DOE OSTI2021

Discrete-Direct Model Calibration and Uncertainty Propagation Method Confirmed on Multi-Parameter Plasticity Model Calibrated to Sparse Random Field Data

A discrete direct (DD) model calibration and uncertainty propagation approach is explained and demonstrated on a 4-parameter Johnson-Cook (J-C) strain-rate dependent material strength model for an aluminum alloy. The methodology's performance is characterized in many trials involving four random realizations of strain-rate dependent material-test data curves per trial, drawn from a large synthetic population. The J-C model is calibrated to particular combinations of the data curves to obtain calibration parameter sets which are then propagated to “Can Crush” structural model predictions to produce samples of predicted response variability. These are processed with appropriate sparse-sample uncertainty quantification (UQ) methods to estimate various statistics of response with an appropriate level of conservatism. This is tested on 16 output quantities (von Mises stresses and equivalent plastic strains) and it is shown that important statistics of the true variabilities of the 16 quantities are bounded with a high success rate that is reasonably predictable and controllable. The DD approach has several advantages over other calibration-UQ approaches like Bayesian inference for capturing and utilizing the information obtained from typically small numbers of replicate experiments in model calibration situations—especially when sparse replicate functional data are involved like force–displacement curves from material tests. The DD methodology is straightforward and efficient for calibration and propagation problems involving aleatory and epistemic uncertainties in calibration experiments, models, and procedures.

42 ENGINEERING↗
DOE OSTI2022

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Linking big models to big data: efficient ecosystem model calibration through Bayesian model emulation

Data-model integration plays a critical role in assessing and improving our capacity to predict ecosystem dynamics. Similarly, the ability to attach quantitative statements of uncertainty around model forecasts is crucial for model assessment and interpretation and for setting field research priorities. Bayesian methods provide a rigorous data assimilation framework for these applications, especially for problems with multiple data constraints. However, the Markov chain Monte Carlo (MCMC) techniques underlying most Bayesian calibration can be prohibitive for computationally demanding models and large datasets. We employ an alternative method, Bayesian model emulation of sufficient statistics, that can approximate the full joint posterior density, is more amenable to parallelization, and provides an estimate of parameter sensitivity. Analysis involved informative priors constructed from a meta-analysis of the primary literature and specification of both model and data uncertainties, and it introduced novel approaches to autocorrelation corrections on multiple data streams and emulating the sufficient statistics surface. We report the integration of this method within an ecological workflow management software, Predictive Ecosystem Analyzer (PEcAn), and its application and validation with two process-based terrestrial ecosystem models: SIPNET and ED2. In a test against a synthetic dataset, the emulator was able to retrieve the true parameter values. A comparison of the emulator approach to standard brute-force MCMC involving multiple data constraints showed that the emulator method was able to constrain the faster and simpler SIPNET model's parameters with comparable performance to the brute-force approach but reduced computation time by more than 2 orders of magnitude. The emulator was then applied to calibration of the ED2 model, whose complexity precludes standard (brute-force) Bayesian data assimilation techniques. Both models are constrained after assimilation of the observational data with the emulator method, reducing the uncertainty around their predictions. Performance metrics showed increased agreement between model predictions and data. Our study furthers efforts toward reducing model uncertainties, showing that the emulator method makes it possible to efficiently calibrate complex models.

58 GEOSCIENCES↗
DOE OSTI2022

NIR Dataset and Models (Near-Infrared Spectroscopy Calibration Dataset for Butanediol Fermentation and Multivariate Calibration Models) [SWR-22-60]

2,3-butanediol (2,3-BDO) is an economically important platform chemical that can be used in a variety of chemical feedstocks, liquid fuels, and biosynthetic building blocks. While 2,3-BDO can be efficiently produced by fermentation, the fermentation requires continuous monitoring and control to maximize 2,3-BDO yields and minimize inhibitory coproducts. Because of the time required for sampling and at-line measurement of fermentation samples with high pressure liquid chromatography (HPLC), the ability for operators to perform real-time modification to fermentation conditions is limited. To overcome this challenge, researchers from the National Renewable Energy Laboratory (NREL) have developed a calibration model which can predict the concentration of several analytes in real-time using near-infrared (NIR) spectra of the filtered fermentation broth. While significantly reducing the need for off-line sampling, NREL expects this technology to play a critical role in maximizing 2,3-BDO production. 2,3-butanediol (2,3-BDO) is a useful chemical platform that can be used to create a variety of products. For instance, 2,3-BDO can be (1) dehydrated and converted into methyl ethyl ketone, a liquid fuel additive or (2) deoxydehydrated into 1,3-butadiene for synthetic rubber, which can also be oligomerized in high yields to gasoline, diesel, and jet fuel. In order to maximize 2,3-BDO production, frequent measurement of fermentation samples is needed, as small changes in oxygen concentration can drive the fermentation to undesired products. For example, oxygen-deficient conditions result in glycerol production, while excess oxygen concentrations result in acetoin production. This results in the need for measuring dissolved oxygen, glucose, and xylose concentrations in order to optimize the aeration rate of the fermentation. Traditional monitoring methods occurs off-line and can take up to 30 minutes per sample. With multiple fermenters and high-pressure liquid chromatography (HPLC) injectors, resulting in the need for multiple samples, the sampling process can take hours to complete. NREL’s calibration model can predict the glucose, xylose, 2,3-BDO, acetoin, and glycerol concentrations from NIR spectra of filtered fermentation liquor samples. Using a partial least-squares (PLS) calibration model, NREL’s model can monitor the concentration of these analytes during subsequent fermentations at bench- and pilot-scale, demonstrating the utility of NIR spectroscopy combined with chemometrics for real-time, at-line monitoring of 2,3-BDO fermentations.

Wolfrum, Edward↗
DOE OSTI2020

Fast matrix algebra for Bayesian model calibration

In Bayesian model calibration, evaluation of the likelihood function usually involves finding the inverse and determinant of a covariance matrix. When Markov Chain Monte Carlo (MCMC) methods are used to sample from the posterior, hundreds of thousands of likelihood evaluations may be required. In this paper, we demonstrate that the structure of the covariance matrix can be exploited, leading to substantial time savings in practice. Here, we also derive two simple equations for approximating the inverse of the covariance matrix in this setting, which can be computed in near-quadratic time. The practical implications of these strategies are demonstrated using a simple numerical case study and the "quack" R package. For a covariance matrix with 1000 rows, application of these strategies for a million likelihood evaluations leads to a speedup of roughly 4000 compared to the naive implementation

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2019

Empirical Absolute Calibration Model for Multiple Pseudo-Invariant Calibration Sites

This work extends an empirical absolute calibration model initially developed for the Libya 4 Pseudo-Invariant Calibration Site (PICS) to five additional Saharan Desert PICS (Egypt 1, Libya 1, Niger 1, Niger 2, and Sudan 1), and demonstrates the efficacy of the resulting models at predicting sensor top-of-atmosphere (TOA) reflectance. It attempts to generate absolute calibration models for these PICS that have an accuracy and precision comparable to or better than the current Libya 4 model, with the intent of providing additional opportunities for sensor calibration. In addition, this work attempts to validate the general applicability of the model to other sites. The method uses Terra Moderate Resolution Imaging Spectroradiometer (MODIS) as the reference radiometer and Earth Observing-1 (EO-1) Hyperion image data to provide a representative hyperspectral reflectance profile of the PICS. Data from a region of interest (ROI) in an “optimal region” of 3% temporal, spatial, and spectral stability within the PICS are used for developing the model. The developed models were used to simulate observations of the Landsat 7 (L7) Enhanced Thematic Mapper Plus (ETM+), Landsat 8 (L8) Operational Land Imager (OLI), Sentinel 2A (S2A) MultiSpectral Instrument (MSI) and Sentinel 2B (S2B) MultiSpectral Instrument (MSI) from their respective launch date through 2018. The models developed for the Egypt 1, Libya 1 and Sudan 1 PICS have an estimated accuracy of approximately 3% and precision of approximately 2% for the sensors used in the study, comparable to the current Libya 4 model. The models developed for the Niger 1 and Niger 2 sites are significantly less accurate with similar precision.

Raut, Bipin↗
DOE OSTI2025

Model Calibration with Markov Chain Monte Carlo Tutorial

The purpose of this tutorial is to demonstrate how to use Markov chain Monte Carlo (MCMC) to calibrate a model. By calibration, we mean the selection of model parameters (and, when relevant, structures). A common goal in model development and diagnostics is calibration, or the identification of model structures and parameters which are consistent with data. While models can be calibrated through hand-tuning parameters or minimizing simple error metrics such as root-mean-square-error (RMSE), these approaches can underrepresent the probabilistic nature of the data-generating process, as well as the potential for multiple model configurations to be consistent with the data. Probabilistic uncertainty quantification, which is the topic of this notebook, can address these concerns. This tutorial is presented as an appendix to the e-book: Addressing Uncertainty in MultiSector Dynamics Research.

Markov chain Monte Carlo↗
DOE OSTI2022

Building Model Calibration: Validation of GridLAB-D Thermal Dynamics Modeling

This report investigates how well GridLAB-D’s house model characterizes the thermal dynamics of buildings given the overpredicted diurnal electric load swing observed in the Distribution System Operation with Transactive (DSO+T) study. This study seeks to validate GridLAB-D’s house model by calibrating it to data from the well-instrumented Pacific Northwest National Laboratory Lab Homes in Richland, WA. The datasets chosen included multiple pre-cooling and pre-heating testing periods where the indoor air temperature was allowed to float over a multi-hour length of time to mimic diurnal behavior. The multi-season calibrations were evaluated by comparing the heating/cooling electric power, indoor air temperature, and the rise/decay time during temperature float periods with Lab Homes data. The default GridLAB-D assumptions for latent load fraction, air heat capacity, mass heat capacity, window-to-wall-ratio, overall envelope conductance (assumed as NORMAL thermal integrity level), and solar heat gain coefficient were compared with the calibrated model to confirm when the default assumptions were adequate and the impact of calibration on the accuracy of modeling the thermal dynamics of homes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2009

Model Calibration in Watershed Hydrology

Hydrologic models use relatively simple mathematical equations to conceptualize and aggregate the complex, spatially distributed, and highly interrelated water, energy, and vegetation processes in a watershed. A consequence of process aggregation is that the model parameters often do not represent directly measurable entities and must, therefore, be estimated using measurements of the system inputs and outputs. During this process, known as model calibration, the parameters are adjusted so that the behavior of the model approximates, as closely and consistently as possible, the observed response of the hydrologic system over some historical period of time. This Chapter reviews the current state-of-the-art of model calibration in watershed hydrology with special emphasis on our own contributions in the last few decades. We discuss the historical background that has led to current perspectives, and review different approaches for manual and automatic single- and multi-objective parameter estimation. In particular, we highlight the recent developments in the calibration of distributed hydrologic models using parameter dimensionality reduction sampling, parameter regularization and parallel computing.

Yilmaz, Koray K.↗
DOE OSTI2018

Geomechanical Simulation of Big Hill Strategic Petroleum Reserve (Model Calibration)

A finite element numerical analysis model has been constructed that consists of a realistic mesh capturing the geometries of Big Hill (BH) Strategic Petroleum Reserve (SPR) site using the multi-mechanism deformation (M-D) salt constitutive model and including data taken daily of the wellhead pressure and level of the oil-brine interface. The salt creep rate is not uniform in the salt dome, and creep test data for BH salt is limited. Therefore, a model calibration is necessary to simulate the geomechanical behavior of the salt dome. Cavern volumetric closures of SPR caverns calculated from sonar survey reports are used for the field baseline measurement. The structure factor, A 2 , and transient strain limit factor, K o , in the M-D constitutive model are used for model calibration. An A 2 value obtained experimentally from the BH salt and K o value of WIPP salt are used as the baseline values. To adjust the magnitude of A 2 and K o , multiplication factors A2F and KOF are defined, respectively. The A2F and KOF values of the salt dome and salt drawdown layer of elements surrounding each SPR cavern have been determined through a number of back fitting analyses. The trendlines of the predictions and sonar data match up well for BH 101, 103, 104, 106, 110, 111, and 113. The prediction curves are close to the sonar data for BH 102 and 114. However, the prediction curves for BH 105, 107, 108, 109, and 112 are not close to the sonar data. An inconsistency was found in the sonar data, i.e. the sonar measurements of cavern volumes increase with time, during some periods for BH 101, 104, 106, 107, and 112. A follow-up report in 2019 will provide a resolution for these issues.

02 PETROLEUM↗
DOE OSTI2024

Advancing earth system model calibration: a diffusion-based method

Understanding of climate impact on ecosystems globally requires site-specific model calibration. Here we introduce a novel diffusion-based uncertainty quantification (DBUQ) method for efficient model calibration. DBUQ is a score-based diffusion model that leverages Monte Carlo simulation to estimate the score function and evaluates a simple neural network to quickly generate samples for approximating parameter posterior distributions. DBUQ is stable, efficient, and can effectively calibrate the model given diverse observations, thereby enabling rapid and site-specific model calibration on a global scale. This capability significantly advances Earth system modeling and our understanding of climate impacts on Earth systems. We demonstrate DBUQ's capability in E3SM land model calibration at the Missouri Ozark AmeriFlux forest site. Both synthetic and real-data applications indicate that DBUQ produces accurate parameter posterior distributions similar to those generated by Markov Chain Monte Carlo sampling but with 30X less computing time. This efficiency marks a significant stride in model calibration, paving the way for more effective and timely climate impact analyses.

Liu, Yanfang↗