Interlaced Characterization and Calibration: In-situ Bayesian optimal experimental design for constitutive model calibration
Explore the source record for details and available documents.
Ricciardi, Denielle↗
SEARCH · Search NASA
Results for “MODEL CALIBRATION”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Autotune Calibrates Models to Building Use Data
Models of existing buildings are currently unreliable unless calibrated manually by a skilled professional. Autotune, as the name implies, automates this process by calibrating the model of an existing building to measured data, and is now available as open source software. This enables private businesses to incorporate Autotune into their products so that their customers can more effectively estimate cost savings of reduced energy consumption measures in existing buildings.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Confirmation of Discrete-Direct Calibration and Uncertainty Propagation for a Multi-Parameter Plasticity Model calibrated to Sparse Random Field Data.
Abstract not provided.
Romero, Vicente J.↗
Microsimulation model calibration using incremental mixture approximate Bayesian computation
Microsimulation models (MSMs) are used to inform policy by predicting population-level outcomes under different scenarios. MSMs simulate individual-level event histories that mark the disease process (such as the development of cancer) and the effect of policy actions (such as screening) on these events. MSMs often have many unknown parameters; calibration is the process of searching the parameter space to select parameters that result in accurate MSM prediction of a wide range of targets. We develop Incremental Mixture Approximate Bayesian Computation (IMABC) for MSM calibration which results in a simulated sample from the posterior distribution of model parameters given calibration targets. IMABC begins with a rejection-based ABC step, drawing a sample of points from the prior distribution of model parameters and accepting points that result in simulated targets that are near observed targets. Next, the sample is iteratively updated by drawing additional points from a mixture of multivariate normal distributions and accepting points that result in accurate predictions. Posterior estimates are obtained by weighting the final set of accepted points to account for the adaptive sampling scheme. We demonstrate IMABC by calibrating CRC-SPIN 2.0, an updated version of a MSM for colorectal cancer (CRC) that has been used to inform national CRC screening guidelines.
97 MATHEMATICS AND COMPUTING↗
Model Calibration Efforts for the International Space Station's Solar Array Mast
The International Space Station (ISS) relies on sixteen solar-voltaic blankets to provide electrical power to the station. Each pair of blankets is supported by a deployable boom called the Folding Articulated Square Truss Mast (FAST Mast). At certain ISS attitudes, the solar arrays can be positioned in such a way that shadowing of either one or three longerons causes an unexpected asymmetric thermal loading that if unchecked can exceed the operational stability limits of the mast. Work in this paper documents part of an independent NASA Engineering and Safety Center effort to assess the existing operational limits. Because of the complexity of the system, the problem is being worked using a building-block progression from components (longerons), to units (single or multiple bays), to assembly (full mast). The paper presents results from efforts to calibrate the longeron components. The work includes experimental testing of two types of longerons (straight and tapered), development of Finite Element (FE) models, development of parameter uncertainty models, and the establishment of a calibration and validation process to demonstrate adequacy of the models. Models in the context of this paper refer to both FE model and probabilistic parameter models. Results from model calibration of the straight longerons show that the model is capable of predicting the mean load, axial strain, and bending strain. For validation, parameter values obtained from calibration of straight longerons are used to validate experimental results for the tapered longerons.
Elliott, Kenny B.↗
Compressively strained SiGe band-to-band tunneling model calibration based on p-i-n diodes and prospect of strained SiGe tunneling field-effect transistors
Band-to-band tunneling parameters of strained indirect bandgap materials are not well-known, hampering the reliability of performance predictions of tunneling devices based on these materials. The nonlocal band-to-band tunneling model for compressively strained SiGe is calibrated based on a comparison of strained SiGe p-i-n tunneling diode measurements and doping-profile-based diode simulations. Dopant and Ge profiles of the diodes are determined by secondary ion mass spectrometry and capacitance-voltage measurements. Theoretical parameters of the band-to-band tunneling model are calculated based on strain-dependent properties such as bandgap, phonon energy, deformation-potential-based electron-phonon coupling, and hole effective masses of strained SiGe. The latter is determined with a 6-band k·p model. The calibration indicates an underestimation of the theoretical electron-phonon coupling with nearly an order of magnitude. Prospects of compressively strained SiGe tunneling transistors are made by simulations with the calibrated model.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Assessing mechanical response of CO 2 storage into a depleted carbonate reef using a site-scale geomechanical model calibrated with field tests and InSAR monitoring data
Geomechanical risks of injection have raised concerns regarding secure CO 2 storage. In this work, a combined monitoring and modeling approach is used to assess the stress changes and surface uplift associated with CO 2 injection into a depleted carbonate reef of the Michigan basin. A site-scale geomechanical model is built by assigning mechanical properties of formations using well-log and experimental data. Gravity load is applied to the model to estimate the vertical component of stress as well as different lateral boundary displacement scenarios to estimate horizontal stresses. We used a poroelastic pressure-dependent model (instead of a linear elastic mechanical earth model) to calibrate initial stresses using hydraulic fracture test data measured at depleted reservoir status. Multi-phase fluid flow-geomechanical simulations are performed to estimate the poroelastic response during (1) primary depletion (2) field-scale CO 2 injection phase (3) a hypothetical forecast scenario in which well bottom hole pressure (BHP) reach 45000 KPa. The predicted surface uplift is less than 1 mm at the end of the field-scale CO 2 injection phase which is in good agreement with Interferometric Synthetic Aperture Radar (InSAR) uplift measurement. Although the InSAR data shows an insignificant uplift, hydromechanical modeling of injection shows that CO 2 injection still causes reservoir deformation emphasizing the role of carbonate overburden and reservoir formation mechanical properties and limited size of reef on diminishing the surface deformation. Modeling indicates poroelastic response of caprock matters to estimate uplift. The lower permeability of the top two layers provides additional barrier to large uplift. Also, history of subsidence due to production should be accounted to predict uplift due to a follow up injection correctly. This report shows the significance of combining a calibrated geomechanical model with field measured stresses and monitoring data to be used as a tool to ensure the safety of CO 2 storage.
42 ENGINEERING↗
Using Machine Learning to Generate a GISS ModelE Calibrated Physics Ensemble (CPE)
A neural network (NN) surrogate of the NASA GISS ModelE atmosphere (version E3) is trained on a perturbed parameter ensemble (PPE) spanning 45 physics parameters and 36 outputs. The NN is leveraged in a Markov Chain Monte Carlo (MCMC) Bayesian parameter inference framework to generate a second posterior constrained ensemble coined a “calibrated physics ensemble,” or CPE. The CPE members are characterized by diverse parameter combinations and are, by definition, close to top-of-atmosphere radiative balance, and must broadly agree with numerous hydrologic, energy cycle and radiative forcing metrics simultaneously. Global observations of numerous cloud, environment, and radiation properties (provided by global satellite products) are crucial for CPE generation. The inference framework explicitly accounts for discrepancies (or biases) in satellite products during CPE generation. We demonstrate that product discrepancies strongly impact calibration of important model parameter settings (e.g., convective plume entrainment rates; fall speed for cloud ice). Structural improvements new to E3 are retained across CPE members (e.g., stratocumulus simulation). Notably, the framework improved the simulation of shallow cumulus and Amazon rainfall while not degrading radiation fields, an upgrade that neither default parameters nor Latin Hypercube parameter searching achieved. Analyses of the initial PPE suggested several parameters were unimportant for output variation. However, many “unimportant” parameters were needed for CPE generation, a result that brings to the forefront how parameter importance should be determined in PPEs. From the CPE, two diverse 45-dimensional parameter configurations are retained to generate radiatively-balanced, auto-tuned atmospheres that were used in two E3 submissions to CMIP6.
54 ENVIRONMENTAL SCIENCES↗
Calibration Modeling Methodology to Optimize Performance for Low Range Applications
Calibration is a vital process in characterizing the performance of an instrument in an application environment and seeks to obtain acceptable accuracy over the entire design range. Often, project requirements specify a maximum total measurement uncertainty, expressed as a percent of full-scale. However in some applications, we seek to obtain enhanced performance at the low range, therefore expressing the accuracy as a percent of reading should be considered as a modeling strategy. For example, it is common to desire to use a force balance in multiple facilities or regimes, often well below its designed full-scale capacity. This paper presents a general statistical methodology for optimizing calibration mathematical models based on a percent of reading accuracy requirement, which has broad application in all types of transducer applications where low range performance is required. A case study illustrates the proposed methodology for the Mars Entry Atmospheric Data System that employs seven strain-gage based pressure transducers mounted on the heatshield of the Mars Science Laboratory mission.
McCollum, Raymond A.↗
Thermal-Mechanical Elastic-Plastic and Ductile Failure Model Calibrations for 304L Stainless Steel Alloy
Numerical simulations of metallic structures undergoing rapid loading into the plastic range require material models that accurately represent the response. In general, the material response can be seen as having four interrelated parts: the baseline response under slow loading, the effect of strain rate, the conversion of plastic work into heat and the effect of temperature. In essence, the material behaves in a thermal-mechanical manner if the loading is fast enough so when heat is generated by plastic deformation it raises the temperature and therefore influences the mechanical response. In these cases, appropriate models that can capture the aspects listed above are necessary. The material of interest here is 304L stainless steel, and the objective of this work is to calibrate thermal-mechanical models: one for the constitutive behavior and another for failure. The work was accomplished by first designing and conducting a material test program to provide data for the calibration of the models. The test program included uniaxial tension tests conducted at room temperature, 150 and 300 C and at strain rates between 10 –4 and 10 3 1/s. It also included notched tension and shear-dominated compression hat tests specifically designed to calibrate the failure model. All test specimens were extracted from a single piece of plate to maintain consistency. The constitutive model adopted was a modular $J_2$ plasticity model with isotropic hardening that included rate and temperature dependence. A criterion for failure initiation based on a critical value of equivalent plastic strain fitted the failure data appropriately and was adopted. Possible ranges of the values of the parameters of the models were determined partially on historical data from calibrations of the same alloy from other lots and are given here. The calibration of the parameters of the models were based on finite element simulations of the various material tests using relatively ne meshes and hexahedral elements. When using the model in structural finite element calculations, however, element formulations and sizes different from those in the calibration are likely to be used. A brief investigation demonstrated that the failure initiation predictions can be particularly sensitive to the element selection and provided an initial guide to compensate for the effect of element size in a specific example.
36 MATERIALS SCIENCE↗
SURF Model Calibration Strategy
SURF and SURFplus are high explosive reactive burn models for shock initiation and propagation of detonation waves. They are engineering models motivated by the ignition & growth concept of high spots and for SURFplus a second slow reaction for the energy release from carbon clustering. A key feature of the SURF model is that there is a partial decoupling between model parameters and detonation properties. This enables reduced sets of independent parameters to be calibrated sequentially for the initiation and propagation regimes. Here we focus on a methodology for tting the initiation parameters to Pop plot data based on 1-D simulations to compute a numerical Pop plot. In addition, the strategy for tting the remaining parameters for the propagation regime and failure diameter is discussed.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
A SCR Model Calibration Approach with Spatially Resolved Measurements and NH 3 Storage Distributions
The selective catalytic reduction (SCR) is a technology used for reducing NO x emissions in the heavy-duty diesel (HDD) engine exhaust. In this study, the spatially resolved capillary inlet infrared spectroscopy (Spaci-IR) technique was used to study the gas concentration and NH 3 storage distributions in a SCR catalyst, and to provide data for developing a SCR model to analyze the axial gaseous concentration and axial distributions of NH 3 storage. A two-site SCR model is described for simulating the reaction mechanisms. The model equations and a calculation method was developed using the Spaci-IR measurements to determine the NH 3 storage capacity and the relationships between certain kinetic parameters of the model. Moreover, a calibration approach was then applied for tuning the kinetic parameters using the spatial gaseous measurements and calculated NH3 storage as a function of axial position instead of inlet and outlet gaseous concentrations of NO, NO 2 , and NH 3 . The equations and the approach for determining the NH 3 storage capacity of the catalyst and a method of dividing the NH 3 storage capacity between the two storage sites are presented. It was determined that the kinetic parameters of the adsorption and desorption reactions have to follow certain relationships for the model to simulate the experimental data. Finally, the modeling results served as a basis for developing full model calibrations to SCR lab reactor and engine data and state estimator development as described in the references (Song et al. 2013a, b; Surenahalli et al. 2013).
54 ENVIRONMENTAL SCIENCES↗
Recent Improvements to the Calibration Models for RXTE/PCA
We are updating the calibration of the PCA to correct for slow variations, primarily in energy to channel relationship. We have also improved the physical model in the vicinity of the Xe K-edge, which should increase the reliability of continuum fits above 20 keV. The improvements to the matrix are especially important to simultaneous observations, where the PCA is often used to constrain the continuum while other higher resolution spectrometers are used to study the shape of lines and edges associated with Iron.
Jahoda, K.↗
GoldSim E-Area Low-Level Waste Facility Aquifer Zone Model Calibration Methodology
This report documents the development and calibration of the E-Area Low-Level Waste Facility (ELLWF) Gold Sim aquifer model. It provides a methodology on how a Gold Sim aquifer model can be calibrated to specific PORFLOW-based aquifer predictions. The calibration activity presented within this report focuses on the Slit Trench #06 (ST06) location that resides within the center set of Slit Trenches. This Gold Sim-based aquifer model is a generic model capable of being calibrated to any of the other trench locations within E-Area. In addition, subsequent activities (beyond the scope of this effort) will couple this GoldSim-based aquifer model to various GoldSim-based trench models, with the intent of performing stochastic analyses that couple all pertinent fate and transport processes from the ground surface up to the 100-m point of assessment (POA).
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Robust Importance Sampling for Bayesian Model Calibration with Spatio-Temporal Data
This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.
97 MATHEMATICS AND COMPUTING↗
Atmospheric drag model calibrations for spacecraft lifetime prediction
Although solar activity prediction uncertainty normally dominates decay prediction error budget for near-Earth spacecraft, the effect of drag force modeling errors for given levels of solar activity needs to be considered. Two atmospheric density models, the modified Harris-Priester model and the Jacchia-Roberts model, to reproduce the decay histories of the Solar Mesosphere Explorer (SME) and Solar Maximum Mission (SMM) spacecraft in the 490- to 540-kilometer altitude range were analyzed. Historical solar activity data were used in the input to the density computations. For each spacecraft and atmospheric model, a drag scaling adjustment factor was determined for a high-solar-activity year, such that the observed annual decay in the mean semimajor axis was reproduced by an averaged variation-of-parameters (VOP) orbit propagation. The SME (SMM) calibration was performed using calendar year 1983 (1982). The resulting calibration factors differ by 20 to 40 percent from the predictions of the prelaunch ballistic coefficients. The orbit propagations for each spacecraft were extended to the middle of 1988 using the calibrated drag models. For the Jaccia-Roberts density model, the observed decay in the mean semimajor axis of SME (SMM) over the 4.5-year (5.5-year) predictive period was reproduced to within 1.5 (4.4) percent. The corresponding figure for the Harris-Priester model was 8.6 (20.6) percent. Detailed results and conclusions regarding the importance of accurate drag force modeling for lifetime predictions are presented.
Binebrink, A. L.↗
Quantifying Groundwater Response and Uncertainty in Beaver‐Influenced Mountainous Floodplains Using Machine Learning‐Based Model Calibration
Abstract Beavers ( Castor canadensis ) alter river corridor hydrology by creating ponds and inundating floodplains, and thereby improving surface water storage. However, the impact of inundation on groundwater, particularly in mountainous alluvial floodplains with permeable gravel/cobble layers overlain by a soil layer, remains uncertain. Numerical modeling across various floodplain structures considers topographic and sediment complexity and multidirectional flow, linking inundation to groundwater response. This study develops a model‐data integration workflow to address uncertainty in groundwater response to beaver‐induced inundations in a mountainous alluvial floodplain in the Upper Colorado River Basin. Uncertain factors include seasonal hydrologic dynamics, hydraulic conductivities, floodplain structures, and meteorological forcings. We employed an ensemble of groundwater models, based on geophysical and hydrologic data, with machine learning‐based calibration using a neural density estimator. This allowed us to quantify the vertical flux from the soil layer to the permeable gravel bed, the down‐valley underflow within the gravel bed, and their ratios. Results show a significant increase in the vertical flux relative to down‐valley underflow, from 2 during dry pond periods to 20 during wet periods, serving as an analogy for conditions without and with beaver ponds. The study highlights the influence of floodplain structure on groundwater storage, water balance, and water quality impacted by beaver ponds. A thick gravel bed layer, with a large down‐valley underflow, minimizes the effect of beaver‐induced inundation on water quality. We emphasize the need for field‐scale measurements of floodplain structure and improved characterization of evapotranspiration changes to reduce uncertainty in groundwater response. Plain Language Summary Beavers change the flow of water in river corridors by creating ponds, expanding wetlands, and flooding floodplains. This increases surface water area, promotes plant growth, and enhances biodiversity. However, the impact of this flooding on groundwater flow is not well understood, especially in mountainous areas with gravel layers where water moves easily beneath soil. In this study, we used numerical modeling to investigate how beaver ponds influence groundwater in a mountainous floodplain of the Upper Colorado River Basin. We adapted a machine learning method to validate our numerical models using multiple field data sets. Our findings show that beaver ponds significantly increase vertical water flow from the soil to the gravel during wet periods, compared to when the ponds are fully drained. The study also highlights the importance of floodplain structure in controlling both water flow in gravel layers along the river direction and vertical flow from the soil to the gravel with the presence of beavers. To reduce uncertainty in groundwater response, we emphasize the need for more field‐scale measurements of floodplain structure, hydraulic properties, and evapotranspiration changes. Key Points Floodplain structures and hydraulic conductivities are important for groundwater response with beaver ponds in mountainous floodplains Large down‐valley underflow in permeability‐stratified floodplains reduces beaver‐induced impacts on groundwater storage and water quality Machine learning‐based model calibration methods are effective for estimating posterior distributions of groundwater model parameters
Wang, Lijing↗
Computer Model Calibration Based on Image Warping Metrics: An Application for Sea Ice Deformation
Arctic sea ice plays an important role in the global climate. Sea ice models governed by physical equations have been used to simulate the state of the ice including characteristics such as ice thickness, concentration, and motion. More recent models also attempt to capture features such as fractures or leads in the ice. These simulated features can be partially misaligned or misshapen when compared to observational data, whether due to numerical approximation or incomplete physics. In order to make realistic forecasts and improve understanding of the underlying processes, it is necessary to calibrate the numerical model to field data. Traditional calibration methods based on generalized least-square metrics are flawed for linear features such as sea ice cracks. We develop a statistical emulation and calibration framework that accounts for feature misalignment and misshapenness, which involves optimally aligning model output with observed features using cutting-edge image registration techniques. Here, this work can also have application to other physical models which produce coherent structures.
54 ENVIRONMENTAL SCIENCES↗