Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Reactive burn model calibration using high-throughput initiation experiments at sub-millimeter length scales

We report a first-of-its-kind model calibration was performed using Sandia National Laboratories’ high-throughput initiation (HTI) experiment for two types of vapor-deposited explosive films consisting of hexanitrostilbene (HNS) or pentaerythritol tetranitrate (PETN). These films exhibit prompt initiation, and they reach steady detonation at sub-millimeter length scales. Following prior work on HNS, we test the hypothesis of approximating these explosive films as fine-grained homogeneous solids with simple Arrhenius kinetics burn models. The model calibration process is described herein using a single-step as well as a two-step Arrhenius rate law, and it consists of systematic parameter sampling leading to a reduction in the model degrees of freedom. Multiple local minima are observed; results are given for seven different optimized parameter sets. Each model set is further evaluated in a two-dimensional simulation of the critical failure thickness for a sustained detonation. Overall, the two-step Arrhenius kinetics model captures the observed behavior for HNS; however, neither model produces a good fit to the PETN data. We hypothesize that the HTI results for PETN correspond to a heterogeneous response, owing to the smaller reaction zone of PETN compared to HNS (i.e., it does not homogenize the fine-grained hot spots as well). Future work should consider using the ignition and growth model for PETN, as well as other reactive burn models such as xHVRB, AWSD, PiSURF, and CREST.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multivariate Calibration Models for Sorghum Composition using Near-Infrared Spectroscopy

NREL developed calibration models based on near-infrared (NIR) spectroscopy coupled with multivariate statistics to predict compositional properties relevant to cellulosic biofuels production for a variety of sorghum cultivars. A robust calibration population was developed in an iterative fashion. The quality of models developed using the same sample geometry on two different types of NIR spectrometers and two different sample geometries on the same spectrometer did not vary greatly.

09 BIOMASS FUELS↗

Bayesian optimal experimental design for constitutive model calibration

Computational simulation is increasingly relied upon for high/consequence engineering decisions, which necessitates a high confidence in the calibration of and predictions from complex material models. However, the calibration and validation of material models is often a discrete, multi-stage process that is decoupled from material characterization activities, which means the data collected does not always align with the data that is needed. To address this issue, an integrated workflow for delivering an enhanced characterization and calibration procedure—Interlaced Characterization and Calibration (ICC)—is introduced and demonstrated. Further, this framework leverages Bayesian optimal experimental design (BOED), which creates a line of communication between model calibration needs and data collection capabilities in order to optimize the information content gathered from the experiments for model calibration. Eventually, the ICC framework will be used in quasi real-time to actively control experiments of complex specimens for the calibration of a high-fidelity material model. This work presents the critical first piece of algorithm development and a demonstration in determining the optimal load path of a cruciform specimen with simulated data. Calibration results, obtained via Bayesian inference, from the integrated ICC approach are compared to calibrations performed by choosing the load path a priori based on human intuition, as is traditionally done. The calibration results are communicated through parameter uncertainties which are propagated to the model output space (i.e. stress–strain). In these exemplar problems, data generated within the ICC framework resulted in calibrated model parameters with reduced measures of uncertainty compared to the traditional approaches.

42 ENGINEERING↗

Statistically Rigorous Uncertainty Quantification for Physical Parameter Model Calibration with Functional Output

In experiments conducted on the Z-machine at Sandia National Laboratories, dynamic material properties cannot be analyzed using traditional analytic methods, necessitating solving an inverse problem. Bayesian model calibration is a statistical framework for solving an inverse problem to estimate parameters input into a computational model in the presence of multiple uncertainties. Disentangling input parameter uncertainty and model misspecification is often poorly identified problem. When using computational models for physical parameter estimation, the issue of parameter identifiability must be carefully considered to obtain accurate and precise estimates of physical parameters. Additionally, in dynamic material properties applications, the experimental output is a function, velocity over time. While we can sample an arbitrarily large number of points from the measured velocity, these curves only contain a finite amount of information about the calibration parameters. In this report, we propose modifications to the Bayesian model calibration framework to simplify and improve the estimation of physical parameters with functional outputs. Specifically, we propose scaling the likelihood function by an effective sample size rather than modeling the discrepancy function; and modularizing input nuisance parameters with weakly identified parameters. We evaluate the performance of these proposed methods using a statistical simulation study and then apply these methods to estimate parameters of the tantalum equation of state. We conclude that these proposed methods can provide simple, fast, and statistically valid alternatives to the full Bayesian model calibration procedure; and that these methods can be used to estimate parameters of the equation of state for tantalum.

97 MATHEMATICS AND COMPUTING↗

Development of Upscaling Techniques and Construction of Calibrated Models for Fractured Rocks Using Discrete Fracture Network Approaches

The Pahute Mesa Corrective Action Unit on the Nevada National Security Site (NNSS) contains several fractured aquifers that can potentially provide high-permeability pathways for radionuclides to migrate away from underground nuclear testing locations. Although the geometric properties of fractures, such as length and orientation, can be found using geophysical methods and borehole image analyses, the hydraulic property of fractures (which are primarily influenced by apertures) are often unknown or have a high degree of uncertainty attached to their values. The aperture values have a profound impact on groundwater velocity and are critical to understanding transport scales at Pahute Mesa. Fracture aperture values and their distributions also have dominant control over radionuclide transport with potential for long-range correlations or scale-invariant dynamics. Understanding of the small-scale transport variability in fractures could lead to identification of distinct characteristics on larger scales. Furthermore, upscaling techniques need to be developed to adequately predict transport behavior at field scales by capturing the transport trends of smaller scale networks. This report explores these vital modeling needs to understand the role of fractures in Pahute Mesa. Discrete fracture network (DFN) models are the basis for constructing a well-calibrated model to ascertain aperture values of fractures in lava-flow aquifers. These models are also used to develop and compare the usefulness of several random-walk-based models to perform transport upscaling.

54 ENVIRONMENTAL SCIENCES↗

Finite Element Model Calibration Approach for Ares I-X

Ares I-X is a pathfinder vehicle concept under development by NASA to demonstrate a new class of launch vehicles. Although this vehicle is essentially a shell of what the Ares I vehicle will be, efforts are underway to model and calibrate the analytical models before its maiden flight. Work reported in this document will summarize the model calibration approach used including uncertainty quantification of vehicle responses and the use of nonconventional boundary conditions during component testing. Since finite element modeling is the primary modeling tool, the calibration process uses these models, often developed by different groups, to assess model deficiencies and to update parameters to reconcile test with predictions. Data for two major component tests and the flight vehicle are presented along with the calibration results. For calibration, sensitivity analysis is conducted using Analysis of Variance (ANOVA). To reduce the computational burden associated with ANOVA calculations, response surface models are used in lieu of computationally intensive finite element solutions. From the sensitivity studies, parameter importance is assessed as a function of frequency. In addition, the work presents an approach to evaluate the probability that a parameter set exists to reconcile test with analysis. Comparisons of pre-test predictions of frequency response uncertainty bounds with measured data, results from the variance-based sensitivity analysis, and results from component test models with calibrated boundary stiffness models are all presented.

Horta, Lucas G.↗

Finite Element Model Calibration Approach for Area I-X

Ares I-X is a pathfinder vehicle concept under development by NASA to demonstrate a new class of launch vehicles. Although this vehicle is essentially a shell of what the Ares I vehicle will be, efforts are underway to model and calibrate the analytical models before its maiden flight. Work reported in this document will summarize the model calibration approach used including uncertainty quantification of vehicle responses and the use of non-conventional boundary conditions during component testing. Since finite element modeling is the primary modeling tool, the calibration process uses these models, often developed by different groups, to assess model deficiencies and to update parameters to reconcile test with predictions. Data for two major component tests and the flight vehicle are presented along with the calibration results. For calibration, sensitivity analysis is conducted using Analysis of Variance (ANOVA). To reduce the computational burden associated with ANOVA calculations, response surface models are used in lieu of computationally intensive finite element solutions. From the sensitivity studies, parameter importance is assessed as a function of frequency. In addition, the work presents an approach to evaluate the probability that a parameter set exists to reconcile test with analysis. Comparisons of pretest predictions of frequency response uncertainty bounds with measured data, results from the variance-based sensitivity analysis, and results from component test models with calibrated boundary stiffness models are all presented.

Horta, Lucas G.↗

Model calibration and optimization of a post-combustion CO 2 WAG pilot in a mature oil field

A carbon dioxide (CO 2 ) water-alternating-gas (WAG) pilot was conducted to gain insights into tertiary oil recovery potential via CO 2 flood in the West Ranch Field as part of the Petra Nova project, the world's largest postcombustion CO 2 capture and utilization initiative. With a fluvial formation geology, this is a challenging and novel application of CO 2 enhanced oil recovery. The aim of this study is two-fold. First, to build a predictive dynamic model that incorporates the data acquired during the pilot operation. Second, to utilize this model to provide guidance for optimal design for a field-wide CO 2 EOR operation. Our study began with an initialization of the pilot sector model extracted from a calibrated full-field model. The pilot model calibration follows a two-step hierarchical workflow. First, we performed a large-scale update of the permeability distribution by integrating available bottomhole pressure and multiphase production data. Next, local permeability field is fine-tuned using a streamline-based method to match CO 2 breakthrough times at the producers. The predictive capability of the calibrated model was verified through two blind validation tests: (1) the model showed good agreement with saturation logs acquired at two observation wells; and (2) the model reproduced the CO 2 recovery as a fraction of the injected CO 2 . Sensitivity studies were conducted using the calibrated pilot model to evaluate the effects of various operational parameters. Finally, we performed a Design of Experiment based multi-objective optimization of the CO 2 WAG processes using the influential operational parameters identified from the sensitivity analysis.

02 PETROLEUM↗

Estimation of Uncertainties of Wall Temperature Accomplished by Model Calibration Technique Using Small to Large Scale Reflooding Test Data

The fidelity of the prediction can be evaluated by performing validation and uncertainty quantification with suitable test data. Nuclear power plant design and operation must accommodate the uncertainties in predicting system performance, where those uncertainties originating due to initial and boundary conditions, numerics, and modeling uncertainties. To improve the prediction of the reactor system performance, these various sources of uncertainties can be refined through model calibration technique. The objective of this work is to refine the model parameters and to estimate the uncertainties on parameters/responses during reflood phase. To accomplish this experiments should be performed, data collected, and the data utilized to complete model calibration for the thermal-hydraulic input parameters. Simulations were performed using Safety and Performance Analysis Code (SPACE) developed by multiple research institutes in South Korea to predict the thermal hydraulic system behaviors of nuclear power plants. Since existing experimental data were obtained from several tests performed at the small scale, scaling considerations must be addressed during the uncertainty quantification process. (authors)

42 ENGINEERING↗

Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado

Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.

54 ENVIRONMENTAL SCIENCES↗

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Calibrating Historical IR Sensors Using GEO, and AVHRR Infrared Tropical Mean Calibration Models

Long-term, remote-sensing-based climate data records (CDRs) are highly dependent on having consistent, wellcalibrated satellite instrument measurements of the Earth's radiant energy. Therefore, by making historical satellite calibrations consistent with those of today's imagers, the Earth-observing community can benefit from a CDR that spans a minimum of 30 years. Most operational meteorological satellites rely on an onboard blackbody and space looks to provide on-orbit IR calibration, but neither target is traceable to absolute standards. The IR channels can also be affected by ice on the detector window, angle dependency of the scan mirror emissivity, stray-light, and detector-to-detector striping. Being able to quantify and correct such degradations would mean IR data from any satellite imager could contribute to a CDR. Recent efforts have focused on utilizing well-calibrated modern hyper-spectral sensors to intercalibrate concurrent operational IR imagers to a single reference. In order to consistently calibrate both historical and current IR imagers to the same reference, however, another strategy is needed. Large, well-characterized tropical-domain Earth targets have the potential of providing an Earth-view reference accuracy of within 0.5 K. To that effort, NASA Langley is developing an IR tropical mean calibration model in order to calibrate historical Advanced Very High Resolution Radiometer (AVHRR) instruments. Using Meteosat-9 (Met-9) as a reference, empirical models are built based on spatially/temporally binned Met-9 and AVHRR tropical IR brightness temperatures. By demonstrating the stability of the Met-9 tropical models, NOAA-18 AVHRR can be calibrated to Met-9 by matching the AVHRR monthly histogram averages with the Met-9 model. This method is validated with ray-matched AVHRR and Met-9 biasdifference time series. Establishing the validity of this empirical model will allow for the calibration of historical AVHRR sensors to within 0.5 K, and thereby establish a climate-quality IR data record.

Scarino, Benjamin↗

2002 VCMPO Model Calibration and Home-Based Travel Survey

The 2001-2002 Model Calibration and Home-Based Travel Survey was a study conducted in Volusia County, Florida. One of the major purposes of the survey project was to collect information to allow for a better understanding of the travel habits and patterns of residents within Volusia County. The project was jointly funded by the Florida Department of Transportation, Volusia County, and the Volusia County MPO. Demographic and trip data were collected for 2,727 households from February 20, 2002, to February 28, 2002. Respondents were asked to record their travel and activities for a 48-hour period. Detailed information regarding their trips, including mode of transportation, trip purpose, departure and arrival times, and number of passengers, were gathered from 13,408 trips.

1Hz data↗

On the Use of Optimization Techniques for Turbulence Model Calibration

This article discusses the use of numerical optimization procedures to aid in the calibration of turbulence model coefficients. Such methods would increase the rigor and repeatability of the calibration procedure by requiring clearly defined and objective optimization metrics, and could be used to identify unique combinations of coefficient values for specific flow problems. The approach is applied to the re-calibration of an explicit algebraic Reynolds stress model for the incompressible planar mixing layer using the Nelder-Mead simplex algorithm and a micro-genetic algorithm with minimally imposed constraints. Three composite fitness functions, each based upon the error in the mixing layer growth rate and the normal and shear components of the Reynolds stresses, are investigated. The results demonstrate a significant improvement in the target objectives through the adjustment of three pressure-strain coefficients. Adjustments of additional coefficients provide little further benefit. Issues regarding the effectiveness of the fitness functions and the efficiency of the optimization algorithms are also discussed.

Yoder, Dennis A.↗

Geomechanical Model Calibration Using Field Measurements for a Petroleum Reserve

A finite element numerical analysis model has been constructed that consists of a mesh that effectively captures the geometries of Bayou Choctaw (BC) Strategic Petroleum Reserve (SPR) site and multimechanism deformation (M-D) salt constitutive model using the daily data of actual wellhead pressure and oil–brine interface location. The salt creep rate is not uniform in the salt dome, and the creep test data for BC salt are limited. Therefore, the model calibration is necessary to simulate the geomechanical behavior of the salt dome. The cavern volumetric closures of SPR caverns calculated from CAVEMAN are used as the field baseline measurement. The structure factor, A 2 , and transient strain limit factor, K o , in the M-D constitutive model are used for the calibration. The value of A 2 , obtained experimentally from BC salt, and the value of K o , obtained from Waste Isolation Pilot Plant salt, are used for the baseline values. To adjust the magnitude of A 2 and K0, multiplication factors A 2 F and K o F are defined, respectively. The A 2 F and K0F values of the salt dome and salt drawdown skins surrounding each SPR cavern have been determined through a number of back analyses. The cavern volumetric closures calculated from this model correspond to the predictions from CAVEMAN for six SPR caverns. Therefore, this model is able to predict behaviors of the salt dome, caverns, caprock, and interbed layers. In conclusion, the geotechnical concerns associated with the BC site from this analysis will be explained in a follow-up paper.

02 PETROLEUM↗

A Model Calibration Method for Grid-Forming Inverters Using Iterative Bayesian Optimization

As inverter-based resources (IBRs) are rapidly deployed, especially at the distribution and microgrid levels, the need to include their accurate representations in power systems models increases. With well-calibrated models, IBR-interactions can be examined, preventing any stability and operational issues, especially in islanded systems. This paper proposes a method to calibrate generic inverter models using Bayesian optimization, but with a parameter-grouping approach to improve speed and accuracy. This approach is illustrated for a grid-forming inverter using synthetic data and field measurements from a simple IBRbased microgrid. Tests show that the calibration algorithm has modest computation cost and is robust to noisy measurements..

Biswas, Shuchismita↗

A Spectacular Viscoelastic Model Calibration for 828/D230/Alox Generated from Legacy Sandia Data

The nonlinear viscoelastic Spectacular model is calibrated to the thermo-mechanical behavior of 828/D230/Alox with an alox volume fraction of 20 %. Legacy experimental data from Sandia’s polymer properties database (PPD) is used to calibrate the model. Based on known densities of the epoxy 828/D230 and the alox filler, the alox volume fractions listed on the PPD were likely reported incorrectly. The alox volume fractions are recalculated here. Using the recalculated alox volume fractions, the PPD contains experimental data for 828/D230/Alox with alox volume fractions of 16 %, 24 %, and 33 %, so the thermo-mechanical behavior at 20 % alox volume fraction is estimated by interpolating between the bounding cases of of 16 % and 24 %. Because the Spectacularmodel can be fairly challenging to calibrate, the calibration procedure is described in detail. Several of the calibration steps involve inverse parameter identification, where an experiment is simulated and parameters are iteratively updated until the model response matches the experimental data. As the PPD does not fully describe all experimental procedures, the experimental simulations use assumed thermal and mechanical loading rates that are typical for the viscoelastic characterization of epoxies. Spectacular uses four independent relaxation functions related to volumetric (ƒ 1 ), shear (ƒ 2 ), thermal strain (ƒ 3 ), and thermal relaxations (ƒ 4 ). The previous SPEC model form, also known as the universal_polymer model, uses two independent relaxation functions related to volumetric and thermal relaxation (ƒ ν = ƒ 1 = ƒ 3 = ƒ 4 ) and shear relaxation (ƒ s = ƒ 2 ). The two constitutive choices are briefly evaluated here, where it is found that the four relaxation function approach of Spectacular was better suited for fitting the coefficient of thermal expansion during both heating and cooling.

36 MATERIALS SCIENCE↗