Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Can MODIS Data Calibrate and Validate Coastal Sediment Transport Models? Rapid Prototyping Using 250 m Data and the ECOMSED Model for Lake Pontchartrain, LA USA

Field measurements from small boats and sparse arrays of instrumented buoys often do not provide sufficient data to capture the dynamic nature of biogeophysical parameters in may coastal aquatic environments. Several investigators have shown the MODIS 250 m images can provide daily synoptic views of suspended sediment concentration in coastal waters to determine sediment transport and fate. However, the use of MODIS for coastal environments can be limited due to a lack of cloud-free images. Sediment transport models are not constrained by sky conditions but often suffer from a lack of in situ observations for model calibration or validation. We demonstrate here the utility of MODIS 250 m to calibrate (set model parameters), validate output, and set or reset initial conditions of a hydrodynamic and sediment transport model (ECOMSED) developed for Lake Pontchartrain, LA USA. We present our approach in the context of how to quickly assess of 'prototype' an application of NASA data to support environmental managers and decision makers. The combination of daily MODIS imagery and model simulations offer a more robust monitoring and prediction system of suspended sediments than available from either system alone.

Miller, Richard L.↗

Cutting out the Middleman: Calibrating and Validating a Dynamic Vegetation Model (ED2-PROSPECT5) Using Remotely Sensed Surface Reflectance

Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types. Using a single common set of parameters across all sites, the calibrated model was able to accurately reproduce surface reflectance for sites with highly varied forest composition and structure. However, the calibrated model's predictions of leaf area index (LAI) were less robust, capturing only 46 % of the variability in the observations. Comparing the ED2 radiative transfer model with another two-stream soil–leaf–canopy radiative transfer model commonly used in remote sensing studies (PRO4SAIL) illustrated structural errors in the ED2 representation of direct radiation backscatter that resulted in systematic underestimation of reflectance. In addition, we also highlight that, to directly compare with a two-stream radiative transfer model like EDR, we had to perform an additional processing step to convert the directional reflectance estimates of AVIRIS to hemispherical reflectance (also known as “albedo”). In future work, we recommend that vegetation models add the capability to predict directional reflectance, to allow them to more directly assimilate a wide range of airborne and satellite reflectance products. We ultimately conclude that despite these challenges, using dynamic vegetation models to predict surface reflectance is a promising avenue for model calibration and validation using remote sensing data.

Alexey N Shiklomanov↗

Studies of the net surface radiative flux from satellite radiances during FIFE

Studies of the net surface radiative flux from satellite radiances during First ISLSCP Field Experiment (FIFE) are presented. Topics covered include: radiative transfer model validation; calibration of VISSR and AVHRR solar channels; development and refinement of algorithms to estimate downward solar and terrestrial irradiances at the surface, including photosynthetically available radiation (PAR) and surface albedo; verification of these algorithms using in situ measurements; production of maps of shortwave irradiance, surface albedo, and related products; analysis of the temporal variability of shortwave irradiance over the FIFE site; development of a spectroscopy technique to estimate atmospheric total water vapor amount; and study of optimum linear combinations of visible and near-infrared reflectances for estimating the fraction of PAR absorbed by plants.

Frouin, Robert↗

KINEROS2-AGWA: Model Use, Calibration, and Validation

KINEROS (KINematic runoff and EROSion) originated in the 1960s as a distributed event-based model that conceptualizes a watershed as a cascade of overland flow model elements that flow into trapezoidal channel model elements. KINEROS was one of the first widely available watershed models that interactively coupled a finite difference approximation of the kinematic overland flow equations to a physically based infiltration model. Development and improvement of KINEROS continued from the 1960s on a variety of projects for a range of purposes, which has resulted in a suite of KINEROS-based modeling tools. This article focuses on KINEROS2 (K2), a spatially distributed, event-based watershed rainfall-runoff and erosion model, and the companion ArcGIS-based Automated Geospatial Watershed Assessment (AGWA) tool. AGWA automates the time-consuming tasks of watershed delineation into distributed model elements and initial parameterization of these elements using commonly available, national GIS data layers. A variety of approaches have been used to calibrate and validate K2 successfully across a relatively broad range of applications (e.g., urbanization, pre- and post-fire, hillslope erosion, erosion from roads, runoff and recharge, and manure transport). The case studies presented in this article (1) compare lumped to stepwise calibration and validation of runoff and sediment at plot, hillslope, and small watershed scales; and (2) demonstrate an uncalibrated application to address relative change in watershed response to wildfire.

Erosion↗

Calibration of Predictor Models Using Multiple Validation Experiments

This paper presents a framework for calibrating computational models using data from several and possibly dissimilar validation experiments. The offset between model predictions and observations, which might be caused by measurement noise, model-form uncertainty, and numerical error, drives the process by which uncertainty in the models parameters is characterized. The resulting description of uncertainty along with the computational model constitute a predictor model. Two types of predictor models are studied: Interval Predictor Models (IPMs) and Random Predictor Models (RPMs). IPMs use sets to characterize uncertainty, whereas RPMs use random vectors. The propagation of a set through a model makes the response an interval valued function of the state, whereas the propagation of a random vector yields a random process. Optimization-based strategies for calculating both types of predictor models are proposed. Whereas the formulations used to calculate IPMs target solutions leading to the interval value function of minimal spread containing all observations, those for RPMs seek to maximize the models' ability to reproduce the distribution of observations. Regarding RPMs, we choose a structure for the random vector (i.e., the assignment of probability to points in the parameter space) solely dependent on the prediction error. As such, the probabilistic description of uncertainty is not a subjective assignment of belief, nor is it expected to asymptotically converge to a fixed value, but instead it casts the model's ability to reproduce the experimental data. This framework enables evaluating the spread and distribution of the predicted response of target applications depending on the same parameters beyond the validation domain.

Crespo, Luis G.↗

Performance modeling & simulation of complex systems (A systems engineering design & analysis approach)

Modeling of the Multi-mission Image Processing System (MIPS) will be described as an example of the use of a modeling tool to design a distributed system that supports multiple application scenarios. This paper examines: (a) modeling tool selection, capabilities, and operation (namely NETWORK 2.5 by CACl), (b) pointers for building or constructing a model and how the MIPS model was developed, (c) the importance of benchmarking or testing the performance of equipment/subsystems being considered for incorporation the design/architecture, (d) the essential step of model validation and/or calibration using the benchmark results, (e) sample simulation results from the MIPS model, and (f) how modeling and simulation analysis affected the MIPS design process by having a supportive and informative impact.

Hall, Laverne↗

Thermocouple Temperature Measurements in Selective Laser Melting Additive Manufacturing

The extreme thermal history resulting from selective laser melting leads to microstructural characteristics and residual stresses that have considerable impact on the mechanical behavior of the printed part. Accurate measurements of the temperature combined with thermal models are needed to better understand and control the thermal history to optimize mechanical properties. In order to calibrate and validate models, experimental temperature data must be accurately measured in a rapid fashion due to the high speeds of the laser. In this work, a novel method to read data from thermocouples is created with enhanced circuitry that achieves a sampling rate of 10 kHz. This data acquisition rate allows for high precision sampling of SLM heating and cooling cycles.

additive manufacturing↗

Quantification of uncertainties in coupled material degradation processes - High temperature, fatigue and creep

This paper describes the development of methodology that provides for quantification of uncertainties in lifetime strength of aerospace materials subjected to a number of diverse effects. A probabilistic material degradation model, in the form of a randomized multifactor interaction equation, has been postulated for lifetime strength degradation of structural components of aerospace propulsion systems. The model includes effects that typically reduce lifetime strength and may include temperature, mechanical fatigue, creep and others. The paper also includes the analysis of experimental data from the open literature for Inconel 718. These data are used to provide an initial check for model validity, as well as for calibration of the model's empirical material constants. The model validity check and calibration is carried out for three effects, namely, high temperature, mechanical fatigue and creep.

Boyce, L.↗

Calibration and Validation of a Finite ELement Model of THor-K Anthropomorphic Test Device for Aerospace Safety Applications

The THOR anthropomorphic test device (ATD) has been developed and continuously improved by the National Highway Traffic Safety Administration to provide automotive manufacturers an advanced tool that can be used to assess the injury risk of vehicle occupants in crash tests. Recently, a series of modifications were completed to improve the biofidelity of THOR ATD [1]. The updated THOR Modification Kit (THOR-K) ATD was employed at Wright-Patterson Air Base in 22 impact tests in three configurations: vertical, lateral, and spinal [2]. Although a computational finite element (FE) model of the THOR had been previously developed [3], updates to the model were needed to incorporate the recent changes in the modification kit. The main goal of this study was to develop and validate a FE model of the THOR-K ATD. The CAD drawings of the THOR-K ATD were reviewed and FE models were developed for the updated parts. For example, the head-skin geometry was found to change significantly, so its model was re-meshed (Fig. 1a). A protocol was developed to calibrate each component identified as key to the kinematic and kinetic response of the THOR-K head/neck ATD FE model (Fig. 1b). The available ATD tests were divided in two groups: a) calibration tests where the unknown material parameters of deformable parts (e.g., head skin, pelvis foam) were optimized to match the data and b) validation tests where the model response was only compared with test data by calculating their score using CORrelation and Analysis (CORA) rating system. Finally, the whole ATD model was validated under horizontal-, vertical-, and lateral-loading conditions against data recorded in the Wright Patterson tests [2]. Overall, the final THOR-K ATD model developed in this study is shown to respond similarly to the ATD in all validation tests. This good performance indicates that the optimization performed during calibration by using the CORA score as objective function is not test specific. Therefore confidence is provided in the ATD model for uses in predicting response in test conditions not performed in this study such those observed in the spacecraft landing. Comparison studies with ATD and human models may also be performed to contribute to future changes in THOR ATD design in an effort to improve its biofidelity, which has been traditionally based on post-mortem human subject testing and designer experience.

Putnam, J. B.↗

Solar Dynamics Observatory (SDO) HGAS Induced Jitter

This paper presents the results of a comprehensive assessment of High Gain Antenna System induced jitter on the Solar Dynamics Observatory. The jitter prediction is created using a coupled model of the structural dynamics, optical response, control systems, and stepper motor actuator electromechanical dynamics. The paper gives an overview of the model components, presents the verification processes used to evaluate the models, describes validation and calibration tests and model-to-measurement comparison results, and presents the jitter analysis methodology and results.

Liu, Alice↗

Impact of AMS-02 Measurements on Reducing GCR Model Uncertainties

For vehicle design, shield optimization, mission planning, and astronaut risk assessment, the exposure from galactic cosmic rays (GCR) poses a significant and complex problem both in low Earth orbit and in deep space. To address this problem, various computational tools have been developed to quantify the exposure and risk in a wide range of scenarios. Generally, the tool used to describe the ambient GCR environment provides the input into subsequent computational tools and is therefore a critical component of end-to-end procedures. Over the past few years, several researchers have independently and very carefully compared some of the widely used GCR models to more rigorously characterize model differences and quantify uncertainties. All of the GCR models studied rely heavily on calibrating to available near-Earth measurements of GCR particle energy spectra, typically over restricted energy regions and short time periods. In this work, we first review recent sensitivity studies quantifying the ions and energies in the ambient GCR environment of greatest importance to exposure quantities behind shielding. Currently available measurements used to calibrate and validate GCR models are also summarized within this context. It is shown that the AMS-II measurements will fill a critically important gap in the measurement database. The emergence of AMS-II measurements also provides a unique opportunity to validate existing models against measurements that were not used to calibrate free parameters in the empirical descriptions. Discussion is given regarding rigorous approaches to implement the independent validation efforts, followed by recalibration of empirical parameters.

Slaba, T. C.↗

Applied high-speed imaging for the icing research program at NASA Lewis Research Center

The Icing Research Tunnel at NASA Lewis Research Center provides scientists a scaled, controlled environment to simulate natural icing events. The closed-loop, low speed, refrigerated wind tunnel offers the experimental capability to test for icing certification requirements, analytical model validation and calibration techniques, cloud physics instrumentation refinement, advanced ice protection systems, and rotorcraft icing methodology development. The test procedures for these objectives all require a high degree of visual documentation, both in real-time data acquisition and post-test image processing. Information is provided to scientific, technical, and industrial imaging specialists as well as to research personnel about the high-speed and conventional imaging systems will be on the recent ice protection technology program. Various imaging examples for some of the tests are presented. Additional imaging examples are available from the NASA Lewis Research Center's Photographic and Printing Branch.

Slater, Howard↗

Applied high-speed imaging for the icing research program at NASA Lewis Research Center

The Icing Research Tunnel at NASA Lewis Research Center provides scientists a scaled, controlled environment to simulate natural icing events. The closed-loop, low speed, refrigerated wind tunnel offers the experimental capability to test for icing certification requirements, analytical model validation and calibration techniques, cloud physics instrumentation refinement, advanced ice protection systems, and rotorcraft icing methodology development. The test procedures for these objectives all require a high degree of visual documentation, both in real-time data acquisition and post-test image processing. Information is provided to scientific, technical, and industrial imaging specialists as well as to research personnel about the high-speed and conventional imaging systems will be on the recent ice protection technology program. Various imaging examples for some of the tests are presented. Additional imaging examples are available from the NASA Lewis Research Center's Photographic and Printing Branch.

Slater, Howard↗

Software Tools to Support Research on Airport Departure Planning

A simple, portable and useful collection of software tools has been developed for the analysis of airport surface traffic. The tools are based on a flexible and robust traffic-flow model, and include calibration, validation and simulation functionality for this model. Several different interfaces have been developed to help promote usage of these tools, including a portable Matlab(TM) implementation of the basic algorithms; a web-based interface which provides online access to automated analyses of airport traffic based on a database of real-world operations data which covers over 250 U.S. airports over a 5-year period; and an interactive simulation-based tool currently in use as part of a college-level educational module. More advanced applications for airport departure traffic include taxi-time prediction and evaluation of "windowing" congestion control.

Carr, Francis↗

Comparative Measurements of Earth and Martian Entry Environments in the NASA Langley HYMETS Facility

Arc-jet facilities play a major role in the development of heat shield materials for entry vehicles because they are capable of producing representative high-enthalpy flow environments. Arc-jet test data is used to certify material performance for a particular mission and to validate or calibrate models of material response during atmospheric entry. Materials used on missions entering Earth s atmosphere are certified in an arc-jet using a simulated air entry environment. Materials used on missions entering the Martian atmosphere should be certified in an arc-jet using a simulated Martian atmosphere entry environment, which requires the use of carbon dioxide. Carbon dioxide has not been used as a test gas in a United States arc-jet facility since the early 1970 s during the certification of materials for the Viking Missions. Materials certified for the Viking missions have been used on every entry mission to Mars since that time. The use of carbon dioxide as a test gas in an arc-jet is again of interest to the thermal protection system community for certification of new heat shield materials that can increase the landed mass capability for Mars bound missions beyond that of Viking and Pathfinder. This paper describes the modification, operation, and performance of the Hypersonic Materials Environmental Test System (HYMETS) arc-jet facility with carbon dioxide as a test gas. A basic comparison of heat fluxes, various bulk properties, and performance characteristics for various Earth and Martian entry environments in HYMETS is provided. The Earth and Martian entry environments consist of a standard Earth atmosphere, an oxygen-rich Earth atmosphere, and a simulated Martian atmosphere. Finally, a preliminary comparison of the HYMETS arc-jet facility to several European plasma facilities is made to place the HYMETS facility in a more global context of arc-jet testing capability.

Splinter, Scott C.↗

Experimental Characterization and Simulation of Slip Transfer at Grain Boundaries and Microstructurally-Sensitive Crack Propagation

A systematic study of crack tip interaction with grain boundaries is critical for improvement of multiscale modeling of microstructurally-sensitive fatigue crack propagation and for the computationally-assisted design of more durable materials. In this study, single, bi- and large-grain multi-crystal specimens of an aluminum-copper alloy are fabricated, characterized using electron backscattered diffraction (EBSD), and deformed under tensile loading and nano-indentation. 2D image correlation (IC) in an environmental scanning electron microscope (ESEM) is used to measure displacements near crack tips, grain boundaries and within grain interiors. The role of grain boundaries on slip transfer is examined using nano-indentation in combination with high-resolution EBSD. The use of detailed IC and EBSD-based experiments are discussed as they relate to crystal-plasticity finite element (CPFE) model calibration and validation.

Gupta, Vipul↗

Variational Asymptotic Homogenization of Finitely Deformed Viscoelastic-Viscoplastic Composites

The objective of this paper is to develop a constitutive model for finitely deformed viscoelastic-viscoplastic materials and a micromechanics approach to homogenizing composites consisting of such materials. The development of the constitutive model involves establishing a thermodynamic framework based on finite strain theory, developing a viscoelasticity and a viscoplasticity model based on the thermodynamic framework, developing a radial return algorithm based on a classic framework, and deriving a closed-from incremental constitutive relation in the spatial configuration. The development of the micromechanics approach involves pulling-back the above constitutive relation to the material configuration, formulating a variational statement with the resulting constitutive relation, discretizing variational statement in a finite-dimensional space, and solving the discretized variational statement using an Euler–Newton predictor–corrector method. The constitutive model is calibrated via monotonic uniaxial compression tests on a polymer, and the calibrated model is validated by comparing its predictions with the cyclic test data. It is shown capable of characterizing viscoelasticity, viscoplasticity, and complex loading paths. The micromechanics approach’s capabilities are demonstrated through homogenizing a unidirectional fiber-reinforced composite, subjected to uniaxial, biaxial, and shear loading, at different strain rates. It is demonstrated to be capable of handling rate dependence and complex loading paths. The present framework can be further improved by implementing more sophisticated viscoelasticity and viscoplasticity models in future work.

Finite element analysis↗