Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the turbulence simulation overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura White↗

Hidden Connections between Regression Models of Strain-Gage Balance Calibration Data

Hidden connections between regression models of wind tunnel strain-gage balance calibration data are investigated. These connections become visible whenever balance calibration data is supplied in its design format and both the Iterative and Non-Iterative Method are used to process the data. First, it is shown how the regression coefficients of the fitted balance loads of a force balance can be approximated by using the corresponding regression coefficients of the fitted strain-gage outputs. Then, data from the manual calibration of the Ames MK40 six-component force balance is chosen to illustrate how estimates of the regression coefficients of the fitted balance loads can be obtained from the regression coefficients of the fitted strain-gage outputs. The study illustrates that load predictions obtained by applying the Iterative or the Non-Iterative Method originate from two related regression solutions of the balance calibration data as long as balance loads are given in the design format of the balance, gage outputs behave highly linear, strict statistical quality metrics are used to assess regression models of the data, and regression model term combinations of the fitted loads and gage outputs can be obtained by a simple variable exchange.

Ulbrich, Norbert↗

Modeling of a Modern Aircraft Through Calibration Techniques

NASA is seeking a new baseline aircraft model to assess the state-of-the-art technology for aircraft noise, emissions, and fuel/energy consumption as an update to a 2005 baseline. The process of modeling engine and airframe models as a system has historically required many iterations at NASA between the airframe and engine models. A new internal process presented in this paper contains a method that simultaneously calibrates an airframe and engine model to known data to create an aircraft system model. The work presented in this paper proposes a new framework in creating new aircraft models for future NASA research. This approach is presented as a general outline applicable to any chosen commercial aircraft. As an applied example, the B737 MAX 8 aircraft is chosen as the integrated engine and airframe model subjected to calibration. Initial results show a close match to available data but further refinement in the process is necessary for this ongoing work.

Thacker, Robert↗

Cross - Scale Intercomparison of Climate Change Impacts Simulated by Regional and Global Hydrological Models in Eleven Large River Basins

Ideally, the results from models operating at different scales should agree in trend direction and magnitude of impacts under climate change. However, this implies that the sensitivity to climate variability and climate change is comparable for impact models designed for either scale. In this study, we compare hydrological changes simulated by 9 global and 9 regional hydrological models (HM) for 11 large river basins in all continents under reference and scenario conditions. The foci are on model validation runs, sensitivity of annual discharge to climate variability in the reference period, and sensitivity of the long-term average monthly seasonal dynamics to climate change. One major result is that the global models, mostly not calibrated against observations, often show a considerable bias in mean monthly discharge, whereas regional models show a better reproduction of reference conditions. However, the sensitivity of the two HM ensembles to climate variability is in general similar. The simulated climate change impacts in terms of long-term average monthly dynamics evaluated for HM ensemble medians and spreads show that the medians are to a certain extent comparable in some cases, but have distinct differences in other cases, and the spreads related to global models are mostly notably larger. Summarizing, this implies that global HMs are useful tools when looking at large-scale impacts of climate change and variability. Whenever impacts for a specific river basin or region are of interest, e.g. for complex water management applications, the regional-scale models calibrated and validated against observed discharge should be used.

Hydrological models↗

Simulation of Dynamic Crushing Behavior of Simulated Carbon/Epoxy Stanchions Using MAT58 and MAT213 in LS-DYNA

Carbon fiber-reinforced polymer (CFRP) composites have shown promise as a material for structures designed to absorb energy in crush-style impact loading. In complementing the lightweight and tailorable characteristics of CFRP structures, the benefits of impact energy absorption are particularly interesting in aerospace vehicles that require excellent crashworthiness performance. However, simulating the behavior of CFRP structures in dynamic, crushing-style impact loading is challenging because of the many damage and failure modes that are essential to capture in the model. For the present investigation, CFRP stanchions were tested using a crash sled experimental test rig. The stanchions were designed by the Composite Materials Handbook-17 (CMH-17) Crashworthiness Working Group for the purpose of comparing experimental crash sled tests to corresponding simulations of the tests. The stanchions are C-channel shaped and represent a geometry common in the interior of aerospace vehicle structures. Explicit simulations in LSDYNA were performed using a well-established composite material model (MAT58) and a next-generation material model (MAT213). Fully integrated shell elements were utilized instead of 3D solid elements to limit computation time. In all models, each of the sixteen plies were represented with individual layers of shell elements with tiebreak contact between each adjacent ply pair to simulate interlaminar fracture. Simulating the crushing of the stanchions occurred in two phases. First, the material models were calibrated using flat specimens that were manufactured with the same layup as the stanchions. While the original goal was calibration of material-related properties, meshdependent behavior was observed in simulations with either material model, and an unstructured mesh was selected to remediate undesirable mesh-dependent failure modes. Additionally, for both the MAT58 and MAT213 models, it was found that either the crush force or the failure mode could be modeled accurately, but no set of parameters could be identified to attain both results in the same model. Once satisfactory calibration was achieved, the same material parameters were applied to the stanchion crush simulations. The stanchion simulations showed that MAT213 more accurately predicted the experimentally determined crush force, and both material models predicted key aspects of the experimentally observed failure modes.

Composite Materials↗

Calibration of longwavelength exotech model 20-C spectroradiometer

A brief description of the Exotech model 20-C field spectroradiometer which measures the spectral radiance of a target in the wavelength ranges 0.37 to 2.5 microns (short wavelength unit), 2.8 to 5.6 microns and 7.0 to 14 microns (long wavelength unit) is given. Wavelength calibration of long wavelength unit was done by knowing the strong, sharp and accurately known absorption bands of polystyrene, atmospheric carbon dioxide and methyl cyclohexane (liquid) in the infrared wavelength region. The spectral radiance calibration was done by recording spectral scans of the hot and the cold blackbodies and assuming that spectral radiance varies linearly with the signal.

Kumar, R.↗

Computational Process Modeling for Additive Manufacturing

Computational Process and Material Modeling of Powder Bed additive manufacturing of IN 718. Optimize material build parameters with reduced time and cost through modeling. Increase understanding of build properties. Increase reliability of builds. Decrease time to adoption of process for critical hardware. Potential to decrease post-build heat treatments. Conduct single-track and coupon builds at various build parameters. Record build parameter information and QM Meltpool data. Refine Applied Optimization powder bed AM process model using data. Report thermal modeling results. Conduct metallography of build samples. Calibrate STK models using metallography findings. Run STK models using AO thermal profiles and report STK modeling results. Validate modeling with additional build. Photodiode Intensity measurements highly linear with power input. Melt Pool Intensity highly correlated to Melt Pool Size. Melt Pool size and intensity increase with power. Applied Optimization will use data to develop powder bed additive manufacturing process model.

Bagg, Stacey↗

Diurnal Cycles in SST: Coupled Data Assimilation and Future Observational Requirements

Most operational centers are developing coupled (atmosphere-ocean) data assimilation systems as an alternative to uncoupled counterparts (atmosphere- or ocean-only). The Sea Surface Temperature (SST) is one of the key variables that tightly connects the atmosphere and ocean states and also air-sea fluxes. However, current prototype coupled data assimilation systems rely on external (L4) gridded SST or along-track (L3 or L2) SST retrievals as observed data or relaxation field. But in reality, SST are measurements are available from sparse in-situ network of ships, moorings, and buoys; all of them combined together are far less than those from satellites. However, satellites do not directly measure temperature, and inferring SST from satellite measured radiances requires a radiative transfer model, its calibration and also bias correction.The NASA Global Modeling and Assimilation Office (GMAO) is developing a coupled data assimilation system which assimilates SST directly from the raw observations, i.e., satellite radiances and in-situ observations. The methodology to directly assimilate radiances for SST became operational in Jan, 2017 in the GMAO's near-real time Weather Analysis and Prediction System. There were many modifications to the GMAO system in order to implement SST assimilation, most of which generally improved the predictability of the system. In order to maintain and further improve this system, we advocate for the availability of a microwave satellite radiometer in future beyond the currently operational GPM- GMI and AMSR-2 missions. For improved modeling of the near-surface temperature, salinity and mixing processes, we suggest adding more than one temperature sensor and salinity sensors to the drifting buoy network.

Akella, Santha↗

Using SMAP Level-4 Soil Moisture to Constrain MOD16 Evapotranspiration over the Contiguous USA

Evapotranspiration (ET) is a key hydrologic variable linking the Earth’s water, carbon and energy cycles. At large spatial scales, remote sensing-based (RS) models are often used to quantify ET. Despite the large number of RS ET models available, few include soil moisture as a key environmental input, which can degrade model accuracy and utility. Here, we use model assimilation enhanced soil moisture estimates from the NASA SMAP (Soil Moisture Active Passive) mission as a water supply control in the MOD16 ET algorithm framework. SMAP-derived daily surface (0-5cm depth) and root zone (0-1m depth) soil moisture are used with MODIS (Moderate Resolution Imaging Spectroradiometer) vegetation observations, and 4km gridded regional surface meteorology (Gridmet) as primary inputs for estimating daily ET and underlying model soil and stomatal conductance terms. We calibrated the model environmental response parameters using tower eddy covariance ET observations representing major North American biomes. The model ET results were validated using a holdout set of tower observations spanning a large regional climate gradient. The updated ET estimates outperform the baseline MOD16 product across all tower validation sites (RMSE = 0.758 vs 1.108 mm day-1; R2 = 0.68 vs0.45, respectively). Smaller relative improvements were obtained using a recalibrated model with 4km Gridmet meteorology, but no soil moisture control (RMSE = 0.813 mm day-1; R2 = 0.66), indicating that these changes are essential for the improved model performance. The soil moisture-constrained model improvements and relative benefits from the SMAP observations are greater in arid climates, consistent with stronger soil moisture control on ET in water-limited regions. The use of SMAP soil moisture as an additional model constraint improves MOD16 regional performance and provides a new framework for investigating both soil and atmosphere controls on ET.

SMAP↗

Evaluation of a Traditional Regression Model Term Selection Process for Balance Calibration Data Sets

Key elements of a traditional regression model term selection process for the analysis of wind tunnel strain-gage balance calibration data are discussed. The traditional process is sometimes applied when regression models of the gage outputs are needed and an analyst does not have access to a term selection algorithm. In principle, the traditional process identifies supported regression model terms of a gage output by combining an analyst's subject- matter knowledge with a visual examination of selected plots of the calibration loads. Twelve empirical rules are listed that may be used to select regression model terms. Data from the manual calibration of a force balance is used to illustrate the application of the traditional term selection process. The data example shows that the traditional process can become very complex. Its successful application highly depends on an analyst's experience and skills. Therefore, it is suggested to replace the traditional term selection process with an automated term selection algorithm. Then, objective metrics are systematically applied during the term selection that make the identification of the regression model more repeatable and less dependent on an analyst's personal skills.

strain-gage balance↗

The Badhwar-O'Neill 2020 Model

The Badhwar-O'Neill (BON) model has been used for some time to describe the galactic cosmic ray (GCR) environment encountered in deep space by astronauts and sensitive electronics. The most recent version of the model, BON2014, was calibrated to available measurements to reduce model errors for particles and energies of significance to astronaut exposure. Although subsequent studies showed the model to be reasonably accurate for such applications, modifications to the sunspot number (SSN) classification system and a large number of new high precision measurements suggested the need to develop an improved and more capable model. In this work, the BON2020 model is described. The new model relies on daily integral flux from the Advanced Composition Explorer Cosmic Ray Isotope Spectrometer (ACE/CRIS) to describe solar activity. For time periods not covered by ACE/CRIS, the updated international SSN database is used. Parameters in the new model are calibrated to available data, which includes the new Alpha Magnetic Spectrometer (AMS-02) and Payload for Antimatter Matter Exploration and Light-nuclei Astrophysics (PAMELA) high-precision measurements. It is found that the BON2020 model is a significant improvement over BON2014. Systematic errors associated with BON2014 have been removed. The average relative error of the BON2020 model compared to all available measurements is found to be <1%, and BON2020 is found to be within ±15% of a large fraction of the available measurements (26,269 of 27,646 → 95%).

Slaba, Tony C.↗

The Badhwar-O'Neill 2020 Model

The Badhwar-O’Neill (BON) model has been used for some time to describe the galactic cosmic ray (GCR) environment encountered in deep space by astronauts and sensitive electronics. The most recent version of the model, BON2014, was calibrated to available measurements to reduce model errors for particles and energies of significance to astronaut exposure. Although subsequent studies showed the model to be reasonably accurate for such applications, modifications to the sunspot number (SSN) classification system and a large number of new high-precision measurements suggested the need to develop an improved and more capable model. In this work, the BON2020 model is described. The new model relies on daily integral flux from the Advanced Composition Explorer Cosmic Ray Isotope Spectrometer (ACE/CRIS) to describe solar activity. For time periods not covered by ACE/CRIS, the updated international SSN database is used. Parameters in the new model are calibrated to available data, which includes the new Alpha Magnetic Spectrometer (AMS-02) and Payload for Antimatter Matter Exploration and Light-nuclei Astrophysics (PAMELA) high-precision measurements. It is found that the BON2020 model is a significant improvement over BON2014. Systematic errors associated with BON2014 have been removed. The average relative error of the BON2020 model compared to all available measurements is found to be <1%, and BON2020 is found to be within +15% of a large fraction of the available measurements (26,269 of 27,646  95%.

T C Slaba↗

Decomposition of the Mean Squared Error and NSE Performance Criteria: Implications for Improving Hydrological Modelling

The mean squared error (MSE) and the related normalization, the Nash-Sutcliffe efficiency (NSE), are the two criteria most widely used for calibration and evaluation of hydrological models with observed data. Here, we present a diagnostically interesting decomposition of NSE (and hence MSE), which facilitates analysis of the relative importance of its different components in the context of hydrological modelling, and show how model calibration problems can arise due to interactions among these components. The analysis is illustrated by calibrating a simple conceptual precipitation-runoff model to daily data for a number of Austrian basins having a broad range of hydro-meteorological characteristics. Evaluation of the results clearly demonstrates the problems that can be associated with any calibration based on the NSE (or MSE) criterion. While we propose and test an alternative criterion that can help to reduce model calibration problems, the primary purpose of this study is not to present an improved measure of model performance. Instead, we seek to show that there are systematic problems inherent with any optimization based on formulations related to the MSE. The analysis and results have implications to the manner in which we calibrate and evaluate environmental models; we discuss these and suggest possible ways forward that may move us towards an improved and diagnostically meaningful approach to model performance evaluation and identification.

Gupta, Hoshin V.↗

Data Reduction Methods Applied to the Fastrac Engine

The Fastrac rocket engine is currently being developed for the X-34 technology demonstrator vehicle. The engine performance model must be calibrated to support accurate performance prediction. Data reduction is the process of estimating hardware characteristics from available test data, and is essential for effective performance model calibration and prediction. A new data reduction procedure was developed, implemented, and tested using data from Fastrac engine tests. The procedure selects hardware and test measurements to use in the reduction process based on examination of the model influence matrix condition number. Predicted hardware characteristics are recovered from the solution of a quadratic programming problem. Computational tests indicate that the new procedure provides a significant improvement in test data reduction capability. Enhancements include improved test data utilization and time history data reduction capability. The new method is generically applicable to other systems.

Santi, L. Michael↗

Thermal Analysis of a Carbon Fiber Rope Barrier for Use in the Reusable Solid Rocket Motor Nozzle Joint-2

This study provides for development and verification of analysis methods used to assess performance of a carbon fiber rope (CFR) thermal barrier system that is currently being qualified for use in Reusable Solid Rocket Motor (RSRM) nozzle joint-2. Modeled geometry for flow calculations considers the joint to be vented with the porous CFR barriers placed in the "open' assembly gap. Model development is based on a 1-D volume filling approach where flow resistances (assembly gap and CFRs) are defined by serially connected internal flow and the porous media "Darcy" relationships. Combustion gas flow rates are computed using the volume filling code by assuming a lumped distribution total joint fill volume on a per linear circumferential inch basis. Gas compressibility, friction and heat transfer are included in the modeling. Gas-to-wall heat transfer is simulated by concurrent solution of the compressible flow equations and a large thermal 2-D finite element (FE) conduction grid. The derived numerical technique loosely couples the FE conduction matrix with the compressible gas flow equations, Free constants that appear in the governing equations are calibrated by parametric model comparison to hot fire subscale test results. The calibrated model is then used to make full-scale motor predictions using RSRM aft dome environments. Model results indicate that CFR thermal barrier systems will provide a thermally benign and controlled pressurization environment for the RSRM nozzle joint-2 primary seal activation.

Clayton, J. Louie↗

Thermal Analysis of a Carbon Fiber Rope Barrier for Use in the Reusable Solid Rocket Motor Nozzle Joint-2

This study provides development and verification of analysis methods used to assess performance of a carbon fiber rope (CFR) thermal barrier system that is currently being qualified for use in Reusable Solid Rocket Motor (RSRM) nozzle joint-2. Modeled geometry for flow calculations considers the joint to be vented with the porous CFR barriers placed in the 'open' assembly gap. Model development is based on a 1-D volume filling approach where flow resistances (assembly gap and CFRs) are defined by serially connected internal flow and the porous media 'Darcy' relationships. Combustion gas flow rates are computed using the volume filling code by assuming a lumped distribution total joint fill volume on a per linear circumferential inch basis. Gas compressibility, friction and heat transfer are included in the modeling. Gas-to-wall heat transfer is simulated by concurrent solution of the compressible flow equations and a large thermal 2-D finite element (FE) conduction grid. The derived numerical technique loosely couples the FE conduction matrix with the compressible gas flow equations. Free constants that appear in the governing equations are calibrated by parametric model comparison to hot fire subscale test results. The calibrated model is then used to make full-scale motor predictions using RSRM aft dome environments. Model results indicate that CFR thermal barrier systems will provide a thermally benign and controlled pressurization environment for the RSRM nozzle joint-2 primary seal activation.

Clayton, J. Louie↗

Thermal Pollution Mathematical Model: Verification of One-Dimensional Numerical Model at Lake Keowee - Volume 2

A one dimensional model for studying the thermal dynamics of cooling lakes was developed and verified. The model is essentially a set of partial differential equations which are solved by finite difference methods. The model includes the effects of variation of area with depth, surface heating due to solar radiation absorbed at the upper layer, and internal heating due to the transmission of solar radiation to the sub-surface layers. The exchange of mechanical energy between the lake and the atmosphere is included through the coupling of thermal diffusivity and wind speed. The effects of discharge and intake by power plants are also included. The numerical model was calibrated by applying it to Cayuga Lake. The model was then verified through a long term simulation using Lake Keowee data base. The comparison between measured and predicted vertical temperature profiles for the nine years is good. The physical limnology of Lake Keowee is presented through a set of graphical representations of the measured data base.

Lee, S. S.↗