Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Real-time remote scientific model validation

This paper describes flight results from the use of a CLIPS-based validation facility to compare analyzed data from a space life sciences (SLS) experiment to an investigator's preflight model. The comparison, performed in real-time, either confirms or refutes the model and its predictions. This result then becomes the basis for continuing or modifying the investigator's experiment protocol. Typically, neither the astronaut crew in Spacelab nor the ground-based investigator team are able to react to their experiment data in real time. This facility, part of a larger science advisor system called Principal Investigator in a Box, was flown on the space shuttle in October, 1993. The software system aided the conduct of a human vestibular physiology experiment and was able to outperform humans in the tasks of data integrity assurance, data analysis, and scientific model validation. Of twelve preflight hypotheses associated with investigator's model, seven were confirmed and five were rejected or compromised.

Frainier, Richard↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

Model validation of SIM external metrology at the sub-nanometer level

In order to achieve micro-arcsecond astrometry, SIM must make measurements of various optical path lengths at the picometer level. In this regime of precision, nearly every simplifying assumption in optics must be reexamined as a potential source of systematic error. SIM makes extensive use of physics-based models to predict the form and level of systematic errors affecting instrument performance. Since many of the modeling areas represent new frontiers in optical modeling, the validation of these physical models is a significant challenge that SIM must meet. In the case of the external metrology truss, the model must account for the imperfections in the corner cubes as well as the distance measuring interferometers ("beam launchers"). This model is being validated using the Kite testbed, a 2-D metrology truss with picometer-level accuracy in displacement measurements. We present the model and the results of the model validation tests on the Kite testbed.

Kuan, Gary M.↗
NASA NTRS1997

Closed Form Solution for Minimum Norm Model-Validating Uncertainty

A methodology in which structured uncertainty models are directly constructed from measurement data for use in robust control design of multivariable systems is proposed. The formulation allows a general linear fractional transformation uncertainty structure connections with respect to a given nominal model. Existence conditions are given, and under mild assumptions, a closed-form expression for the smallest norm structured uncertainty that validates the model is given. The uncertainty bound computation is simple and is formulated for both open and closed loop systems.

Lim, Kyong Been↗
NASA NTRS2017

Model Validation for Propulsion - On the TFNS and LES Subgrid Models for a Bluff Body Stabilized Flame

This paper summarizes the reacting results of simulating a bluff body stabilized flame experiment of Volvo Validation Rig using a releasable edition of the National Combustion Code (NCC). The turbulence models selected to investigate the configuration are the sub-grid scaled kinetic energy coupled large eddy simulation (K-LES) and the time-filtered Navier-Stokes (TFNS) simulation. The turbulence chemistry interaction used is linear eddy mixing (LEM).

Flame↗
DOE OSTI2020

SRS Composite Analysis Monitoring Plan (FY2019 Model Validation)

Using a projected end-state date of 2065 (SRNS 2015b), the Savannah River Site (SRS) Composite Analysis (CA) modeling for each facility and waste site began on the inventory year assigned to it so that source depletion and radionuclide transport out of the system could be appropriately captured. Some SRS waste sites that have already achieved their end states (i.e. end-state inventories and end-state configuration) are currently contributing to the potential off-site public dose through source release, groundwater transport, discharge to on-site surface streams, and stream transport to the CA point of assessments (POAs). The inventory year assigned to these waste sites is 2002 or before. This means that SRS CA results from 2002 and beyond are a reasonable representation for these waste sites that have already achieved their end states and are currently contributing to the potential off-site public dose. The SRS Annual Environmental Report (AER) monitoring can differentiate and separate liquid pathway data allowing the data representing only waste sites at their end state to be produced. Because the SRS CA has projected reasonable end-state impacts from 2002 and beyond, and the AER monitoring can differentiate and separate operating and end-state contributions to annual liquid pathway release, an opportunity exists to use the AER monitoring data to validate the SRS CA model. The CA model validation program uses a graded and systematic approach for taking corrective action, starting with an SRS established administrative dose limit of 15 mrem/yr, below which no action is required. Based on the location of the 2010 SRS CA POAs, the only potential exposure pathway for the public is through surface water. The completion of the FY2019 CA model validation indicates that the SRS CA projected dose, while generally conservative, provides a reasonable representation of the maximum annual doses. These doses are well below the administrative limit; therefore, no additional action is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2011

Supersonic Retro-Propulsion Experimental Design for Computational Fluid Dynamics Model Validation

The development of supersonic retro-propulsion, an enabling technology for heavy payload exploration missions to Mars, is the primary focus for the present paper. A new experimental model, intended to provide computational fluid dynamics model validation data, was recently designed for the Langley Research Center Unitary Plan Wind Tunnel Test Section 2. Pre-test computations were instrumental for sizing and refining the model, over the Mach number range of 2.4 to 4.6, such that tunnel blockage and internal flow separation issues would be minimized. A 5-in diameter 70-deg sphere-cone forebody, which accommodates up to four 4:1 area ratio nozzles, followed by a 10-in long cylindrical aftbody was developed for this study based on the computational results. The model was designed to allow for a large number of surface pressure measurements on the forebody and aftbody. Supplemental data included high-speed Schlieren video and internal pressures and temperatures. The run matrix was developed to allow for the quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and bias errors due to flow field or model misalignments. Some preliminary results and observations from the test are presented, although detailed analyses of the data and uncertainties are still on going.

Berry, Scott A.↗
DOE OSTI2023

Hydrogen and Ammonia Blending With Natural Gas: Ignition Delay Times and Chemical Kinetic Model Validation at Gas Turbine Relevant Conditions

Abstract Ignition delay times from undiluted mixtures of natural gas (NG)/H2/Air and NG/NH3/Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000–1500 K near a constant pressure of 25 bar. As mentioned, mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data is compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH3 fuel addition made no noticeable difference in ignition time. NG/NH3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis. The reaction CH3 + O2 = CH3O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

Pierro, Michael↗
NASA NTRS1990

Diurnal ocean surface layer model validation

The diurnal ocean surface layer (DOSL) model at the Fleet Numerical Oceanography Center forecasts the 24-hour change in a global sea surface temperatures (SST). Validating the DOSL model is a difficult task due to the huge areas involved and the lack of in situ measurements. Therefore, this report details the use of satellite infrared multichannel SST imagery to provide day and night SSTs that can be directly compared to DOSL products. This water-vapor-corrected imagery has the advantages of high thermal sensitivity (0.12 C), large synoptic coverage (nearly 3000 km across), and high spatial resolution that enables diurnal heating events to be readily located and mapped. Several case studies in the subtropical North Atlantic readily show that DOSL results during extreme heating periods agree very well with satellite-imagery-derived values in terms of the pattern of diurnal warming. The low wind and cloud-free conditions necessary for these events to occur lend themselves well to observation via infrared imagery. Thus, the normally cloud-limited aspects of satellite imagery do not come into play for these particular environmental conditions. The fact that the DOSL model does well in extreme events is beneficial from the standpoint that these cases can be associated with the destruction of the surface acoustic duct. This so-called afternoon effect happens as the afternoon warming of the mixed layer disrupts the sound channel and the propagation of acoustic energy.

Hawkins, Jeffrey D.↗
NASA NTRS1986

UH-60 Black Hawk engineering simulation model validation and proposed modifications

The engineering simulation model of the UH-60A Black Hawk was validated using comparisons of model time histories with flight test data and updated to improve the fidelity of the model. The flight test data, acquired by the Army Aviation Engineering Flight Activity and consisting of 90 time histories of transient responses to step and pulse control inputs and 16 sets of steady flight data, were processed and compared to corresponding model time histories and trim data by Sikorsky. The current UH-60A model was judged to provide an acceptably accurate simulation for use as an analytical tool, certain unsatisfactory areas were identified and potential approaches to produce a more representative simulation were evaluated.

Kaplita, Thaddeus T.↗
DOE OSTI2022

Overview of the TJ-II stellarator research programme towards model validation in fusion plasmas

TJ-II stellarator results on modelling and validation of plasma flow asymmetries due to on-surface potential variations, plasma fuelling physics, Alfvén eigenmodes (AEs) control and stability, the interplay between turbulence and neoclassical (NC) mechanisms and liquid metals are reported. Regarding the validation of the neoclassically predicted potential asymmetries, its impact on the radial electric field along the flux surface has been successfully validated against Doppler reflectometry measurements. Research on the physics and modelling of plasma core fuelling with pellets and tracer encapsulated solid pellet injection has shown that, although post-injection particle radial redistributions can be understood qualitatively from NC mechanisms, turbulence and fluctuations are strongly affected during the ablation process. Advanced analysis tools based on transfer entropy have shown that radial electric fields do not only affect the radial turbulence correlation length but are also capable of reducing the propagation of turbulence from the edge into the scrape-off layer. Direct experimental observation of long range correlated structures show that zonal flow structures are ubiquitous in the whole plasma cross-section in the TJ-II stellarator. Alfvénic activity control strategies using ECRH and ECCD as well as the relation between zonal structures and AEs are reported. Finally, the behaviour of liquid metals exposed to hot and cold plasmas in a capillary porous system container was investigated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗
NASA NTRS2001

Shuttle Spacesuit: Fabric/LCVG Model Validation

A detailed spacesuit computational model is being developed at the Langley Research Center for radiation exposure evaluation studies. The details of the construction of the spacesuit are critical to estimation of exposures and assessing the risk to the astronaut on EVA. Past evaluations of spacesuit shielding properties assumed the basic fabric lay-up (Thermal Micrometeroid Garment, fabric restraints, and pressure envelope) and Liquid Cooling and Ventilation Garment (LCVG) could be homogenized as a single layer overestimating the protective properties over 60 percent of the fabric area. The present spacesuit model represents the inhomogeneous distributions of LCVG materials (mainly the water filled cooling tubes). An experimental test is performed using a 34-MeV proton beam and highresolution detectors to compare with model-predicted transmission factors. Some suggestions are made on possible improved construction methods to improve the spacesuit's protection properties.

Wilson, J. W.↗
NASA NTRS2001

Shuttle Spacesuit: Fabric/LCVG Model Validation

A detailed spacesuit computational model is being developed at the Langley Research Center for radiation exposure evaluation studies. The details of the construction of the spacesuit are critical to estimation of exposures and assessing the risk to the astronaut on EVA. Past evaluations of spacesuit shielding properties assumed the basic fabric lay-up (Thermal Micrometeroid Garment, fabric restraints, and pressure envelope) and Liquid Cooling and Ventilation Garment (LCVG) could be homogenized as a single layer overestimating the protective properties over 60 percent of the fabric area. The present spacesuit model represents the inhomogeneous distributions of LCVG materials (mainly the water filled cooling tubes). An experimental test is performed using a 34-MeV proton beam and high- resolution detectors to compare with model-predicted transmission factors. Some suggestions are made on possible improved construction methods to improve the spacesuit's protection properties.

Wilson, J. W.↗
NASA NTRS2017

Model Validation for Propulsion - On the TFNS and LES Subgrid Models for a Bluff Body Stabilized Flame

With advances in computational power and availability of distributed computers, the use of even the most complex of turbulent chemical interaction models in combustors and coupled analysis of combustors and turbines is now possible and more and more affordable for realistic geometries. Recent more stringent emission standards have enticed the development of more fuel-efficient and low-emission combustion system for aircraft gas turbine applications. It is known that the NOx emissions tend to increase dramatically with increasing flame temperature. It is well known that the major difficulty, when modeling the turbulence-chemistry interaction, lies in the high non-linearity of the reaction rate expressed in terms of the temperature and species mass fractions. The transport filtered density function (FDF) model and the linear eddy model (LEM), which both use local instantaneous values of the temperature and mass fractions, have been shown to often provide more accurate results of turbulent combustion. In the present, the time-filtered Navier-Stokes (TFNS) approach capable of capturing unsteady flow structures important for turbulent mixing in the combustion chamber and two different subgrid models, LEM-like and EUPDF-like, capable of emulating the major processes occurring in the turbulence-chemistry interaction will be used to perform reacting flow simulations of a selected test case. The selected test case from the Volvo Validation Rig was documented by Sjunnesson.

bluff body↗
NASA NTRS2011

Cryogenic Thermal Distortion Model Validation for the JWST ISIM Structure

The James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) Structure is a precision optical metering structure for the JWST science instruments. Optomechanical performance requirements place stringent limits on the allowable thermal distortion of the metering structure. A significant effort was completed to develop capabilities to predict and metrologize cryogenic thermal distortion of the ISIM Structure. This paper focuses on thermal distortion finite element modeling, analysis, and model validation. Extensive thermal distortion analysis was completed during the design phase for the ISIM Structure to demonstrate that thermal distortion requirements were achieved. Comparison of measurements from recently completed cryogenic testing and model predictions demonstrate the adequacy of thermal distortion modeling uncertainty factors adopted during the design phase, and provide bounds on the accuracy of the model predictions. This paper will provide an overview of the test configurations, describe the thermal distortion models of the tests, and provide a comparison of test results and analytical predictions from the models.

Johnston, John D.↗
NASA NTRS2009

Ablation and Thermal Response Property Model Validation for Phenolic Impregnated Carbon Ablator

Phenolic Impregnated Carbon Ablator was the heatshield material for the Stardust probe and is also a candidate heatshield material for the Orion Crew Module. As part of the heatshield qualification for Orion, physical and thermal properties were measured for newly manufactured material, included emissivity, heat capacity, thermal conductivity, elemental composition, and thermal decomposition rates. Based on these properties, an ablation and thermal-response model was developed for temperatures up to 3500 K and pressures up to 100 kPa. The model includes orthotropic and pressure-dependent thermal conductivity. In this work, model validation is accomplished by comparison of predictions with data from many arcjet tests conducted over a range of stagnation heat flux and pressure from 107 Watts per square centimeter at 2.3 kPa to 1100 Watts per square centimeter at 84 kPa. Over the entire range of test conditions, model predictions compare well with measured recession, maximum surface temperatures, and in depth temperatures.

Milos, F. S.↗