Search NASASearch

SEARCH · Search NASA

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

SPHINX: A Generalized Tool for Solar Energetic Particle Model Validation

The Integrated Solar Energetic Proton Alert/Warning (ISEP) project was established to aid in the transition of SEP models from the research realm to operational use. This project is a collaboration between the NASA Community Coordinated Model Center (CCMC), the NASA Moon to Mars Space Weather Analysis Office (M2M) and the NASA Space Radiation Analysis Group (SRAG). Through ISEP, the SEP Scoreboards (Intensity, Probability, and All Clear) were developed to visualize real time forecasts from SEP models for use in SRAG operations. To accomplish this, SRAG, CCMC, and M2M work closely with modelers on model development, CCMC works on Scoreboard implementation, and M2M provides human-in-the-loop space weather analysis and ensures that models run in real time.

space weather

HelioScope Energy Performance Modeling Validation: Cooperative Research and Development Final Report, CRADA Number CRD-17-00685

HelioScope is a unique solar design and energy performance modeling tool that bridges the worlds of research and industry, bringing the most rigorous methods from the performance modeling community to thousands of solar developers of all backgrounds. However, many financial institutions and municipalities are hesitant to accept the energy production modeling results of HelioScope (including shading losses) in place of costly, time-intensive, and/or redundant methods due to lack of vetting from a respected institution like NREL. We expect that the proposed validation exercises will give municipalities and financial institutions the comfort needed to incorporate HelioScope into their operations, thereby significantly reducing the needs of existing and potential HelioScope users' to otherwise obtain information that HelioScope produces automatically. Folsom Labs was selected for a Small Business Voucher from the U.S. Department of Energy for the National Renewable Energy Laboratory to validate the performance of HelioScope’s simulation engine against measured PV system performance.

14 SOLAR ENERGY

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS

Spectrally Resolved Flux Derived from Collocated AIRS and CERES Observations and its Application in Model Validation: Clear-Sky Over the Tropic Oceans - Part I

Spectrally resolved outgoing IR flux, the integrand of the outgoing longwave radiation (OLR), has its unique value in evaluating model simulations. Here we describe an algorithm of deriving such clear-sky outgoing spectral flux through the whole IR region from the collocated Atmospheric Infrared Sounder (AIRS) and the Clouds & the Earth's Radiant Energy System (CERES) measurements over the tropical oceans. Based on the scene types and corresponding angular distribution models (ADMs) used in the CERES Single Satellite Footprint (SSF) dataset, spectrally-dependent ADMs are developed and used to estimate the spectral flux at each AIRS channel. A multivariate linear prediction scheme is then used to estimate spectral fluxes at frequencies not covered by the AIRS instrument. The whole algorithm is validated using synthetic spectra as well as the CERES OLR measurements. Using the GFDL AM2 model simulation as a case study, the application of the derived clear-sky outgoing spectral flux in model evaluation is illustrated. By comparing the observed and simulated spectral flux in 2004, compensating errors in the simulated OLR from different absorption bands can be revealed, so does the errors from frequencies within a given absorption band. Discrepancies between the simulated and observed spatial distributions and seasonal evolutions of the spectral fluxes at different spectral ranges are further discussed. The methodology described in this study can be applied to other surface types as well as cloudy-sky observations and corresponding model evaluations.

Huang, Xianglei

Quantification of Dynamic Model Validation Metrics Using Uncertainty Propagation from Requirements

The Space Launch System, NASA's new large launch vehicle for long range space exploration, is presently in the final design and construction phases, with the first launch scheduled for 2019. A dynamic model of the system has been created and is critical for calculation of interface loads and natural frequencies and mode shapes for guidance, navigation, and control (GNC). Because of the program and schedule constraints, a single modal test of the SLS will be performed while bolted down to the Mobile Launch Pad just before the first launch. A Monte Carlo and optimization scheme will be performed to create thousands of possible models based on given dispersions in model properties and to determine which model best fits the natural frequencies and mode shapes from modal test. However, the question still remains as to whether this model is acceptable for the loads and GNC requirements. An uncertainty propagation and quantification (UP and UQ) technique to develop a quantitative set of validation metrics that is based on the flight requirements has therefore been developed and is discussed in this paper. There has been considerable research on UQ and UP and validation in the literature, but very little on propagating the uncertainties from requirements, so most validation metrics are "rules-of-thumb;" this research seeks to come up with more reason-based metrics. One of the main assumptions used to achieve this task is that the uncertainty in the modeling of the fixed boundary condition is accurate, so therefore that same uncertainty can be used in propagating the fixed-test configuration to the free-free actual configuration. The second main technique applied here is the usage of the limit-state formulation to quantify the final probabilistic parameters and to compare them with the requirements. These techniques are explored with a simple lumped spring-mass system and a simplified SLS model. When completed, it is anticipated that this requirements-based validation metric will provide a quantified confidence and probability of success for the final SLS dynamics model, which will be critical for a successful launch program, and can be applied in the many other industries where an accurate dynamic model is required.

Brown, Andrew M.

Experimental platforms for investigating feature-driven jets for HED mix model validation

High-energy-density (HED) systems, such as inertial confinement fusion (ICF), are susceptible to hydrodynamic instabilities that can significantly affect both experimental results and modeling predictions. Isolated features, such as fill tubes or divots in the capsule, can cause material to jet as a result of the compressive shock exciting the Richtmyer–Meshkov instability, and serve as one of the primary degradation mechanisms in ICF yield. Simulations of feature-driven jets and how they mix require extensive experimental validation, particularly for understanding to what degree the initial size and shape of a feature influence jet dynamics, and how much instability feeds through downstream layers. A better understanding of feature-driven jetting can improve our mix modeling capabilities and increase hydrodynamic simulation accuracy. This manuscript describes a series of experimental platforms fielded by Los Alamos National Laboratory as a part of the Mshock Omega 60 and ModCons Omega EP campaigns to explore feature-driven jetting. These platforms are designed to benchmark jet evolution and growth as a function of initial feature size and shape, investigate jet-layer interactions leading to instability feedthrough, and will be used to characterize jet-jet interactions resulting from clusters of features. In conclusion, preliminary results for both platforms are shown. The ModCons experiments are on-going, and a discussion of future work directions is included.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

A nonhydrostatic version of the Penn State-NCAR Mesoscale Model - Validation tests and simulation of an Atlantic cyclone and cold front

A nonhydrostatic extension to the Pennsylvania State University-NCAR Mesoscale Model is presented, which employs reference pressure as the basis for a terrain-following vertical coordinate, and the fully compressible system of equations. It is shown that this model, combined with the existing initialization techniques and the physics of the current hydrostatic model, is capable of real-data simulations on any scale, limited only by data quality and resolution and by computer resources. An example of an explosive cyclone simulation is presented, demonstrating the capability of the nonhydrostatic model to reproduce the hydrostatic model results at large scales.

Dudhia, Jimy

The 2006 Cape Canaveral Air Force Station Range Reference Atmosphere Model Validation Study and Sensitivity Analysis to the National Aeronautics and Space Administration's Space Shuttle

The 2006 Cape Canaveral Air Force Station (CCAFS) Range Reference Atmosphere (RRA) is a statistical model summarizing the wind and thermodynamic atmospheric variability from surface to 70 kin. Launches of the National Aeronautics and Space Administration's (NASA) Space Shuttle from Kennedy Space Center utilize CCAFS RRA data to evaluate environmental constraints on various aspects of the vehicle during ascent. An update to the CCAFS RRA was recently completed. As part of the update, a validation study on the 2006 version was conducted as well as a comparison analysis of the 2006 version to the existing CCAFS RRA database version 1983. Assessments to the Space Shuttle vehicle ascent profile characteristics were performed to determine impacts of the updated model to the vehicle performance. Details on the model updates and the vehicle sensitivity analyses with the update model are presented.

Burns, Lee

Experimental Space Shuttle Orbiter Studies to Acquire Data for Code and Flight Heating Model Validation

In an experimental study to obtain detailed heating data over the Space Shuttle Orbiter, CUBRC has completed an extensive matrix of experiments using three distinct models and two unique hypervelocity wind tunnel facilities. This detailed data will be employed to assess heating augmentation due to boundary layer transition on the Orbiter wing leading edge and wind side acreage with comparisons to computational methods and flight data obtained during the Orbiter Entry Boundary Layer Flight Experiment and HYTHIRM during STS-119 reentry. These comparisons will facilitate critical updates to be made to the engineering tools employed to make assessments about natural and tripped boundary layer transition during Orbiter reentry. To achieve the goals of this study data was obtained over a range of Mach numbers from 10 to 18, with flight scaled Reynolds numbers and model attitudes representing key points on the Orbiter reentry trajectory. The first of these studies were performed as an integral part of Return to Flight activities following the accident that occurred during the reentry of the Space Shuttle Columbia (STS-107) in February of 2003. This accident was caused by debris, which originated from the foam covering the external tank bipod fitting ramps, striking and damaging critical wing leading edge heating tiles that reside in the Orbiter bow shock/wing interaction region. During investigation of the accident aeroheating team members discovered that only a limited amount of experimental wing leading edge data existed in this critical peak heating area and a need arose to acquire a detailed dataset of heating in this region. This new dataset was acquired in three phases consisting of a risk mitigation phase employing a 1.8% scale Orbiter model with special temperature sensitive paint covering the wing leading edge, a 0.9% scale Orbiter model with high resolution thin-film instrumentation in the span direction, and the primary 1.8% scale Orbiter model with detailed thin-film resolution in both the span and chord direction in the area of peak heating. Additional objectives of this first study included: obtaining natural or tripped turbulent wing leading edge heating levels, assessing the effectiveness of protuberances and cavities placed at specified locations on the orbiter over a range of Mach numbers and Reynolds numbers to evaluate and compare to existing engineering and computational tools, obtaining cavity floor heating to aid in the verification of cavity heating correlations, acquiring control surface deflection heating data on both the main body flap and elevons, and obtain high speed schlieren videos of the interaction of the orbiter nose bow shock with the wing leading edge. To support these objectives, the stainless steel 1.8% scale orbiter model in addition to the sensors on the wing leading edge was instrumented down the windward centerline, over the wing acreage on the port side, and painted with temperature sensitive paint on the starboard side wing acreage. In all, the stainless steel 1.8% scale Orbiter model was instrumented with over three-hundred highly sensitive thin-film heating sensors, two-hundred of which were located in the wing leading edge shock interaction region. Further experimental studies will also be performed following the successful acquisition of flight data during the Orbiter Entry Boundary Layer Flight Experiment and HYTHIRM on STS-119 at specific data points simulating flight conditions and geometries. Additional instrumentation and a protuberance matching the layout present during the STS-119 boundary layer transition flight experiment were added with testing performed at Mach number and Reynolds number conditions simulating conditions experienced in flight. In addition to the experimental studies, CUBRC also performed a large amount of CFD analysis to confirm and validate not only the tunnel freestream conditions, but also 3D flows over the orbiter acreage, wing leading edge, and controlurfaces to assess data quality, shock interaction locations, and control surface separation regions. This analysis is a standard part of any experimental program at CUBRC, and this information was of key importance for post-test data quality analysis and understanding particular phenomena seen in the data. All work during this effort was sponsored and paid for by the NASA Space Shuttle Program Office at the Johnson Space Center in Houston, Texas.

Wadhams, T. P.

The 2006 Kennedy Space Center Range Reference Atmosphere Model Validation Study and Sensitivity Analysis to the Performance of the National Aeronautics and Space Administration's Space Shuttle Vehicle

The Kennedy Space Center (KSC) Range Reference Atmosphere (RRA) is a statistical model that summarizes wind and thermodynamic atmospheric variability from surface to 70 km. The National Aeronautics and Space Administration's (NASA) Space Shuttle program, which launches from KSC, utilizes the KSC RRA data to evaluate environmental constraints on various aspects of the vehicle during ascent. An update to the KSC RRA was recently completed. As part of the update, the Natural Environments Branch at NASA's Marshall Space Flight Center (MSFC) conducted a validation study and a comparison analysis to the existing KSC RRA database version 1983. Assessments to the Space Shuttle vehicle ascent profile characteristics were performed by JSC/Ascent Flight Design Division to determine impacts of the updated model to the vehicle performance. Details on the model updates and the vehicle sensitivity analyses with the update model are presented.

Burns, Lee

Base Flow Model Validation

A method was developed of obtaining propulsive base flow data in both hot and cold jet environments, at Mach numbers and altitude of relevance to NASA launcher designs. The base flow data was used to perform computational fluid dynamics (CFD) turbulence model assessments of base flow predictive capabilities in order to provide increased confidence in base thermal and pressure load predictions obtained from computational modeling efforts. Predictive CFD analyses were used in the design of the experiments, available propulsive models were used to reduce program costs and increase success, and a wind tunnel facility was used. The data obtained allowed assessment of CFD/turbulence models in a complex flow environment, working within a building-block procedure to validation, where cold, non-reacting test data was first used for validation, followed by more complex reacting base flow validation.

Sinha, Neeraj

4BCO2 Model Validation and Comparisons Between Simulation and Ground and ISS Telemetry Data

The 4-bed CO2Scrubber (4BCO2), used to remove carbon dioxide from the atmosphere of the International Space Station(ISS), was built to improve upon its predecessors to meet the air revitalization needs of future missions. During this internship session, a Matlab wrapper of COMSOL models used to simulate the operation of the 4BCO2 unit was improved upon and validated against both ground test data and flight test data from the currently operating 4BCO2 unit. This presentation details the results of the activities and exercises performed during this internship session, such as the discussion on the plots generated from least squares minimization of the simulation linear driving force and sorbent bed dispersion correction factor multiplier. Plots derived from the collection and processing of telemetry data from the 4BCO2 unit aboard the ISS are discussed in relation to the work processing work performed, and comparisons between real-time CO2 removal rates and simulation removal rates are also discussed.

Larissa Lagria

A Causal Approach to Model Validation and Calibration

This poster presents a novel method for validation and verification that focuses on identifying causal relationships between data elements, moving beyond traditional statistical and machine learning approaches. These methods employ causal discovery techniques to reveal the underlying mechanisms of data generation. The research utilizes structural causal models and directed acyclic graphs to depict causal relationships. This approach assists in achieving alignment between simulation models and reality.

97 MATHEMATICS AND COMPUTING

Development of a validation model for the defense meteorological satellite program's special sensor microwave imager

The Defence Meteorological Space Program's (DMSP) Special Sensor Microwave/Imager (SSM/I), an operational wind speed algorithm was developed. The algorithm is based on the D-matrix approach which seeks a linear relationship between measured SSM/I brightness temperatures and environmental parameters. D-matrix performance was validated by comparing algorithm derived wind speeds with near-simultaneous and co-located measurements made by off-shore ocean buoys. Other topics include error budget modeling, alternate wind speed algorithms, and D-matrix performance with one or more inoperative SSM/I channels.

Swift, C. T.

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling

Air-Cooled RCCS CFD Modeling Validation 2025

Slide deck for the Advanced Reactor Technologies Gas Cooled Reactor (ART-GCR) program review. The slides show the progress on the air-cooled reactor cavity cooling system (RCCS) CFD validation work. The validation of the air-cooled RCCS is performed using the experimental facility at the University of Wisconsin-Madison. The slide deck provides a progress update on this year's achievements. The natural convection tests under uniform power are modeled and compared with the experimental results. The results show good agreement with the experimental results. A sensitivity study on the RANS turbulence models is performed. Additionally, the contribution of radiative and convective heat transfer within the heated cavity is calculated and compared to forced convection setups.

22 - GENERAL STUDIES OF NUCLEAR REACTORS