Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A methodology to develop multi-physics dynamic fuel cell system models validated with vehicle realistic drive cycle data

Fuel cell (FC) technology has been identified as a technically attractive solution to decarbonize the transportation sector, especially for heavy-duty vehicles. In this context, the industry and the scientific community are in need of advanced fuel cell systems (FCS) models that are able to replicate real -world operating conditions. Due to the scarcity of said models in the open literature, this study aimed to develop a comprehensive methodology to calibrate and validate multi -physics dynamic FCS models. Therefore, the key contribution of this paper is the detailed description of the calibration process for each component and the calibration order. The specific focus here was to accurately describe the behavior of the FC stack as well as the cathode, anode, and cooling circuits of the balance of plant. The model was calibrated with the aid of experimental data from a Toyota Mirai FC electric vehicle, which was predominantly retrieved from the vehicle's Controller Area Network (CAN) bus system thereby negating the need for major intrusion into the powertrain system. The validation process was deemed successful with the model being able to truthfully replicate the characteristics of the FC vehicle operated on the World-wide harmonized Light duty Test Cycle (WLTC) 3b and US06 driving cycle. The time -resolved physical parameters such as the cathode pressure, mass flow, or the FC stack temperature were captured with high fidelity, while the overall performance parameters such as the H2 consumption in the stack and the system, and the compressor energy consumption were predicted accurately with a deviation lower than 0.47%, 1.75% and 1.89% with respect to the experimental data, respectively.

Lopez-Juarez, Marcos↗
NASA NTRS2023

Turbulence Model Validation Through Joint Experimental /Computational Studies of Separated Flow Over A Three-Dimensional Tapered Bump: Part I - Experimental Investigation

The results of a three-year experimental campaign aimed at comprehensively documenting the separated flow over a three-dimensional bump are presented with the purpose of generating a benchmark experimental database useful in validating computational fluid dynamics (CFD) flow simulations. The bump model geometry was designed to provide well-defined and repeatable smooth-body flow separation conditions that were suitable for both experiments and simulations. The bump had a Gaussian streamwise profile with a constant height equal to 8.5% of its width over the central 60% of the test section width. The remaining 40% were outboard spanwise portions that gradually taper to zero using an error function profile to minimize side-wall boundary layer effects. The model was immersed in a turbulent boundary layer that was developed on a suspended flat plate in the Notre Dame Mach 0.6 Wind Tunnel. In order to document the effect of the incoming boundary layer thickness on the flow separation, the bump model could be located at two streamwise positions. The mean velocity and turbulence intensity of the wind tunnel freestream flow field and approaching turbulent boundary layer were fully documented. The measurements of the flow separation region included surface visualization, wall shear stress using oil-film interferometry, mean and dynamic surface pressure, and planar and stereoscopic particle image velocimetry. The experiments were conducted over a range of Mach numbers from 0.05 to 0.2 corresponding to a range of Reynolds numbers based on the test section spanwise dimension (0.914m) of 1.0 × 10 6 ≤ Re L = U ∞ L/ν ≤ 4.0 × 10 6 . The bulk of the results are presented for the higher Mach number conditions of 0.1 and 0.2 with Re L = 2.0 × 10 6 and 4.0 × 10 6 , respectively. Extensive uncertainty analysis of the data was performed. The data is archived in the NASA Langley Turbulence Modeling Resource website at https://turbmodels.larc.nasa.gov/Other_exp_Data/speedbump_sep_exp.html. In addition to the experiments, a computational effort was made in parallel by the CFD group at Boeing Research & Technology highlighting the usefulness of the data set, which is outlined in the accompanying CFD report.

Flow separation↗
NASA NTRS2007

A Numerical Study of the Urban Heat Island in the Coastal Tropical City of San Juan, Puerto Rico: Model Validation and Impacts of LCLU Changes

Urban sprawls in tropical locations are rapidly accelerating and it is more evident in islands where a large percentage of the population resides along the coasts. This paper focuses on the analysis of the impacts of land use and land cover for urbanization in the tropical coastal city of San Juan, in the tropical island of Puerto Rico. A mesoscale numerical model, the Regional Atmospheric Modeling System (RAMS), is used to study specific characteristics and patterns of the urban heat island in the San Juan Metropolitan Area (SJMA), the most noticeable urban core of the Caribbean. The research present in this paper makes use of the observations obtained during the airborne San Juan Atlas Mission in two ways. First, surface and rawinsonde data are used to validate the atmospheric model yielding satisfactory results. Second, airborne remote sensing information is used to update the model's surface characteristics to obtain a detailed configuration of the SJMA in order to perform the LCLU changes impact analysis. This analysis showed that the presence of San Juan has an impact reflected in higher air temperatures over the area occupied by the city, with positive values of up to 2.5 C, for the simulations that have specified urban LCLU indexes in the bottom boundary. One interesting result of the impact analysis was the finding of a precipitation disturbance shown as a difference in total accumulated rainfall between simulation with the city and with a potential natural vegetation induced by the presence of the urban area. Model results indicate that the urban-induced cloud formation and precipitation development occur mainly downwind of the city, including the accumulated precipitation. This spatial pattern can be explained by the presence of a-larger urbanized area in the southwest sector of the city, and of the approaching northeasterly trade winds.

Comarazamy, Daniel E.↗
NASA NTRS2018

GT SUITE Fuel Cell Model Validation with Power Module Test Data

The AES Modular Power Systems (AMPS) Fuel Cell team at the NASA Glenn Research Center (GRC) has created a Microsoft Excel model of a regenerative fuel cell (RFC) system for potential lunar and Martian applications. Due to some limitations of this model, including the ability to predict transient effects in the thermal and fluidic performance of the system, a system-level transient thermal/fluids model was desired. GT-SUITE is a transient multi-physics simulation tool that is popular in the automotive industry and has a built in template for proton exchange membrane (PEM) fuel cells. However, terrestrial fuel cells used in the automotive industry vary significantly from aerospace fuel cells. A validation effort was undertaken to compare GT SUITE model results to actual data collected during the 2015 AMPS Power Module Demonstration in which the AMPS team used a PEM fuel cell system to power a 478 kg rover assembly at the Dunes test site located at GRC. The purpose of the model was to evaluate the efficacy of using GT SUITE to model a non-flow through PEM fuel cell system. The validation effort examined electrochemical performance including fuel cell stack voltage and power supplied, the thermal performance of the stack namely stack temperature and heat rejection rates, and the fluidic performance of the system including pressures, reactant consumption, and water production rates.

Gilligan, Ryan↗
NASA NTRS2000

Model Validation of Wake-Vortex/Aircraft Encounters

Wake-vortex effects on an 10% scale model of the B737-100 aircraft are calculated using both strip theory and vortex-lattice methods. The results are then compared to data taken in the 30ft x 60ft wind tunnel at NASA Langley Research Center (LaRC). The accuracy of the models for a reduced geometry, such with the horizontal stabilizer and the vertical tail removed, is also investigated. Using a 10% error in the circulation strength and comparing the model's results with the experiment illustrates the sensitivity of the models to the vortex circulation strength. It was determined that both strip theory and the vortex lattice method give accurate results when all the geometrical information is used. When the horizontal stabilizer and vertical tail were removed there were difficulties modeling the sideforce coefficient and pitching moment. With the removal of only the vertical tail unacceptable errors occurred when modeling the sideforce coefficient and yawing moment. Lift could not be accurately modeled with either the full geometry or the reduced geometry.

Pete, Kimberly R.↗
DOE OSTI2023

Directed Energy Deposition Process Modeling, Validation, and Process-Informed Optimization

The directed energy deposition (DED) process, one of the most popular additive manufacturing techniques in use today, involves various complex physical mechanisms that are not yet well understood. In this regard, computational tools show promise for elucidating the manufacturing process and enabling nondestructive performance evaluations of manufactured parts. To better control and optimize the DED process?thereby improving the manufactured product? the present work develops and demonstrates a novel artificial intelligence (AI)-based process control and optimization technique. Specifically, a geometry-free thermo-mechanical model with adaptive subdomain construction is developed to accurately capture the material?s thermo-mechanical response under cyclical reheating and high cooling rates [1]. The model is demonstrated and validated with experimental measurements, in light of various geometries and processing parameters. Moreover, based on this thermo-mechanical model, a physics-informed reduced-order model is developed to enable quick predictions of the temperature field at every time step. Furthermore, an AI-based controller is developed that can adapt to the ever-changing system states by automatically adjusting the manufacturing process parameters. This entire work is based on the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) [2] and its recent integration with Libtorch (the C++ frontend of PyTorch [3]). The combined development of the adaptive material deposition scheme, thermo-mechanical model, associated reduced-order model, and AI-based process controller carries great potential for improving advanced manufacturing processes.

36 MATERIALS SCIENCE↗
NASA NTRS2011

Highlights of Transient Plume Impingement Model Validation and Applications

This paper describes highlights of an ongoing validation effort conducted to assess the viability of applying a set of analytic point source transient free molecule equations to model behavior ranging from molecular effusion to rocket plumes. The validation effort includes encouraging comparisons to both steady and transient studies involving experimental data and direct simulation Monte Carlo results. Finally, this model is applied to describe features of two exotic transient scenarios involving NASA Goddard Space Flight Center satellite programs.

Woronowicz, Michael↗
NASA NTRSDate not supplied

SPHINX: A Generalized Tool for Solar Energetic Particle Model Validation

The Integrated Solar Energetic Proton Alert/Warning (ISEP) project was established to aid in the transition of SEP models from the research realm to operational use. This project is a collaboration between the NASA Community Coordinated Model Center (CCMC), the NASA Moon to Mars Space Weather Analysis Office (M2M) and the NASA Space Radiation Analysis Group (SRAG). Through ISEP, the SEP Scoreboards (Intensity, Probability, and All Clear) were developed to visualize real time forecasts from SEP models for use in SRAG operations. To accomplish this, SRAG, CCMC, and M2M work closely with modelers on model development, CCMC works on Scoreboard implementation, and M2M provides human-in-the-loop space weather analysis and ensures that models run in real time.

space weather↗
DOE OSTI2021

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model's suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
DOE OSTI2020

3D CFD Model Validation Using Benchmark Data of 1/16th Scaled VHTR Upper Plenum and Development of Wall Heat-Transfer Correlation For Laminar Flow

With support from the U.S. Department of Energy-Office of Nuclear Energy’s (DOE-NE’s) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, an effort has been pursued to support high-temperature gas-cooled reactor (HTGR) technology development and its modeling and simulation needs. There is a particular need for advanced modeling and simulation tools to predict thermal-fluid behavior in the nuclear reactor primary system, especially in the core and the lower and upper plena, during safety-related transients. In this report, two main such activities are presented relevant to the HTGRs: (1) three-dimensional (3D) computational fluid dynamics (CFD) validation using benchmark data from the upper plenum of Texas A&M University’s 1/16th scaled very-high-temperature gas-cooled reactor (VHTR), and (2) development of wall heat-transfer correlation for laminar flow in a wall-heated pipe. The CFD tool validation exercises can be helpful to choose the models and CFD tools to simulate and design specific components of the HTRGs such as upper plenum where jet mixing is a complex phenomenon. In a loss of forced circulation event, the laminar flow can be observed during the development of natural circulation flow. This work includes the development and validation of heat transfer correlations for laminar flow using the Nek5000 CFD code due to limited available experimental data for laminar flow conditions to guide low-order models (1D). In this report, the flow characteristics of a single isothermal jet discharging into the upper plenum was investigated using the Nek5000 Large-Eddy Simulation (LES) CFD tool. Several numerical simulations were performed for various jet-discharged Reynolds numbers ranging from 3,413 to 12,819. A grid-independent study was performed. The numerical results of mean velocity, root-mean-square fluctuating velocity, and Reynolds stress were compared against the benchmark data. Good agreement was obtained between simulated and measured data for axial mean velocities, except near the upper plenum hemisphere. The maximum predicted errors for axial mean velocities at various normalized coolant channel diameter heights of 1, 5, and 10 are 1.56%, 1.88%, and 3.82%, respectively. In addition, the predicted root-mean-square fluctuating velocity and Reynolds stress are qualitatively in agreement with the experimental data. The Nek5000 code was used to develop wall-heat transfer correlation for laminar flow in a cylindrical tube. Several simulations were performed for various Reynolds flow and wall-heat fluxes. A new heat transfer correlation was developed using data from Nek5000 simulation results and regression functions in Matlab. The developed heat transfer correlation is valid for various Reynolds flows from 200 to 2000. The predicted R² value for model fit was 0.875, which ensures that 87.5% of the model data lies on the Nek5000 data. Moreover, a machine learning (ML) tool was used to train and test the Nek5000 data. A good fit of the ML-based model was observed with the test data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

HelioScope Energy Performance Modeling Validation: Cooperative Research and Development Final Report, CRADA Number CRD-17-00685

HelioScope is a unique solar design and energy performance modeling tool that bridges the worlds of research and industry, bringing the most rigorous methods from the performance modeling community to thousands of solar developers of all backgrounds. However, many financial institutions and municipalities are hesitant to accept the energy production modeling results of HelioScope (including shading losses) in place of costly, time-intensive, and/or redundant methods due to lack of vetting from a respected institution like NREL. We expect that the proposed validation exercises will give municipalities and financial institutions the comfort needed to incorporate HelioScope into their operations, thereby significantly reducing the needs of existing and potential HelioScope users' to otherwise obtain information that HelioScope produces automatically. Folsom Labs was selected for a Small Business Voucher from the U.S. Department of Energy for the National Renewable Energy Laboratory to validate the performance of HelioScope’s simulation engine against measured PV system performance.

14 SOLAR ENERGY↗
DOE OSTI2026

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
NASA NTRS2008

Spectrally Resolved Flux Derived from Collocated AIRS and CERES Observations and its Application in Model Validation: Clear-Sky Over the Tropic Oceans - Part I

Spectrally resolved outgoing IR flux, the integrand of the outgoing longwave radiation (OLR), has its unique value in evaluating model simulations. Here we describe an algorithm of deriving such clear-sky outgoing spectral flux through the whole IR region from the collocated Atmospheric Infrared Sounder (AIRS) and the Clouds & the Earth's Radiant Energy System (CERES) measurements over the tropical oceans. Based on the scene types and corresponding angular distribution models (ADMs) used in the CERES Single Satellite Footprint (SSF) dataset, spectrally-dependent ADMs are developed and used to estimate the spectral flux at each AIRS channel. A multivariate linear prediction scheme is then used to estimate spectral fluxes at frequencies not covered by the AIRS instrument. The whole algorithm is validated using synthetic spectra as well as the CERES OLR measurements. Using the GFDL AM2 model simulation as a case study, the application of the derived clear-sky outgoing spectral flux in model evaluation is illustrated. By comparing the observed and simulated spectral flux in 2004, compensating errors in the simulated OLR from different absorption bands can be revealed, so does the errors from frequencies within a given absorption band. Discrepancies between the simulated and observed spatial distributions and seasonal evolutions of the spectral fluxes at different spectral ranges are further discussed. The methodology described in this study can be applied to other surface types as well as cloudy-sky observations and corresponding model evaluations.

Huang, Xianglei↗
NASA NTRS2018

Quantification of Dynamic Model Validation Metrics Using Uncertainty Propagation from Requirements

The Space Launch System, NASA's new large launch vehicle for long range space exploration, is presently in the final design and construction phases, with the first launch scheduled for 2019. A dynamic model of the system has been created and is critical for calculation of interface loads and natural frequencies and mode shapes for guidance, navigation, and control (GNC). Because of the program and schedule constraints, a single modal test of the SLS will be performed while bolted down to the Mobile Launch Pad just before the first launch. A Monte Carlo and optimization scheme will be performed to create thousands of possible models based on given dispersions in model properties and to determine which model best fits the natural frequencies and mode shapes from modal test. However, the question still remains as to whether this model is acceptable for the loads and GNC requirements. An uncertainty propagation and quantification (UP and UQ) technique to develop a quantitative set of validation metrics that is based on the flight requirements has therefore been developed and is discussed in this paper. There has been considerable research on UQ and UP and validation in the literature, but very little on propagating the uncertainties from requirements, so most validation metrics are "rules-of-thumb;" this research seeks to come up with more reason-based metrics. One of the main assumptions used to achieve this task is that the uncertainty in the modeling of the fixed boundary condition is accurate, so therefore that same uncertainty can be used in propagating the fixed-test configuration to the free-free actual configuration. The second main technique applied here is the usage of the limit-state formulation to quantify the final probabilistic parameters and to compare them with the requirements. These techniques are explored with a simple lumped spring-mass system and a simplified SLS model. When completed, it is anticipated that this requirements-based validation metric will provide a quantified confidence and probability of success for the final SLS dynamics model, which will be critical for a successful launch program, and can be applied in the many other industries where an accurate dynamic model is required.

Brown, Andrew M.↗
DOE OSTI2025

Experimental platforms for investigating feature-driven jets for HED mix model validation

High-energy-density (HED) systems, such as inertial confinement fusion (ICF), are susceptible to hydrodynamic instabilities that can significantly affect both experimental results and modeling predictions. Isolated features, such as fill tubes or divots in the capsule, can cause material to jet as a result of the compressive shock exciting the Richtmyer–Meshkov instability, and serve as one of the primary degradation mechanisms in ICF yield. Simulations of feature-driven jets and how they mix require extensive experimental validation, particularly for understanding to what degree the initial size and shape of a feature influence jet dynamics, and how much instability feeds through downstream layers. A better understanding of feature-driven jetting can improve our mix modeling capabilities and increase hydrodynamic simulation accuracy. This manuscript describes a series of experimental platforms fielded by Los Alamos National Laboratory as a part of the Mshock Omega 60 and ModCons Omega EP campaigns to explore feature-driven jetting. These platforms are designed to benchmark jet evolution and growth as a function of initial feature size and shape, investigate jet-layer interactions leading to instability feedthrough, and will be used to characterize jet-jet interactions resulting from clusters of features. In conclusion, preliminary results for both platforms are shown. The ModCons experiments are on-going, and a discussion of future work directions is included.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1993

A nonhydrostatic version of the Penn State-NCAR Mesoscale Model - Validation tests and simulation of an Atlantic cyclone and cold front

A nonhydrostatic extension to the Pennsylvania State University-NCAR Mesoscale Model is presented, which employs reference pressure as the basis for a terrain-following vertical coordinate, and the fully compressible system of equations. It is shown that this model, combined with the existing initialization techniques and the physics of the current hydrostatic model, is capable of real-data simulations on any scale, limited only by data quality and resolution and by computer resources. An example of an explosive cyclone simulation is presented, demonstrating the capability of the nonhydrostatic model to reproduce the hydrostatic model results at large scales.

Dudhia, Jimy↗