Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Advancing a Model-Validated Statistical Method for Decomposing the Key Oceanic Drivers of Regional Climate: Focus on Northern and Tropical African Climate Variability in the Community Earth System Model (CESM)

This study advances the practicality and stability of the traditional multivariate statistical method, generalized equilibrium feedback assessment (GEFA), for decomposing the key oceanic drivers of regional atmospheric variability, especially when available data records are short. An advanced stepwise GEFA methodology is introduced, in which unimportant forcings within the forcing matrix are eliminated through stepwise selection. Method validation of stepwise GEFA is performed using the CESM, with a focused application to northern and tropical Africa (NTA). First, a statistical assessment of the atmospheric response to each primary oceanic forcing is carried out by applying stepwise GEFA to a fully coupled control run. Then, a dynamical assessment of the atmospheric response to individual oceanic forcings is performed through ensemble experiments by imposing sea surface temperature anomalies over focal ocean basins. Finally, to quantify the reliability of stepwise GEFA, the statistical assessment is evaluated against the dynamical assessment in terms of four metrics: the percentage of grid cells with consistent response sign, the spatial correlation of atmospheric response patterns, the area-averaged seasonal cycle of response magnitude, and consistency in associated mechanisms between assessments. In CESM, tropical modes, namely El Niño–Southern Oscillation and the tropical Indian Ocean Basin, tropical Indian Ocean dipole, and tropical Atlantic Niño modes, are the dominant oceanic controls of NTA climate. In complementary studies, stepwise GEFA is validated in terms of isolating terrestrial forcings on the atmosphere, and observed oceanic and terrestrial drivers of NTA climate are extracted to establish an observational benchmark for subsequent coupled model evaluation and development of process-based weights for regional climate projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Model Validation for the FY2021 SRS Composite Analysis Monitoring Plan

Using a projected end-state date of 2065 (SRNS 2015b), the Savannah River Site (SRS) Composite Analysis (CA) modeling for each facility and waste site began on the inventory year assigned to it so that source depletion and radionuclide transport out of the system could be appropriately captured. Some SRS waste sites that have already achieved their end states (i.e., end-state inventories and end-state configuration) are currently contributing to the potential off-site public dose through source release, groundwater transport, discharge to on-site surface streams, and stream transport to the CA point of assessments (POAs). The inventory year assigned to these waste sites is 2002 or before. This means that SRS CA results from 2002 and beyond are a reasonable representation for these waste sites that have already achieved their end states and are currently contributing to the potential off-site public dose. The SRS Annual Environmental Report (AER) monitoring can differentiate and separate liquid pathway data allowing the data representing only waste sites at their end state to be produced. Because the SRS CA has projected reasonable end-state impacts from 2002 and beyond, and the AER monitoring can differentiate and separate operating and end-state contributions to annual liquid pathway release, an opportunity exists to use the AER monitoring data to validate the SRS CA model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1985

Structural analysis model validation using modal test data

The design of a structure which can survive a prescribed dynamic environment is generally based on the use of an analytical model of the structure. The modal test is employed to verify the analytical model. This paper is concerned with the involved validation process, taking into account modal test results from realistic complex spacecraft structural systems as examples to demonstrate the proposed validation procedure. Attention is given to a load analysis model definition, a pretest analysis and test/analysis model, and the correlation parameters. Coordinate transformation is considered along with mode identification, frequency orthogonality, effective mass, mode shape, local kinetic energy, modal force, strain energy, and modal forces by acceleration measurements. Two examples are used to illustrate the procedure.

Chen, J.-C.↗
DOE OSTI2024

A methodology to develop multi-physics dynamic fuel cell system models validated with vehicle realistic drive cycle data

Fuel cell (FC) technology has been identified as a technically attractive solution to decarbonize the transportation sector, especially for heavy-duty vehicles. In this context, the industry and the scientific community are in need of advanced fuel cell systems (FCS) models that are able to replicate real -world operating conditions. Due to the scarcity of said models in the open literature, this study aimed to develop a comprehensive methodology to calibrate and validate multi -physics dynamic FCS models. Therefore, the key contribution of this paper is the detailed description of the calibration process for each component and the calibration order. The specific focus here was to accurately describe the behavior of the FC stack as well as the cathode, anode, and cooling circuits of the balance of plant. The model was calibrated with the aid of experimental data from a Toyota Mirai FC electric vehicle, which was predominantly retrieved from the vehicle's Controller Area Network (CAN) bus system thereby negating the need for major intrusion into the powertrain system. The validation process was deemed successful with the model being able to truthfully replicate the characteristics of the FC vehicle operated on the World-wide harmonized Light duty Test Cycle (WLTC) 3b and US06 driving cycle. The time -resolved physical parameters such as the cathode pressure, mass flow, or the FC stack temperature were captured with high fidelity, while the overall performance parameters such as the H2 consumption in the stack and the system, and the compressor energy consumption were predicted accurately with a deviation lower than 0.47%, 1.75% and 1.89% with respect to the experimental data, respectively.

Lopez-Juarez, Marcos↗
NASA NTRS2023

Turbulence Model Validation Through Joint Experimental /Computational Studies of Separated Flow Over A Three-Dimensional Tapered Bump: Part I - Experimental Investigation

The results of a three-year experimental campaign aimed at comprehensively documenting the separated flow over a three-dimensional bump are presented with the purpose of generating a benchmark experimental database useful in validating computational fluid dynamics (CFD) flow simulations. The bump model geometry was designed to provide well-defined and repeatable smooth-body flow separation conditions that were suitable for both experiments and simulations. The bump had a Gaussian streamwise profile with a constant height equal to 8.5% of its width over the central 60% of the test section width. The remaining 40% were outboard spanwise portions that gradually taper to zero using an error function profile to minimize side-wall boundary layer effects. The model was immersed in a turbulent boundary layer that was developed on a suspended flat plate in the Notre Dame Mach 0.6 Wind Tunnel. In order to document the effect of the incoming boundary layer thickness on the flow separation, the bump model could be located at two streamwise positions. The mean velocity and turbulence intensity of the wind tunnel freestream flow field and approaching turbulent boundary layer were fully documented. The measurements of the flow separation region included surface visualization, wall shear stress using oil-film interferometry, mean and dynamic surface pressure, and planar and stereoscopic particle image velocimetry. The experiments were conducted over a range of Mach numbers from 0.05 to 0.2 corresponding to a range of Reynolds numbers based on the test section spanwise dimension (0.914m) of 1.0 × 10 6 ≤ Re L = U ∞ L/ν ≤ 4.0 × 10 6 . The bulk of the results are presented for the higher Mach number conditions of 0.1 and 0.2 with Re L = 2.0 × 10 6 and 4.0 × 10 6 , respectively. Extensive uncertainty analysis of the data was performed. The data is archived in the NASA Langley Turbulence Modeling Resource website at https://turbmodels.larc.nasa.gov/Other_exp_Data/speedbump_sep_exp.html. In addition to the experiments, a computational effort was made in parallel by the CFD group at Boeing Research & Technology highlighting the usefulness of the data set, which is outlined in the accompanying CFD report.

Flow separation↗
NASA NTRS2007

A Numerical Study of the Urban Heat Island in the Coastal Tropical City of San Juan, Puerto Rico: Model Validation and Impacts of LCLU Changes

Urban sprawls in tropical locations are rapidly accelerating and it is more evident in islands where a large percentage of the population resides along the coasts. This paper focuses on the analysis of the impacts of land use and land cover for urbanization in the tropical coastal city of San Juan, in the tropical island of Puerto Rico. A mesoscale numerical model, the Regional Atmospheric Modeling System (RAMS), is used to study specific characteristics and patterns of the urban heat island in the San Juan Metropolitan Area (SJMA), the most noticeable urban core of the Caribbean. The research present in this paper makes use of the observations obtained during the airborne San Juan Atlas Mission in two ways. First, surface and rawinsonde data are used to validate the atmospheric model yielding satisfactory results. Second, airborne remote sensing information is used to update the model's surface characteristics to obtain a detailed configuration of the SJMA in order to perform the LCLU changes impact analysis. This analysis showed that the presence of San Juan has an impact reflected in higher air temperatures over the area occupied by the city, with positive values of up to 2.5 C, for the simulations that have specified urban LCLU indexes in the bottom boundary. One interesting result of the impact analysis was the finding of a precipitation disturbance shown as a difference in total accumulated rainfall between simulation with the city and with a potential natural vegetation induced by the presence of the urban area. Model results indicate that the urban-induced cloud formation and precipitation development occur mainly downwind of the city, including the accumulated precipitation. This spatial pattern can be explained by the presence of a-larger urbanized area in the southwest sector of the city, and of the approaching northeasterly trade winds.

Comarazamy, Daniel E.↗
NASA NTRS2018

GT SUITE Fuel Cell Model Validation with Power Module Test Data

The AES Modular Power Systems (AMPS) Fuel Cell team at the NASA Glenn Research Center (GRC) has created a Microsoft Excel model of a regenerative fuel cell (RFC) system for potential lunar and Martian applications. Due to some limitations of this model, including the ability to predict transient effects in the thermal and fluidic performance of the system, a system-level transient thermal/fluids model was desired. GT-SUITE is a transient multi-physics simulation tool that is popular in the automotive industry and has a built in template for proton exchange membrane (PEM) fuel cells. However, terrestrial fuel cells used in the automotive industry vary significantly from aerospace fuel cells. A validation effort was undertaken to compare GT SUITE model results to actual data collected during the 2015 AMPS Power Module Demonstration in which the AMPS team used a PEM fuel cell system to power a 478 kg rover assembly at the Dunes test site located at GRC. The purpose of the model was to evaluate the efficacy of using GT SUITE to model a non-flow through PEM fuel cell system. The validation effort examined electrochemical performance including fuel cell stack voltage and power supplied, the thermal performance of the stack namely stack temperature and heat rejection rates, and the fluidic performance of the system including pressures, reactant consumption, and water production rates.

Gilligan, Ryan↗
NASA NTRS2000

Model Validation of Wake-Vortex/Aircraft Encounters

Wake-vortex effects on an 10% scale model of the B737-100 aircraft are calculated using both strip theory and vortex-lattice methods. The results are then compared to data taken in the 30ft x 60ft wind tunnel at NASA Langley Research Center (LaRC). The accuracy of the models for a reduced geometry, such with the horizontal stabilizer and the vertical tail removed, is also investigated. Using a 10% error in the circulation strength and comparing the model's results with the experiment illustrates the sensitivity of the models to the vortex circulation strength. It was determined that both strip theory and the vortex lattice method give accurate results when all the geometrical information is used. When the horizontal stabilizer and vertical tail were removed there were difficulties modeling the sideforce coefficient and pitching moment. With the removal of only the vertical tail unacceptable errors occurred when modeling the sideforce coefficient and yawing moment. Lift could not be accurately modeled with either the full geometry or the reduced geometry.

Pete, Kimberly R.↗
DOE OSTI2023

Directed Energy Deposition Process Modeling, Validation, and Process-Informed Optimization

The directed energy deposition (DED) process, one of the most popular additive manufacturing techniques in use today, involves various complex physical mechanisms that are not yet well understood. In this regard, computational tools show promise for elucidating the manufacturing process and enabling nondestructive performance evaluations of manufactured parts. To better control and optimize the DED process?thereby improving the manufactured product? the present work develops and demonstrates a novel artificial intelligence (AI)-based process control and optimization technique. Specifically, a geometry-free thermo-mechanical model with adaptive subdomain construction is developed to accurately capture the material?s thermo-mechanical response under cyclical reheating and high cooling rates [1]. The model is demonstrated and validated with experimental measurements, in light of various geometries and processing parameters. Moreover, based on this thermo-mechanical model, a physics-informed reduced-order model is developed to enable quick predictions of the temperature field at every time step. Furthermore, an AI-based controller is developed that can adapt to the ever-changing system states by automatically adjusting the manufacturing process parameters. This entire work is based on the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) [2] and its recent integration with Libtorch (the C++ frontend of PyTorch [3]). The combined development of the adaptive material deposition scheme, thermo-mechanical model, associated reduced-order model, and AI-based process controller carries great potential for improving advanced manufacturing processes.

36 MATERIALS SCIENCE↗
NASA NTRS2011

Highlights of Transient Plume Impingement Model Validation and Applications

This paper describes highlights of an ongoing validation effort conducted to assess the viability of applying a set of analytic point source transient free molecule equations to model behavior ranging from molecular effusion to rocket plumes. The validation effort includes encouraging comparisons to both steady and transient studies involving experimental data and direct simulation Monte Carlo results. Finally, this model is applied to describe features of two exotic transient scenarios involving NASA Goddard Space Flight Center satellite programs.

Woronowicz, Michael↗
NASA NTRSDate not supplied

SPHINX: A Generalized Tool for Solar Energetic Particle Model Validation

The Integrated Solar Energetic Proton Alert/Warning (ISEP) project was established to aid in the transition of SEP models from the research realm to operational use. This project is a collaboration between the NASA Community Coordinated Model Center (CCMC), the NASA Moon to Mars Space Weather Analysis Office (M2M) and the NASA Space Radiation Analysis Group (SRAG). Through ISEP, the SEP Scoreboards (Intensity, Probability, and All Clear) were developed to visualize real time forecasts from SEP models for use in SRAG operations. To accomplish this, SRAG, CCMC, and M2M work closely with modelers on model development, CCMC works on Scoreboard implementation, and M2M provides human-in-the-loop space weather analysis and ensures that models run in real time.

space weather↗
DOE OSTI2021

Cryo-EM model validation recommendations based on outcomes of the 2019 EMDataResource challenge

This paper describes outcomes of the 2019 Cryo-EM Model Challenge. The goals were to (1) assess the quality of models that can be produced from cryogenic electron microscopy (cryo-EM) maps using current modeling software, (2) evaluate reproducibility of modeling results from different software developers and users and (3) compare performance of current metrics used for model evaluation, particularly Fit-to-Map metrics, with focus on near-atomic resolution. Our findings demonstrate the relatively high accuracy and reproducibility of cryo-EM models derived by 13 participating teams from four benchmark maps, including three forming a resolution series (1.8 to 3.1 Å). The results permit specific recommendations to be made about validating near-atomic cryo-EM structures both in the context of individual experiments and structure data archives such as the Protein Data Bank. We recommend the adoption of multiple scoring parameters to provide full and objective annotation and assessment of the model, reflective of the observed cryo-EM map density.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model's suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
DOE OSTI2020

3D CFD Model Validation Using Benchmark Data of 1/16th Scaled VHTR Upper Plenum and Development of Wall Heat-Transfer Correlation For Laminar Flow

With support from the U.S. Department of Energy-Office of Nuclear Energy’s (DOE-NE’s) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, an effort has been pursued to support high-temperature gas-cooled reactor (HTGR) technology development and its modeling and simulation needs. There is a particular need for advanced modeling and simulation tools to predict thermal-fluid behavior in the nuclear reactor primary system, especially in the core and the lower and upper plena, during safety-related transients. In this report, two main such activities are presented relevant to the HTGRs: (1) three-dimensional (3D) computational fluid dynamics (CFD) validation using benchmark data from the upper plenum of Texas A&M University’s 1/16th scaled very-high-temperature gas-cooled reactor (VHTR), and (2) development of wall heat-transfer correlation for laminar flow in a wall-heated pipe. The CFD tool validation exercises can be helpful to choose the models and CFD tools to simulate and design specific components of the HTRGs such as upper plenum where jet mixing is a complex phenomenon. In a loss of forced circulation event, the laminar flow can be observed during the development of natural circulation flow. This work includes the development and validation of heat transfer correlations for laminar flow using the Nek5000 CFD code due to limited available experimental data for laminar flow conditions to guide low-order models (1D). In this report, the flow characteristics of a single isothermal jet discharging into the upper plenum was investigated using the Nek5000 Large-Eddy Simulation (LES) CFD tool. Several numerical simulations were performed for various jet-discharged Reynolds numbers ranging from 3,413 to 12,819. A grid-independent study was performed. The numerical results of mean velocity, root-mean-square fluctuating velocity, and Reynolds stress were compared against the benchmark data. Good agreement was obtained between simulated and measured data for axial mean velocities, except near the upper plenum hemisphere. The maximum predicted errors for axial mean velocities at various normalized coolant channel diameter heights of 1, 5, and 10 are 1.56%, 1.88%, and 3.82%, respectively. In addition, the predicted root-mean-square fluctuating velocity and Reynolds stress are qualitatively in agreement with the experimental data. The Nek5000 code was used to develop wall-heat transfer correlation for laminar flow in a cylindrical tube. Several simulations were performed for various Reynolds flow and wall-heat fluxes. A new heat transfer correlation was developed using data from Nek5000 simulation results and regression functions in Matlab. The developed heat transfer correlation is valid for various Reynolds flows from 200 to 2000. The predicted R² value for model fit was 0.875, which ensures that 87.5% of the model data lies on the Nek5000 data. Moreover, a machine learning (ML) tool was used to train and test the Nek5000 data. A good fit of the ML-based model was observed with the test data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

HelioScope Energy Performance Modeling Validation: Cooperative Research and Development Final Report, CRADA Number CRD-17-00685

HelioScope is a unique solar design and energy performance modeling tool that bridges the worlds of research and industry, bringing the most rigorous methods from the performance modeling community to thousands of solar developers of all backgrounds. However, many financial institutions and municipalities are hesitant to accept the energy production modeling results of HelioScope (including shading losses) in place of costly, time-intensive, and/or redundant methods due to lack of vetting from a respected institution like NREL. We expect that the proposed validation exercises will give municipalities and financial institutions the comfort needed to incorporate HelioScope into their operations, thereby significantly reducing the needs of existing and potential HelioScope users' to otherwise obtain information that HelioScope produces automatically. Folsom Labs was selected for a Small Business Voucher from the U.S. Department of Energy for the National Renewable Energy Laboratory to validate the performance of HelioScope’s simulation engine against measured PV system performance.

14 SOLAR ENERGY↗
DOE OSTI2017

Toward Development of a Stochastic Wake Model: Validation Using LES and Turbine Loads

Wind turbines within an array do not experience free-stream undisturbed flow fields. Rather, the flow fields on internal turbines are influenced by wakes generated by upwind unit and exhibit different dynamic characteristics relative to the free stream. The International Electrotechnical Commission (IEC) standard 61400-1 for the design of wind turbines only considers a deterministic wake model for the design of a wind plant. This study is focused on the development of a stochastic model for waked wind fields. First, high-fidelity physics-based waked wind velocity fields are generated using Large-Eddy Simulation (LES). Stochastic characteristics of these LES waked wind velocity field, including mean and turbulence components, are analyzed. Wake-related mean and turbulence field-related parameters are then estimated for use with a stochastic model, using Multivariate Multiple Linear Regression (MMLR) with the LES data. To validate the simulated wind fields based on the stochastic model, wind turbine tower and blade loads are generated using aeroelastic simulation for utility-scale wind turbine models and compared with those based directly on the LES inflow. The study’s overall objective is to offer efficient and validated stochastic approaches that are computationally tractable for assessing the performance and loads of turbines operating in wakes.

17 WIND ENERGY↗
DOE OSTI2026

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗
DOE OSTI2017

Three-dimensional fuel pin model validation by prediction of hydrogen distribution in cladding and comparison with experiment

To correctly describe and predict this hydrogen distribution there is a need for multi-physics coupling to provide accurate three-dimensional azimuthal, radial, and axial temperature distributions in the cladding. Coupled high-fidelity reactor-physics codes with a sub-channel code as well as with a computational fluid dynamics (CFD) tool have been used to calculate detailed temperature distributions. These high-fidelity coupled neutronics/thermal-hydraulics code systems are coupled further with the fuel-performance BISON code with a kernel (module) for hydrogen. Both hydrogen migration and precipitation/dissolution are included in the model. Results from this multi-physics analysis is validated utilizing calculations of hydrogen distribution using models informed by data from hydrogen experiments and PIE data.

36 MATERIALS SCIENCE↗