Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Physics model validation of propane and methane for Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+)

HyRAM+ is a toolkit that includes fast-running models for the unconstrained (i.e., no wall interactions) dispersion and flames for non-premixed fuels. The models were developed for use with hydrogen, but the toolkit was expanded to include propane and methane in a recent release. Here, in this work we validate the dispersion and flame models for these additional fuels, based on reported literature data. The validation efforts spanned a range of release conditions, from subsonic to underexpanded jets and flames for a range of mass flow rates. In general, the dispersion model works well for both propane and methane although the width of the jet/plume is predicted to be wider than observed in some cases. The flame model tends to over-predict the induced buoyancy for low-momentum flames, while the radiative heat flux agrees with the experimental data reasonably well, for both fuels. The models could be improved but give acceptable predictions for propane and methane behavior for the purposes of risk assessment.

33 ADVANCED PROPULSION SYSTEMS↗

Model-based Systems Engineering: Creation and Implementation of Model Validation Rules for MOS 2.0

Model-based Systems Engineering (MBSE) is an emerging modeling application that is used to enhance the system development process. MBSE allows for the centralization of project and system information that would otherwise be stored in extraneous locations, yielding better communication, expedited document generation and increased knowledge capture. Based on MBSE concepts and the employment of the Systems Modeling Language (SysML), extremely large and complex systems can be modeled from conceptual design through all system lifecycles. The Operations Revitalization Initiative (OpsRev) seeks to leverage MBSE to modernize the aging Advanced Multi-Mission Operations Systems (AMMOS) into the Mission Operations System 2.0 (MOS 2.0). The MOS 2.0 will be delivered in a series of conceptual and design models and documents built using the modeling tool MagicDraw. To ensure model completeness and cohesiveness, it is imperative that the MOS 2.0 models adhere to the specifications, patterns and profiles of the Mission Service Architecture Framework, thus leading to the use of validation rules. This paper outlines the process by which validation rules are identified, designed, implemented and tested. Ultimately, these rules provide the ability to maintain model correctness and synchronization in a simple, quick and effective manner, thus allowing the continuation of project and system progress.

Model-based Systems Engineering (MBSE)↗

Model Validation of an RSRM Transporter Through Full-scale Operational and Modal Testing

The Reusable Solid Rocket Motor (RSRM) segments, which are part of the current Space Shuttle system and will provide the first stage of the Ares launch vehicle, must be transported from their manufacturing facility in Promontory, Utah, to a railhead in Corinne, Utah. This approximately 25-mile trip on secondary paved roads is accomplished using a special transporter system which lifts and conveys each individual segment. ATK Launch Systems (ATK) has recently obtained a new set of these transporters from Scheuerle, a company in Germany. The transporter is a 96-wheel, dual tractor vehicle that supports the payload via a hydraulic suspension. Since this system is a different design than was previously used, computer modeling with validation via test is required to ensure that the environment to which the segment is exposed is not too severe for this space-critical hardware. Accurate prediction of the loads imparted to the rocket motor is essential in order to prevent damage to the segment. To develop and validate a finite element model capable of such accurate predictions, ATA Engineering, Inc., teamed with ATK to perform a modal survey of the transport system, including a forward RSRM segment. A set of electrodynamic shakers was placed around the transporter at locations capable of exciting the transporter vehicle dynamics. Forces from the shakers with varying phase combinations were applied using sinusoidal sweep excitation. The relative phase of the shaker forcing functions was adjusted to match the shape characteristics of each of several target modes, thereby customizing each sweep run for exciting a particular mode. The resulting frequency response functions (FRF) from this series of sine sweeps allowed identification of all target modes and other higher-order modes, allowing good comparison to the finite element model. Furthermore, the survey-derived modal frequencies were correlated with peak frequencies observed during road-going operating tests. This correlation enabled verification of the most significant modes contributing to real-world loading of the motor segment under transport. After traditional model updating, dynamic simulation of the transportation environment was compared to the measured operating data to provided further validation of the analysis model. KEYWORDS Validation, correlation, modal test, rocket motor, transporter

Brillhart, Ralph↗

Benchmarks for Model Validation based on LiDAR Wake Measurements

Technology development and design decisions in wind energy are often based on results from simulations performed for individual wind turbines or entire wind plants. It is therefore critical to ensure that the models being used for research and industry applications in wind energy be thoroughly validated against measurements. A full-system validation of wind plant simulations must consider the atmospheric inflow, the response of the wind turbines, and their wakes. This task is complicated by the lack of freely available, quality-controlled, high-quality measurements. Here, such measurements are used to offer a validation exercise that can be used to assess the accuracy of models of any fidelity level. When it comes to real-world measurements, the dataset considered herein is simple in terms of terrain but exhibits pronounced diurnal cycles. Instead of a full-scale wind plant, we consider an individual research-scale, utility wind turbine instrumented for power and loads measurements. Three benchmarks are defined, with increasing levels of complexity: near neutral, slightly unstable, and very stable atmospheric stratification. Through comparisons between observations and simulations, the benchmarks provide complementary information about the model performance and its ability to reproduce mean and dynamic wake characteristics. This article describes the measurements and methodology used to define these benchmarks and provides the information required to perform simulations and conduct the model-measurement comparison. The objective is to provide a robust wake model validation exercise open to anyone, which will serve to minimize uncertainty in model validation practices related to varying methodologies across simulation tools and users.

17 WIND ENERGY↗

Comprehensive experimental investigation on biomass-glass beads binary fluidization: A data set for CFD model validation

Fluidization behavior of biomass and glass beads binary mixtures in a bubbling fluidized bed was experimentally investigated. Mixtures containing different mass fraction of Loblolly Pine white wood and glass beads were fluidized at different fluidization velocities. The particle properties were characterized in a QICPIC that uses a dynamic image processing method to measure both particle size and sphericity. The minimum fluidization velocity was determined using the pressure drop method. An image processing method was developed to capture the dynamic expanded bed height at a very high frequency. The effect of biomass mass fraction and inlet gas velocity on mixing and segregation behavior was studied and analyzed through pressure drop measurements. Pressure drop fluctuations and expanded bed height fluctuations via fast Fourier transform were analyzed and compared. Here, the complete and accurate experimental data reported in this study could provide a benchmark data set for various computational fluid dynamics models validation, calibration, and identification.

42 ENGINEERING↗

Gateway bi-propellant refueling development testing and model validation activities

The Gateway is an upcoming long term lunar exploration program to be completed by NASA in partnership with ESA and other US and international partners. The system design of the Gateway contains both a high performance Xenon based Solar Electric Propulsion system, as well as a bi-propellant attitude control system. Both propulsion systems are designed for on-orbit refueling to enable long life performance of the Gateway. The ESPRIT-RM is a module which will expand the pressurized volume of Gateway, while also providing refueling capability for both the Xenon and Bipropellant propulsion systems, therefore extending the Gateway life on orbit. As part of the Gateway bi-propellant refueling system development, a simplified fluidic breadboard system was created to evaluate system performance and response using simulant fluids. The test plan includes verification activities with simulant (water, HFE-7100) to verify joined subsystem behavior in the critical operations, including propellant transfer demonstration between modules, transient tests and venting tests. Integrated testing occurred at TASUK in collaboration with NASA to support joint verification activities to de-risk the major functions of the ESPRIT BTS and the overall CONOPS of the refueling of the Gateway chemical propulsion system. Initially collected test data from the system testing is presented, as well as initial model validation, and correlated to collected high frequency test data and system response is shown. Initially collected data has shown the architected system performance is closing initial design assumptions, but much forward work remains to characterize and develop the system.

Christopher Daniel Radke↗

Development of a wind turbine model and simulation platform using an acausal approach: Multiphysics modeling, validation, and control

This article presents the development of the Control-oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS). CRAFTS has a modular, hierarchical model architecture that enables rapid and accurate simulation of wind turbines. The architecture facilitates the incorporation of model variants, and its system reconfiguration features help simulate multiple design variants. CRAFTS also supports the integration of models developed on a causality-free platform (e.g., Modelica®) with existing causal models. This article focuses on the validation of a land-based wind turbine models against OpenFAST, an industry-standard platform, for several test cases. Closed-loop scenarios are also tested using the standard ROSCO controller and compared against OpenFAST. In addition, a nonlinear controller developed in our prior work is also evaluated. The test cases demonstrate the user-friendly and computationally efficient capabilities of CRAFTS to facilitate control co-design, assist in incorporating multiphysics models, be adaptable to design variants, and allow for rapid simulations to validate models and evaluate controllers.

17 WIND ENERGY↗

Multiscale Modeling of a Direct Nonoxidative Methane Dehydroaromatization Reactor with a Validated Model for Catalyst Deactivation

Due to the recent boom in shale gas production, aromatics production using direct nonoxidative methane dehydroaromatization (DHA) is being investigated extensively. However, due to rapid coke formation, catalysts in the nonoxidative methane DHA reactors get deactivated, which is one of the critical issues for the commercial success of the methane DHA process. In this paper, a model for catalyst deactivation is developed. Rate models for other DHA reactions are developed by considering the decrease in the catalyst activity with time. Due to the very fast coke formation rate on the fresh catalyst, there is coke formation immediately upon the introduction of the feed. Therefore, an algorithm is developed for estimation of the initial state of the reactor and the kinetic parameters by coupling an iterative direct substitution approach with an optimization approach. Transient experimental data from an in-house reactor are first reconciled and then used for developing the kinetic model including the coke formation model. Using the rate model, a dynamic, heterogeneous, multiscale reactor model with embedded heating is developed. Here, the model couples the catalyst pellet level model with a reactor level model. Impacts of temperature, L/D ratio, and scheduling of reactors on variability in conversion and yield with time are studied.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Shuttle Space Suit: Fabric/LCVG Model Validation

A detailed space suit computational model is being developed at the Langley Research Center for radiation exposure evaluation studies. The details of the construction of the space suit are critical to estimation of exposures and assessing the risk to the astronaut on EVA. Past evaluations of space suit shielding properties assumed the basic fabric layup (Thermal Micrometeoroid Garment, fabric restraints, and pressure envelope) and LCVG could be homogenized as a single layer overestimating the protective properties over 60 percent of the fabric area. The present space suit model represents the inhomogeneous distributions of LCVG materials (mainly the water filled cooling tubes). An experimental test is performed using a 34-MeV proton beam and high-resolution detectors to compare with model-predicted transmission factors. Some suggestions are made on possible improved construction methods to improve the space suit s protection properties.

Wilson, J. W.↗

Cost model validation: a technical and cultural approach

This paper summarizes how JPL's parametric mission cost model (PMCM) has been validated using both formal statistical methods and a variety of peer and management reviews in order to establish organizational acceptance of the cost model estimates.

cost model validation↗

Coarse Woody Debris Decomposition Assessment Tool: Model validation and application

Coarse woody debris (CWD) is a significant component of the forest biomass pool; hence a model is warranted to predict CWD decomposition and its role in forest carbon (C) and nutrient cycling under varying management and climatic conditions. A process-based model, CWDDAT (Coarse Woody Debris Decomposition Assessment Tool) was calibrated and validated using data from the FACE (Free Air Carbon Dioxide Enrichment) Wood Decomposition Experiment utilizing pine ( Pinus taeda ), aspen ( Populous tremuloides ) and birch ( Betula papyrifera ) on nine Experimental Forests (EF) covering a range of climate, hydrology, and soil conditions across the continental USA. The model predictions were evaluated against measured FACE log mass loss over 6 years. Four widely applied metrics of model performance demonstrated that the CWDDAT model can accurately predict CWD decomposition. The R 2 (squared Pearson’s correlation coefficient) between the simulation and measurement was 0.80 for the model calibration and 0.82 for the model validation ( P <0.01). The predicted mean mass loss from all logs was 5.4% lower than the measured mass loss and 1.4% lower than the calculated loss. The model was also used to assess the decomposition of mixed pine-hardwood CWD produced by Hurricane Hugo in 1989 on the Santee Experimental Forest in South Carolina, USA. The simulation reflected rapid CWD decomposition of the forest in this subtropical setting. The predicted dissolved organic carbon (DOC) derived from the CWD decomposition and incorporated into the mineral soil averaged 1.01 g C m -2 y -1 over the 30 years. The main agents for CWD mass loss were fungi (72.0%) and termites (24.5%), the remainder was attributed to a mix of other wood decomposers. These findings demonstrate the applicability of CWDDAT for large-scale assessments of CWD dynamics, and fine-scale considerations regarding the fate of CWD carbon.

54 ENVIRONMENTAL SCIENCES↗

TEAMER - AquaHarmonics High Fidelity WEC Sim PTO and Control Model Validation, Test Logs and Results

Collaborative effort between AquaHarmonics, Sandia National Laboratories (SNL), and the National Renewable Energy Laboratory (NREL) to revise and validate Aquaharmonics' full wave to wire model, allowing for reduced uncertainty and increased understanding of design requirements of a utility scale wave energy converter (WEC). SNL and NREL in collaboration with AquaHarmonics, will set up and run WEC Simulator (WEC-Sim) models of the AquaHarmonics WEC, building off past model developments for inclusion of custom PTO (power take-off) dynamics. The intent is to review, update, and verify or validate a new WEC-Sim model against wave tank experimental data. Furthermore, the WEC-Sim model will be coupled to an energy storage system model to better understand the wave-to-wire functionality. This data set is described in the "Test Log" excel file. Please refer to that document for details on each specific test date/time, constraint parameters and model hardware setup details. Sim model can be found in the associated MHKDR link below.

16 TIDAL AND WAVE POWER↗

A Numerical Study of Hypoxia in Chesapeake Bay Using an Unstructured Grid Model: Validation and Sensitivity to Bathymetry Representation

A three-dimensional unstructured-grid hydrodynamic and water quality model (Semi-implicit Cross-scale Hydroscience Intergrated System Model-Integrated Compartment Model) is applied successfully for Chesapeake Bay. The model is validated with observations of salinity, chlorophyll-a, dissolved oxygen, nutrients, and phytoplankton productions from the year 1991 to 1995 for the mainstem and some major tributaries, based on multiple model skill scores. Model experiments are conducted to test the importance of having (1) an accurate representation of bathymetry to correctly predict hypoxia and other processes and (2) a high-resolution model grid for tributaries to correctly simulate water quality variables. Further, comparison with the model experiment results with bathymetry smoothing indicates that bathymetry smoothing, as commonly used for many systems, changes the stratification and lateral circulation pattern, resulting in more salt intrusion into shallow water regions, and an increase in the freshwater age. Consequently, a model with bathymetry smoothing can lead to an unrealistic prediction of the distribution of hypoxia and phytoplankton production. Local grid refinement shows significant improvement of model simulations on local stratification and water quality variables. Overall, the use of high-resolution unstructured grid model leads to a faithful representation of the complex geometry, and thus a seamless cross-scale capability for simulating water quality processes in the Bay including tributaries and tidal creeks.

54 ENVIRONMENTAL SCIENCES↗

TOPEX Microwave Radiometer - Thermal design verification test and analytical model validation

The testing of the TOPEX Microwave Radiometer (TMR) is described in terms of hardware development based on the modeling and thermal vacuum testing conducted. The TMR and the vacuum-test facility are described, and the thermal verification test includes a hot steady-state segment, a cold steady-state segment, and a cold survival mode segment totalling 65 hours. A graphic description is given of the test history which is related temperature tracking, and two multinode TMR test-chamber models are compared to the test results. Large discrepancies between the test data and the model predictions are attributed to contact conductance, effective emittance from the multilayer insulation, and heat leaks related to deviations from the flight configuration. The TMR thermal testing/modeling effort is shown to provide technical corrections for the procedure outlined, and the need for validating predictive models is underscored.

Lin, Edward I.↗

Selection and Ranking of Experiments from the Halden Database in support of Multiscale Model Validation

Validating fuel performance codes, such as BISON, requires an extensive amount of experiments covering a wide range of operating conditions and fuel types. Within the light-water reactor (LWR) space, there have been several international experimental programs that have contributed to the wealth of available experimental data available for use. One of those international programs, the Halden Reactor Project (HRP), began in 1958 and utilized the Halden Boiling Water Reactor to conduct many highly instrumented experiments until the reactor closed in 2018. Idaho National Laboratory, through the U.S. Department of Energy, has utilized several Halden experiments to perform the initial validation of the BISON code based upon their inclusion in international modeling and simulation benchmarks. Recently, the HRP has provided member organizations a complete copy of all available data, reports, and presentations since the HRP began. This report provides an initial exploration of the data available in the database for use in validating the multiscale models under development in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program for LWR applications. Ranking tables that identify potential validation cases are provided for the high priority models of interest. It was found that some of the recommended high priority experiments correspond to additional rods in existing assemblies already available in the BISON validation suite. It is expected that several of these cases will be incorporated into future NEAMS milestones in the fuels technical area for increased validation of BISON.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

In-Situ Scanning Electron Microscope Experiments for Microscale Mechanical Testing and Validated Modeling of Fiber Reinforced Thermoplastics

A novel, in-situ, scanning electron microscope (SEM) mechanical testing capability for materials at the microscale which provides experimental validation to a machine learning (ML) toolset for full-field validation of physics-based micromechanics models is being developed by researchers at NASA Glenn Research Center. These are enabling technologies for the integration of multiscale digital twins for materials into system level models which will result in the improved performance, material discovery, reduced production cost and time, rapid characterization, and prognostic structural health monitoring (SHM) for materials and structures for extreme environments in support of NASA space exploration missions. In order to bridge the material structure-to-system gap for digital twins, physics-based models must be experimentally validated at multiple length scales. Seminal microscale experiments, conducted at the Air Force Research Laboratory (AFRL), were limited to transverse compression of single-layer, unidirectional thermoset polymer matrix composite (PMC) micropillar specimens [1]. The early phases of the current project followed those initial results and setup to reproduce the compression testing of PMC material on the custom-built piezoelectric actuated micromechanical testing rig built by MicroTesting Solutions LLC. In this work, samples of thermoplastic PMC material were first machined into 3 mm cubes, and then further machining and final milling was done using a Focused Ion Beam (FIB). The initial experiment was done on a pillar roughly 20 µm x 20 µm x 40 µm tall. Additional pillars were milled with final sizes ranging from 20 µm x 20 µm x 40 µm tall to 40 µm x 40 µm x 65 µm tall. A speckle pattern for in-situ full-field measurements using Digital Image Correlation (DIC) was applied with platinum, which was coated on the surface, and then the FIB was used to mill away some of the coating to produce an irregular pattern of Pt on the pillar surface. The samples were loaded into the custom testing rig and placed into the SEM and loaded under compression until failure. Images were collected in the SEM during testing. Post-processing of the images was conducted using DIC to obtain full-field displacement and strain measurements elucidating the role of the matrix as well as fiber-fiber interaction at the microscale within the composite subjected to compression loading well into the non-linear regime of the material. Moreover, the evolution of fiber-matrix debonding and matrix cracking is observed in-situ at the microscale. This data, along with images segmented with a newly developed ML toolset [2], was used to create and validate physics-based micromechanics models. An image of the failed micropillar is shown in Figure 1. The techniques developed in the initial compression experiment was tailored to the validation needs of the models and expanded to include different sized samples as well as possibly tension and fatigue.

Laura Wilson↗

GCR Environmental Models III: GCR Model Validation and Propagated Uncertainties in Effective Dose

This is the last of three papers focused on quantifying the uncertainty associated with galactic cosmic rays (GCR) models used for space radiation shielding applications. In the first paper, it was found that GCR ions with Z>2 and boundary energy below 500 MeV/nucleon induce less than 5% of the total effective dose behind shielding. This is an important finding since GCR model development and validation have been heavily biased toward Advanced Composition Explorer/Cosmic Ray Isotope Spectrometer measurements below 500 MeV/nucleon. Weights were also developed that quantify the relative contribution of defined GCR energy and charge groups to effective dose behind shielding. In the second paper, it was shown that these weights could be used to efficiently propagate GCR model uncertainties into effective dose behind shielding. In this work, uncertainties are quantified for a few commonly used GCR models. A validation metric is developed that accounts for measurements uncertainty, and the metric is coupled to the fast uncertainty propagation method. For this work, the Badhwar-O'Neill (BON) 2010 and 2011 and the Matthia GCR models are compared to an extensive measurement database. It is shown that BON2011 systematically overestimates heavy ion fluxes in the range 0.5-4 GeV/nucleon. The BON2010 and BON2011 also show moderate and large errors in reproducing past solar activity near the 2000 solar maximum and 2010 solar minimum. It is found that all three models induce relative errors in effective dose in the interval [-20%, 20%] at a 68% confidence level. The BON2010 and Matthia models are found to have similar overall uncertainty estimates and are preferred for space radiation shielding applications.

Slaba, Tony C.↗