Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validated Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Techniques and Issues in Agent-Based Modeling Validation

Validation of simulation models is extremely important. It ensures that the right model has been built and lends confidence to the use of that model to inform critical decisions. Agent-based models (ABM) have been widely deployed in different fields for studying the collective behavior of large numbers of interacting agents. However, researchers have only recently started to consider the issues of validation. Compared to other simulation models, ABM has many differences in model development, usage and validation. An ABM is inherently easier to build than a classical simulation, but more difficult to describe formally since they are closer to human cognition. Using multi-agent models to study complex systems has attracted criticisms because of the challenges involved in their validation [1]. In this report, we describe the challenge of ABM validation and present a novel approach we recently developed for an ABM system.

99 GENERAL AND MISCELLANEOUS↗

Low frequency eddy current finite element model validation and benchmark studies

A finite element method (FEM) model was created to calculate the change in impedance of a coil due to the presence of a notch in a plate. The rectangular notches were created via electrical discharge machining (EDM) in a thick aluminum plate and were positioned at normal and oblique angles (10, 20, and 30 degrees) with respect to the vertical axis of the coil. The FEM method was chosen for this model due to its ability to solve problems in complicated geometries with the use of irregular mesh elements to discretize the solution domain. The change in impedance was calculated from the field variables in the simulation for each probe position along the parallel axis of the plate. The error between the model and the experimental data was approximately 5% for the majority of cases. The validated model was used to investigate more complex problems.

42 ENGINEERING↗

Flight Testing an Iced Business Jet for Flight Simulation Model Validation

A flight test of a business jet aircraft with various ice accretions was performed to obtain data to validate flight simulation models developed through wind tunnel tests. Three types of ice accretions were tested: pre-activation roughness, runback shapes that form downstream of the thermal wing ice protection system, and a wing ice protection system failure shape. The high fidelity flight simulation models of this business jet aircraft were validated using a software tool called "Overdrive." Through comparisons of flight-extracted aerodynamic forces and moments to simulation-predicted forces and moments, the simulation models were successfully validated. Only minor adjustments in the simulation database were required to obtain adequate match, signifying the process used to develop the simulation models was successful. The simulation models were implemented in the NASA Ice Contamination Effects Flight Training Device (ICEFTD) to enable company pilots to evaluate flight characteristics of the simulation models. By and large, the pilots confirmed good similarities in the flight characteristics when compared to the real airplane. However, pilots noted pitch up tendencies at stall with the flaps extended that were not representative of the airplane and identified some differences in pilot forces. The elevator hinge moment model and implementation of the control forces on the ICEFTD were identified as a driver in the pitch ups and control force issues, and will be an area for future work.

Ratvasky, Thomas P.↗

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

V-SUIT Model Validation Using PLSS 1.0 Test Results

The dynamic portable life support system (PLSS) simulation software Virtual Space Suit (V-SUIT) has been under development at the Technische Universitat Munchen since 2011 as a spin-off from the Virtual Habitat (V-HAB) project. The MATLAB(trademark)-based V-SUIT simulates space suit portable life support systems and their interaction with a detailed and also dynamic human model, as well as the dynamic external environment of a space suit moving on a planetary surface. To demonstrate the feasibility of a large, system level simulation like V-SUIT, a model of NASA's PLSS 1.0 prototype was created. This prototype was run through an extensive series of tests in 2011. Since the test setup was heavily instrumented, it produced a wealth of data making it ideal for model validation. The implemented model includes all components of the PLSS in both the ventilation and thermal loops. The major components are modeled in greater detail, while smaller and ancillary components are low fidelity black box models. The major components include the Rapid Cycle Amine (RCA) CO2 removal system, the Primary and Secondary Oxygen Assembly (POS/SOA), the Pressure Garment System Volume Simulator (PGSVS), the Human Metabolic Simulator (HMS), the heat exchanger between the ventilation and thermal loops, the Space Suit Water Membrane Evaporator (SWME) and finally the Liquid Cooling Garment Simulator (LCGS). Using the created model, dynamic simulations were performed using same test points also used during PLSS 1.0 testing. The results of the simulation were then compared to the test data with special focus on absolute values during the steady state phases and dynamic behavior during the transition between test points. Quantified simulation results are presented that demonstrate which areas of the V-SUIT model are in need of further refinement and those that are sufficiently close to the test results. Finally, lessons learned from the modelling and validation process are given in combination with implications for the future development of other PLSS models in V-SUIT.

Olthoff, Claas↗

Low frequency eddy current benchmark study for model validation

This paper presents results of an eddy current model validation study. Precise measurements were made using an impedance analyzer to investigate changes in impedance due to Electrical Discharge Machining (EDM) notches in aluminum plates. Each plate contained one EDM notch at an angle of 0, 10, 20, or 30 degrees from the normal of the plate surface. Measurements were made with the eddy current probe both scanning parallel and perpendicular to the notch length. The experimental response from the vertical and oblique notches will be reported and compared to results from different numerical simulation codes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Estimation of Uncertainties for a Supersonic Retro-Propulsion Model Validation Experiment in a Wind Tunnel

A high-quality model validation experiment was performed in the NASA Langley Research Center Unitary Plan Wind Tunnel to assess the predictive accuracy of computational fluid dynamics (CFD) models for a blunt-body supersonic retro-propulsion configuration at Mach numbers from 2.4 to 4.6. Static and fluctuating surface pressure data were acquired on a 5-inch-diameter test article with a forebody composed of a spherically-blunted, 70-degree half-angle cone and a cylindrical aft body. One non-powered configuration with a smooth outer mold line was tested as well as three different powered, forward-firing nozzle configurations: a centerline nozzle, three nozzles equally spaced around the forebody, and a combination with all four nozzles. A key objective of the experiment was the determination of experimental uncertainties from a range of sources such as random measurement error, flowfield non-uniformity, and model/instrumentation asymmetries. This paper discusses the design of the experiment towards capturing these uncertainties for the baseline non-powered configuration, the methodology utilized in quantifying the various sources of uncertainty, and examples of the uncertainties applied to non-powered and powered experimental results. The analysis showed that flowfield nonuniformity was the dominant contributor to the overall uncertainty a finding in agreement with other experiments that have quantified various sources of uncertainty.

Rhode, Matthew N.↗

Loci/STREAM Sharp Interface Model Validation of Cryogenic Propellant Tank Self-Pressurization

This paper documents a model validation effort for the prediction of cryogenic propellant tank selfpressurization physics using the Loci/STREAM sharp interface CFD model developed at NASA MSFC. Cryogenic fluid management (CFM) applications for long duration spaceflight missions require accurate modeling of heat transfer and thermodynamics. Therefore, detailed validation of those physics is important to ensure simulation accuracy. In the past, the MSFC Propulsion Fluid Dynamics Branch has validated and used the Loci/STREAM Volume of Fluid (VOF) module extensively for propellant slosh applications, which are dominated by fluid motion. For cases where the interface gas/liquid interface is essentially static, the Loci/STREAM sharp interface was developed for more rapid and efficient CFM analysis. In the present study, Loci/STREAM sharp interface simulations were compared with the NASA K-site self-pressurization experiment of a flight weight, partially full, LH2 tank in normal gravity. This study investigated several parametric effects and made a number of important observations on the performance of the Loci/STREAM sharp interface method: - First, a homogeneous model was derived to verify the CFD model. The homogeneous model assumes both gas and liquid phases are uniform and are at saturation temperature. The predicted pressure rise rates at 3.5 W/m2 and 2.0 W/m2 with a 49% fill level are all lower than the experimental measurement. This is expected due to the observed temperature stratification near the gas-liquid interface during testing. - The k-w and k-e turbulence models predict comparable pressurization rates, which are much lower than the experiment measurement. On the other hand, the pressure values and pressurization rates from both models are almost the same as those of the homogeneous model. The current turbulence model is too diffusive and is not capable of capturing the thermal stratification in the liquid and ullage. - When using the laminar flow model, the pressurization rate is found to be very close to the experimental value when a quasi-steady flow field is allowed to develop by continuously venting the tank prior to pressurization as was done during testing. On the other hand, without initial venting, the rate is not constant. Additionally, the development time to reach a quasi-steady flow field differed from the experiment due to the lack of turbulent mixing away from the gas-liquid interface that is expected in reality. - Using the laminar flow model and appropriate initial conditioning, the pressurization rate is within 15% of the experimental value for 49% fill level at 3.5 W/m 2 and is within 18% for 2.0 W/m 2 heat loading. - Using the laminar flow model and appropriate initial conditioning, the pressurization rate is within 18% of the experimental value for a 29% fill level and within 15% for an 83% fill level.

H. Q. Yang↗

Representing Small Commercial Building Faults in EnergyPlus, Part II: Model Validation

Automated fault detection and diagnosis (AFDD) tools based on machine-learning algorithms hold promise for lowering cost barriers for AFDD in small commercial buildings; however, access to high-quality training data for such algorithms is often difficult to obtain. To fill the gap in this research area, this study covers the development (Part I) and validation (Part II) of fault models that can be used with the building energy modeling software EnergyPlus® and OpenStudio® to generate a cost-effective training data set for developing AFDD algorithms. Part II (this paper) first presents a methodology of validating fault models with OpenStudio and then presents validation results, which are compared against measurements from a reference building. We discuss the results of our experiments with eight different faults in the reference building (a total of 39 different baseline and faulted scenarios), including our methodology for using fault models along with the reference building model to simulate the same faulted scenarios. Then, we present validation of the fault models by comparing results of simulations and experiments either quantitatively or qualitatively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Model validation - A connection between robust control and identification

The gap between the models used in control synthesis and those obtained from identification experiments is considered by investigating the connection between uncertain models and data. The model validation problem addressed is: given experimental data and a model with both additive noise and norm-bounded perturbations, is it possible that the model could produce the observed input-output data? This problem is studied for the standard H-infinity/mu framework models. A necessary condition for such a model to describe an experimental datum is obtained. For a large class of models in the robust control framework, this condition is computable as the solution of a quadratic optimization problem.

Smith, Roy S.↗

Bennu Shape Model Validation Methods and Results

The OSIRIS-REx Independent Shape Modeling Team, staffed by the Jet Propulsion Laboratory (JPL), has used stereophotoclinometry (SPC) to produce a three-dimensional shape model of Bennu. The SPC process is informed by (but is separate from) orbit determination, so it is important to ensure that the resulting shape model is consistent with all available spacecraft tracking data. Specifically, checking the shape model’s consistency with LIDAR measurements can illuminate any discrepancies, because LIDAR measurements are highly correlated with the shape model. This study focuses on the JPL experience with these LIDAR measurements and the greater context of the shape model validation process.

Lauretta, Dante S.↗

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ISS Stage 12A Post-Flight Modal Analysis, Model Validation and Correlation

This paper summarizes the on-orbit structural dynamic data and the related modal analysis, model validation and correlation performed for the ISS configurations spanning ISS Stage 12A. The objective of this analysis is to validate and correlate analytical models used to verify the ISS critical interface dynamic loads and improve its fatigue life prediction. On-Orbit dynamic responses were measured during the ISS configurations throughout ISS Stage 12A by the two main ISS instrumentation systems; Internal Wireless Instrumentation System (IWIS) and the Structural Dynamic Measurement System (SDMS). These nominal on-orbit events include Russian vehicle docking and undockings. Also, the ISS photogrammetric system recorded the movements of the 2A and 4A solar arrays during a modified ISS maneuver. Modal analyses were performed on the measured data to extract modal parameters including frequency, damping and mode shapes. Correlation and comparisons between the test and analytical frequencies and mode shapes were performed to assess the accuracy of the analytical models for the ISS configurations under consideration.

Fitzpatrick, Kristin↗

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

A Framework for Model Validation and Calibration of Microgrid Components Using PMU Data

This paper presents a framework for phasor measurement-based component model validation and calibration islanded microgrids, with emphasis on grid-forming inverters. Real measurements from the Plum Island microgrid facility are used to calibrate the model of a commercial inverter in the open-source phasor-based distribution system simulator GridLAB-D.Limitations of current distribution system simulators in replicating the behavior of commercial inverters are also identified.

microgrid, Synchrophasor data, model validation↗

Multi-component testing using HZ-PAN and AgZ-PAN Sorbents for OSPREY Model validation

In efforts to further develop the capability of the Off-gas SeParation and RecoverY (OSPREY) model, multi-component tests were completed using both HZ-PAN and AgZ-PAN sorbents. The primary purpose of this effort was to obtain multi-component xenon and krypton capacities for comparison to future OSPREY predicted multi-component capacities using previously acquired Langmuir equilibrium parameters determined from single component isotherms. Experimental capacities were determined for each sorbent using two feed gas compositions of 1000 ppmv xenon and 150 ppmv krypton in either a helium or air balance. Test temperatures were consistently held at 220 K and the gas flowrate was 50 sccm. Capacities were calculated from breakthrough curves using TableCurve® 2D software by Jandel Scientific. The HZ-PAN sorbent was tested in the custom designed cryostat while the AgZ-PAN was tested in a newly installed cooling apparatus. Previous modeling validation efforts indicated the OSPREY model can be used to effectively predict single component xenon and krypton capacities for both engineered form sorbents. Results indicated good agreement with the experimental and predicted capacity values for both krypton and xenon on the sorbents. Overall, the model predicted slightly elevated capacities for both gases which can be partially attributed to the estimation of the parameters and the uncertainty associated with the experimental measurements. Currently, OSPREY is configured such that one species adsorbs and one does not (i.e. krypton in helium). Modification of OSPREY code is currently being performed to incorporate multiple adsorbing species and non-ideal interactions of gas phase species with the sorbent and adsorbed phases. Once these modifications are complete, the sorbent capacities determined in the present work will be used to validate OSPREY multicomponent adsorption predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗