SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2015

V-SUIT Model Validation Using PLSS 1.0 Test Results

The dynamic portable life support system (PLSS) simulation software Virtual Space Suit (V-SUIT) has been under development at the Technische Universitat Munchen since 2011 as a spin-off from the Virtual Habitat (V-HAB) project. The MATLAB(trademark)-based V-SUIT simulates space suit portable life support systems and their interaction with a detailed and also dynamic human model, as well as the dynamic external environment of a space suit moving on a planetary surface. To demonstrate the feasibility of a large, system level simulation like V-SUIT, a model of NASA's PLSS 1.0 prototype was created. This prototype was run through an extensive series of tests in 2011. Since the test setup was heavily instrumented, it produced a wealth of data making it ideal for model validation. The implemented model includes all components of the PLSS in both the ventilation and thermal loops. The major components are modeled in greater detail, while smaller and ancillary components are low fidelity black box models. The major components include the Rapid Cycle Amine (RCA) CO2 removal system, the Primary and Secondary Oxygen Assembly (POS/SOA), the Pressure Garment System Volume Simulator (PGSVS), the Human Metabolic Simulator (HMS), the heat exchanger between the ventilation and thermal loops, the Space Suit Water Membrane Evaporator (SWME) and finally the Liquid Cooling Garment Simulator (LCGS). Using the created model, dynamic simulations were performed using same test points also used during PLSS 1.0 testing. The results of the simulation were then compared to the test data with special focus on absolute values during the steady state phases and dynamic behavior during the transition between test points. Quantified simulation results are presented that demonstrate which areas of the V-SUIT model are in need of further refinement and those that are sufficiently close to the test results. Finally, lessons learned from the modelling and validation process are given in combination with implications for the future development of other PLSS models in V-SUIT.

Olthoff, Claas↗

NASA NTRS2012

Estimation of Uncertainties for a Supersonic Retro-Propulsion Model Validation Experiment in a Wind Tunnel

A high-quality model validation experiment was performed in the NASA Langley Research Center Unitary Plan Wind Tunnel to assess the predictive accuracy of computational fluid dynamics (CFD) models for a blunt-body supersonic retro-propulsion configuration at Mach numbers from 2.4 to 4.6. Static and fluctuating surface pressure data were acquired on a 5-inch-diameter test article with a forebody composed of a spherically-blunted, 70-degree half-angle cone and a cylindrical aft body. One non-powered configuration with a smooth outer mold line was tested as well as three different powered, forward-firing nozzle configurations: a centerline nozzle, three nozzles equally spaced around the forebody, and a combination with all four nozzles. A key objective of the experiment was the determination of experimental uncertainties from a range of sources such as random measurement error, flowfield non-uniformity, and model/instrumentation asymmetries. This paper discusses the design of the experiment towards capturing these uncertainties for the baseline non-powered configuration, the methodology utilized in quantifying the various sources of uncertainty, and examples of the uncertainties applied to non-powered and powered experimental results. The analysis showed that flowfield nonuniformity was the dominant contributor to the overall uncertainty a finding in agreement with other experiments that have quantified various sources of uncertainty.

Rhode, Matthew N.↗

NASA NTRSDate not supplied

Loci/STREAM Sharp Interface Model Validation of Cryogenic Propellant Tank Self-Pressurization

This paper documents a model validation effort for the prediction of cryogenic propellant tank selfpressurization physics using the Loci/STREAM sharp interface CFD model developed at NASA MSFC. Cryogenic fluid management (CFM) applications for long duration spaceflight missions require accurate modeling of heat transfer and thermodynamics. Therefore, detailed validation of those physics is important to ensure simulation accuracy. In the past, the MSFC Propulsion Fluid Dynamics Branch has validated and used the Loci/STREAM Volume of Fluid (VOF) module extensively for propellant slosh applications, which are dominated by fluid motion. For cases where the interface gas/liquid interface is essentially static, the Loci/STREAM sharp interface was developed for more rapid and efficient CFM analysis. In the present study, Loci/STREAM sharp interface simulations were compared with the NASA K-site self-pressurization experiment of a flight weight, partially full, LH2 tank in normal gravity. This study investigated several parametric effects and made a number of important observations on the performance of the Loci/STREAM sharp interface method: - First, a homogeneous model was derived to verify the CFD model. The homogeneous model assumes both gas and liquid phases are uniform and are at saturation temperature. The predicted pressure rise rates at 3.5 W/m2 and 2.0 W/m2 with a 49% fill level are all lower than the experimental measurement. This is expected due to the observed temperature stratification near the gas-liquid interface during testing. - The k-w and k-e turbulence models predict comparable pressurization rates, which are much lower than the experiment measurement. On the other hand, the pressure values and pressurization rates from both models are almost the same as those of the homogeneous model. The current turbulence model is too diffusive and is not capable of capturing the thermal stratification in the liquid and ullage. - When using the laminar flow model, the pressurization rate is found to be very close to the experimental value when a quasi-steady flow field is allowed to develop by continuously venting the tank prior to pressurization as was done during testing. On the other hand, without initial venting, the rate is not constant. Additionally, the development time to reach a quasi-steady flow field differed from the experiment due to the lack of turbulent mixing away from the gas-liquid interface that is expected in reality. - Using the laminar flow model and appropriate initial conditioning, the pressurization rate is within 15% of the experimental value for 49% fill level at 3.5 W/m 2 and is within 18% for 2.0 W/m 2 heat loading. - Using the laminar flow model and appropriate initial conditioning, the pressurization rate is within 18% of the experimental value for a 29% fill level and within 15% for an 83% fill level.

H. Q. Yang↗

DOE OSTI2019

Representing Small Commercial Building Faults in EnergyPlus, Part II: Model Validation

Automated fault detection and diagnosis (AFDD) tools based on machine-learning algorithms hold promise for lowering cost barriers for AFDD in small commercial buildings; however, access to high-quality training data for such algorithms is often difficult to obtain. To fill the gap in this research area, this study covers the development (Part I) and validation (Part II) of fault models that can be used with the building energy modeling software EnergyPlus® and OpenStudio® to generate a cost-effective training data set for developing AFDD algorithms. Part II (this paper) first presents a methodology of validating fault models with OpenStudio and then presents validation results, which are compared against measurements from a reference building. We discuss the results of our experiments with eight different faults in the reference building (a total of 39 different baseline and faulted scenarios), including our methodology for using fault models along with the reference building model to simulate the same faulted scenarios. Then, we present validation of the fault models by comparing results of simulations and experiments either quantitatively or qualitatively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NASA NTRS1992

Model validation - A connection between robust control and identification

The gap between the models used in control synthesis and those obtained from identification experiments is considered by investigating the connection between uncertain models and data. The model validation problem addressed is: given experimental data and a model with both additive noise and norm-bounded perturbations, is it possible that the model could produce the observed input-output data? This problem is studied for the standard H-infinity/mu framework models. A necessary condition for such a model to describe an experimental datum is obtained. For a large class of models in the robust control framework, this condition is computable as the solution of a quadratic optimization problem.

Smith, Roy S.↗

NASA NTRS2020

Bennu Shape Model Validation Methods and Results

The OSIRIS-REx Independent Shape Modeling Team, staffed by the Jet Propulsion Laboratory (JPL), has used stereophotoclinometry (SPC) to produce a three-dimensional shape model of Bennu. The SPC process is informed by (but is separate from) orbit determination, so it is important to ensure that the resulting shape model is consistent with all available spacecraft tracking data. Specifically, checking the shape model’s consistency with LIDAR measurements can illuminate any discrepancies, because LIDAR measurements are highly correlated with the shape model. This study focuses on the JPL experience with these LIDAR measurements and the greater context of the shape model validation process.

Lauretta, Dante S.↗

DOE OSTI2022

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2009

ISS Stage 12A Post-Flight Modal Analysis, Model Validation and Correlation

This paper summarizes the on-orbit structural dynamic data and the related modal analysis, model validation and correlation performed for the ISS configurations spanning ISS Stage 12A. The objective of this analysis is to validate and correlate analytical models used to verify the ISS critical interface dynamic loads and improve its fatigue life prediction. On-Orbit dynamic responses were measured during the ISS configurations throughout ISS Stage 12A by the two main ISS instrumentation systems; Internal Wireless Instrumentation System (IWIS) and the Structural Dynamic Measurement System (SDMS). These nominal on-orbit events include Russian vehicle docking and undockings. Also, the ISS photogrammetric system recorded the movements of the 2A and 4A solar arrays during a modified ISS maneuver. Modal analyses were performed on the measured data to extract modal parameters including frequency, damping and mode shapes. Correlation and comparisons between the test and analytical frequencies and mode shapes were performed to assess the accuracy of the analytical models for the ISS configurations under consideration.

Fitzpatrick, Kristin↗

DOE OSTI2021

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

DOE OSTI2023

A Framework for Model Validation and Calibration of Microgrid Components Using PMU Data

This paper presents a framework for phasor measurement-based component model validation and calibration islanded microgrids, with emphasis on grid-forming inverters. Real measurements from the Plum Island microgrid facility are used to calibrate the model of a commercial inverter in the open-source phasor-based distribution system simulator GridLAB-D.Limitations of current distribution system simulators in replicating the behavior of commercial inverters are also identified.

microgrid, Synchrophasor data, model validation↗

NASA NTRSDate not supplied

Model Validation and its Crucial Roles in Connecting Space Weather Research, Operations, and End-User Needs

Model validation is indispensable to transitioning a model from research to operations. In this presentation, we focus on the performance of models for specific operational purposes/user needs, which include careful selection of the corresponding specific Essential Space Environment Quantity (ESEQ) and a proper set of metrics. Initial results of our community-wide validation efforts under the COSPAR ISWAT Initiative with relevance to surface charging and internal charging will be shown. We will highlight processes involved in performing such tasks, such as setting up unified guidelines, data preparation, assessment using different metrics, etc. We will also present setbacks and challenges associated with such efforts so further progress can be made.

Yihua Zheng↗

DOE OSTI2026

Modeling, Validation, and Control of the IEA‐15 MW Reference Wind Turbine and VolturnUS‐S Platform

This paper presents the acausal modeling, validation, and control of floating offshore wind turbines (FOWTs). The model simulates the IEA‐15 MW reference turbine and the semi‐submersible VolturnUS‐S platform utilizing a Control‐oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS), which integrates the key coupled aero‐hydro‐elasto‐servo dynamics and is being developed by authors at the University of Central Florida. Verification and validation are conducted using numerical data from the industry‐standard simulation platform OpenFAST and experimental data from the Floating Offshore‐wind and Controls Advanced Laboratory (FOCAL) project, in which the authors were involved. Numerical results demonstrate the model's ability to qualitatively capture loads and responses across various load cases, highlighting the impact of the control system under different wind and wave conditions and opening new opportunities for optimizing FOWT designs. This paper provides wind turbine researchers with valuable insights into system characteristics, system frequencies, damping effects, and internal reaction forces, serving as a reference for future studies in FOWT modeling and control.

17 WIND ENERGY↗

DOE OSTI2019

Recent DIII-D advances in runaway electron measurement and model validation

Novel measurements and modeling of runaway electron (RE) dynamics in DIII-D have resolved experimental discrepancies and validated predictions for ITER, improving confidence that RE avoidance and mitigation can be predictably achieved. Considering RE formation, first experimental assessments of the RE seed current demonstrates that present hot-tail theories are not yet accurate and require improved treatment of the pellet dynamics. Novel measurements of kinetic instabilities in the MHz-range have been made in the RE formation phase, with the intensity of these modes correlated with previously unexplained empirical thresholds for RE generation. Controlled RE dissipation experiments in quiescent regimes have validated RE distribution function dependencies on collisional and synchrotron damping, both in terms of distribution function shape and dissipation rates. Measurements of RE bremsstrahlung and synchrotron emission are now used in tandem to resolve energy and pitch-angle effects. A resolution to long-standing dissipation anomalies in the quiescent regime is offered by taking into account kinetic instability effects on RE phase-space dynamics. Kinetic instabilities in the 100–200 MHz range are directly observed, though modeling finds the largest dissipation arises from GHz range instabilities that are beyond the reach of existing diagnostics. Kinetic instabilities are also observed in the mature post-disruption RE plateau phase, so long as the collisional damping rate is reduced with low-Z injection. Experiments with high-Z injection find that the dissipation rate saturates with injection quantity, likely due to neutral diffusion rates being slower than vertical instability rates in DIII-D. Considering the final loss, a 0D model for first-wall Joule heating is found to be in agreement with experiment, and controlled access to RE equilibria with edge safety factor of two identifies novel dynamics brought about by large-scale kink instabilities. These dynamics are typified by fast (tens of microseconds) RE loss rates without RE beam regeneration. The above measurements and comparison with theory represent significant advances in the understanding of RE dynamics and indicate possible new opportunities for RE avoidance or mitigation via kinetic instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2007

Solar Sail Model Validation from Echo Trajectories

The NASA In-Space Propulsion program has been engaged in a project to increase the technology readiness of solar sails. Recently, these efforts came to fruition in the form of several software tools to model solar sail guidance, navigation and control. Furthermore, solar sails are one of five technologies competing for the New Millennium Program Space Technology 9 flight demonstration mission. The historic Echo 1 and Echo 2 balloons were comprised of aluminized Mylar, which is the near-term material of choice for solar sails. Both spacecraft, but particularly Echo 2, were in low Earth orbits with characteristics similar to the proposed Space Technology 9 orbit. Therefore, the Echo balloons are excellent test cases for solar sail model validation. We present the results of studies of Echo trajectories that validate solar sail models of optics, solar radiation pressure, shape and low-thrust orbital dynamics.

Heaton, Andrew F.↗

NASA NTRS2011

Earth as an Extrasolar Planet: Earth Model Validation Using EPOXI Earth Observations

The EPOXI Discovery Mission of Opportunity reused the Deep Impact flyby spacecraft to obtain spatially and temporally resolved visible photometric and moderate resolution near-infrared (NIR) spectroscopic observations of Earth. These remote observations provide a rigorous validation of whole disk Earth model simulations used to better under- stand remotely detectable extrasolar planet characteristics. We have used these data to upgrade, correct, and validate the NASA Astrobiology Institute s Virtual Planetary Laboratory three-dimensional line-by-line, multiple-scattering spectral Earth model (Tinetti et al., 2006a,b). This comprehensive model now includes specular reflectance from the ocean and explicitly includes atmospheric effects such as Rayleigh scattering, gas absorption, and temperature structure. We have used this model to generate spatially and temporally resolved synthetic spectra and images of Earth for the dates of EPOXI observation. Model parameters were varied to yield an optimum fit to the data. We found that a minimum spatial resolution of approx.100 pixels on the visible disk, and four categories of water clouds, which were defined using observed cloud positions and optical thicknesses, were needed to yield acceptable fits. The validated model provides a simultaneous fit to the Earth s lightcurve, absolute brightness, and spectral data, with a root-mean-square error of typically less than 3% for the multiwavelength lightcurves, and residuals of approx.10% for the absolute brightness throughout the visible and NIR spectral range. We extend our validation into the mid-infrared by comparing the model to high spectral resolution observations of Earth from the Atmospheric Infrared Sounder, obtaining a fit with residuals of approx.7%, and temperature errors of less than 1K in the atmospheric window. For the purpose of understanding the observable characteristics of the distant Earth at arbitrary viewing geometry and observing cadence, our validated forward model can be used to simulate Earth s time dependent brightness and spectral properties for wavelengths from the far ultraviolet to the far infrared.brightness

Robinson, Tyler D.↗

NASA NTRS2021

Optial Experiments and Model Validation of Perturbed Starshade Designs

Starshades are a leading technology to enable the direct detection and spectroscopic characterization of Earth- like exoplanets. Critical starshade technologies are currently being advanced through the S5 Project and at the Princeton starshade testbed. We report on the status of Milestone 2 of the S5 Project, optical model validation. We present results from optical experiments of starshades with intentional perturbations built into their design. These perturbations are representative of the type of perturbations possible in a flight design and serve as points of validation for dffraction models and error budgets. We show experimental results for two perturbed shapes, a mask with all petals shifted radially outward by 5 um and a mask with shallow sine waves built into two petals. We compare these data to outputs of the optical model and demonstrate better than 25% agreement. We also present images taken in crossed polarized light and use those data to constrain physical parameters of the optical edge. Bringing in previously obtained results for other perturbed shapes, we show an agreement between experiment and model of better than 25% and argue that this satisfies the Milestone 2 criteria.

Galvin, Michael↗

NASA NTRS2022

NESC Peer Review of Exploration Systems Development (ESD) Integrated Vehicle Modal Test, Model Correlation, Development Flight Instrumentation (DFI) and Flight Loads Readiness; Uncertainty Propagation for Model Validation Sub-task

This report details a sub-task (regarding Uncertainty Propagation for Model Validation) from a NASA Engineering and Safety Center assessment that is a multi-year activity spanning the complete development of the Space Launch System integrated vehicle structural dynamic models, and the development of the certification of flight readiness for the Artemis 1 and Artemis 2 vehicles and their variants.

Exploration Systems Development; Development Fligh↗