SEARCH · Search NASA
Results for “Model Validation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Aeroacoustic Simulations of the High-Lift Common Research Model and Validation with Experiment
Explore the source record for details and available documents.
Melt Pond Conditions on Declining Arctic Sea Ice Over 1979–2016: Model Development, Validation, and Results
Explore the source record for details and available documents.
Validation of modeled daily erythemal exposure along tropical and subtropical shipping routes by ship‐based and satellite‐based measurements
Explore the source record for details and available documents.
Closing the Contrast Gap Between Testbed and Model Prediction with WFIRST-CGI Shaped Pupil Coronagraph
JPL has recently passed an important milestone in its technology development for a proposed NASA WFIRST mission: demonstration of a better than 1x10-8 contrast over broad bandwidth (10%) on both shaped pupil coronagraph (SPC) and hybrid Lyot coronagraph (HLC) testbeds with WFIRST telescope optics. Challenges remain, however, in the technology readiness for the proposed mission. One such is the discrepancy between the achieved contrast on testbeds and their corresponding model predictions. A series of testbed diagnosis and modeling activity were planned and (some) carried out on SPC testbed in order to close the gap. A very useful tool we developed was to analyze the measured testbed Jacobian and compare with its model version that was used to control image plane speckle pattern. The difference between these two is the error in the control Jacobian. When the error, which includes both amplitude and phase, was inserted into a separate prediction model with nominal Jacobian, the model prediction became closely matching the SPC testbed behavior in both contrast floor and contrast convergence speed. This offers a new perspective and is a step closer toward model validation for high contrast coronagraph. Further Jacobian analysis and modeling provided clues to the possible sources for the mismatch: the DM misregistration and the underrepresented testbed optics wavefront error (WFE) and the deformable mirror (DM) setting for correcting this WFE. These analyses suggested that high contrast coronagraph has a tight tolerance in the accuracy of its control Jacobian. Modifications to both testbed control model as well as prediction model are being implemented and future works discussed.
Verification and Validation of Simulation Models for High-Speed Flow Fields
This paper is largely based on the paper titled "Guide to Credible Computational Fluid Dynamics Simulations (Invited)" (AIAA Paper 95-2225). The significance of computational fluid dynamics (CFD) simulations depends solely on their credibility. A customer of CFD products -- simulations and software -- expects that these products are credible for the intended use. Simulation model verification and validation are critical in establishing the credibility of simulations and in certifying simulation software. The only thing that matters in establishing the credibility is uncertainty, not veracity or validity. The sensitivity-uncertainty analysis is the key to the establishment of this credibility. Assessing the credibility of complex simulation results poses a significant challenge. Terminology, concepts, framework, and guidelines are presented for addressing this challenge. Verification assesses whether the problem is solved correctly and estimates the level of computational accuracy of simulations; validation determines whether the right problem is solved and assesses the level of validity of the simulation model by estimating the degree to which simulations accurately represent reality. These concepts and the related guidelines are discussed with examples from high-speed flow fields.
Advances in Entry Modeling for Impact Risk Assessment
A summary of recent advancements in the detailed modeling of asteroid atmospheric entry processes made through NASA’s Asteroid Threat Assessment Project (ATAP) is presented. Understanding, and accurately modeling these processes and their associated uncertainties is critical to predicting all downstream impact effects, such as blast wave and thermal damage footprints. Furthermore, there is (perhaps thankfully) a dearth of empirical data for large impactors of the kind that would pose a threat to human populations, on which to anchor and/or validate models used in risk assessments. Therefore, we must rely heavily on detailed theoretical and numerical modeling to develop robust assessments for decision makers. To that end, ATAP has made some significant progress in advancing the capabilities in this area. Two areas in particular are highlighted in the present work: meteoroid ablation mechanisms, and bolide luminosity. The first research area – meteoroid ablation mechanisms – has focused on performing novel high-enthalpy wind tunnel experiments on meteorites and meteorite analogs, and utilizing the resulting data to develop high-fidelity models for impactor mass loss at scale. These efforts have resulted in several insights. Of note, these data suggest a differential vaporization process where volatiles are liberated preferentially when the asteroidal material is subject to high heat, while refractory components remain in the molten layer on the surface. A numerical model has been developed which considers this phenomena, and its effect on the bulk impactors effective heat of ablation is examined. The second research thrust that is discussed is focused on accurate modeling of impactor radiation phenomena. While another submission to the conference will discuss the application of our approach to thermal ground damage modeling, here, we present an overview of our extensive efforts to utilize available ground- and space-based observations of large bolides (~1m diameter, and above) to inform and validate our detailed modeling approaches. These methods have been shown to accurately reconstruct the detailed spectra for the Benesov bolide, as well as approximate the burn footprint for the Tunguska event. Recent effort has focused on reconciling light curve data from multiple sources (all-sky camera networks, GLM, US government sensors), using our validated model, and providing a calibrated model for luminous efficiency which can then be utilized to infer impactor properties such as shape, mass, and composition. This work will be demonstrated through an exemplar case study focusing on a large bolide event with observational data (e.g. Chelyabinsk, Flensburg, etc.). Finally, our team’s assessment on the current maturity of atmospheric entry models, and priorities for future research will be provided.
Optimized MODIS Channel Selection to Improve the NASA CERES FluxByCloudType Product Fluxes
The NASA Clouds and the Earth’s Radiant Energy System (CERES) project has provided the climate community more than a 20-year record of top of the atmosphere (TOA) reflected shortwave (SW) and emitted longwave (LW) fluxes. The fluxes used to monitor the Earth’s energy balance as well as for climate model validation and cloud feedback studies. One of the largest uncertainties in climate models is the response of clouds in feedback studies. To reduce this uncertainty requires more stringently validation of model generated fluxes by cloud-type. Rather than relying on radiative transfer model generated fluxes from observed cloud-type retrievals, the CERES FluxByCloudType (FBCT) product, relies on MODIS empirical narrowband to broadband relationships to convert the cloudy portions of the CERES footprints into fluxes. The overcast footprint and sub-footprint cloud layer fluxes are then stratified by 7 pressure layers and 6 optical depth bins and temporally averaged into daily and monthly regional cloud-type fluxes. The CERES project analyzed a total of 19 MODIS channels for use in the next generation FBCT product narrowband to broadband conversion. This was accomplished by comparing the narrowband to broadband RMS errors from all possible 5-channel combinations. The SW and LW optimized channels were selected by also considering analogous geostationary, MODIS and VIIRS imager channels as well as channel combinations that provided the lowest RMS errors across all surface types. The optimized channel combinations will be tested in the FBCT algorithm to investigate any cloud fraction, effective pressure, optical depth, PW, solar and view angle, surface type and regional narrowband to broadband dependencies.
Validation of an Accurate Three-Dimensional Helical Slow-Wave Circuit Model
The helical slow-wave circuit embodies a helical coil of rectangular tape supported in a metal barrel by dielectric support rods. Although the helix slow-wave circuit remains the mainstay of the traveling-wave tube (TWT) industry because of its exceptionally wide bandwidth, a full helical circuit, without significant dimensional approximations, has not been successfully modeled until now. Numerous attempts have been made to analyze the helical slow-wave circuit so that the performance could be accurately predicted without actually building it, but because of its complex geometry, many geometrical approximations became necessary rendering the previous models inaccurate. In the course of this research it has been demonstrated that using the simulation code, MAFIA, the helical structure can be modeled with actual tape width and thickness, dielectric support rod geometry and materials. To demonstrate the accuracy of the MAFIA model, the cold-test parameters including dispersion, on-axis interaction impedance and attenuation have been calculated for several helical TWT slow-wave circuits with a variety of support rod geometries including rectangular and T-shaped rods, as well as various support rod materials including isotropic, anisotropic and partially metal coated dielectrics. Compared with experimentally measured results, the agreement is excellent. With the accuracy of the MAFIA helical model validated, the code was used to investigate several conventional geometric approximations in an attempt to obtain the most computationally efficient model. Several simplifications were made to a standard model including replacing the helical tape with filaments, and replacing rectangular support rods with shapes conforming to the cylindrical coordinate system with effective permittivity. The approximate models are compared with the standard model in terms of cold-test characteristics and computational time. The model was also used to determine the sensitivity of various circuit parameters including typical manufacturing dimensional tolerances and support rod permittivity. By varying the circuit parameters of an accurate model using MAFIA, these sensitivities can be computed for manufacturing concerns, and design optimization previous to fabrication, thus eliminating the need for costly experimental iterations. Several variations were made to a standard helical circuit using MAFIA to investigate the effect that variations on helical tape and support rod width, metallized loading height and support rod permittivity, have on TWT cold-test characteristics.
NASA's Evolutionary Xenon Thruster (NEXT) Long-Duration Test as of 736 kg of Propellant Throughput
The NASA s Evolutionary Xenon Thruster (NEXT) program is developing the next-generation solar-electric ion propulsion system with significant enhancements beyond the state-of-the-art NASA Solar Electric Propulsion Technology Application Readiness (NSTAR) ion propulsion system to provide future NASA science missions with enhanced mission capabilities. A Long-Duration Test (LDT) was initiated in June 2005 to validate the thruster service life modeling and to qualify the thruster propellant throughput capability. The thruster has set electric propulsion records for the longest operating duration, highest propellant throughput, and most total impulse demonstrated. At the time of this publication, the NEXT LDT has surpassed 42,100 h of operation, processed more than 736 kg of xenon propellant, and demonstrated greater than 28.1 MN s total impulse. Thruster performance has been steady with negligible degradation. The NEXT thruster design has mitigated several lifetime limiting mechanisms encountered in the NSTAR design, including the NSTAR first failure mode, thereby drastically improving thruster capabilities. Component erosion rates and the progression of the predicted life-limiting erosion mechanism for the thruster compare favorably to pretest predictions based upon semi-empirical ion thruster models used in the thruster service life assessment. Service life model validation has been accomplished by the NEXT LDT. Assuming full-power operation until test article failure, the models and extrapolated erosion data predict penetration of the accelerator grid grooves after more than 45,000 hours of operation while processing over 800 kg of xenon propellant. Thruster failure due to degradation of the accelerator grid structural integrity is expected after
NASA's Evolutionary Xenon Thruster (NEXT) Long-Duration Test as of 736 kg of Propellant Throughput
The NASA s Evolutionary Xenon Thruster (NEXT) program is developing the next-generation solar-electric ion propulsion system with significant enhancements beyond the state-of-the-art NASA Solar Electric Propulsion Technology Application Readiness (NSTAR) ion propulsion system to provide future NASA science missions with enhanced mission capabilities. A Long-Duration Test (LDT) was initiated in June 2005 to validate the thruster service life modeling and to qualify the thruster propellant throughput capability. The thruster has set electric propulsion records for the longest operating duration, highest propellant throughput, and most total impulse demonstrated. At the time of this publication, the NEXT LDT has surpassed 42,100 h of operation, processed more than 736 kg of xenon propellant, and demonstrated greater than 28.1 MN s total impulse. Thruster performance has been steady with negligible degradation. The NEXT thruster design has mitigated several lifetime limiting mechanisms encountered in the NSTAR design, including the NSTAR first failure mode, thereby drastically improving thruster capabilities. Component erosion rates and the progression of the predicted life-limiting erosion mechanism for the thruster compare favorably to pretest predictions based upon semi-empirical ion thruster models used in the thruster service life assessment. Service life model validation has been accomplished by the NEXT LDT. Assuming full-power operation until test article failure, the models and extrapolated erosion data predict penetration of the accelerator grid grooves after more than 45,000 hours of operation while processing over 800 kg of xenon propellant. Thruster failure due to degradation of the accelerator grid structural integrity is expected after groove penetration.
Validation & Verification of CFD Models for Cryogenic Fluid Management of Propellant Tanks in Space
This article describes the need and the strategy for CFD model development, validation, and verification for Cryogenic Fluid Management (CFM) of Propellant Tanks in Space. It describes the type of CFD models that must be developed to address the future needs of Space CFM. It also discusses the two classes of experiments currently used to validate the fidelity of the CFD models. These two experiment classes are: (a) the small-scale simulant fluid science experiments that are equipped with scientific diagnostics to elucidate the underlying two-phase fluid physics of the CFM processes; and (b) the large-scale cryogenic experiments that assess the engineering performance of the propellant tank for storage and transfer. The current status of the CFD model development and validation is briefly assessed by presenting examples of segregated two-phase flow problems that have been successfully modeled. The future model development directions for CFM situations involving more complex interpenetrating phases are also defined.
Description of a Website Resource for Turbulence Modeling Verification and Validation
The activities of the Turbulence Model Benchmarking Working Group - which is a subcommittee of the American Institute of Aeronautics and Astronautics (AIAA) Fluid Dynamics Technical Committee - are described. The group s main purpose is to establish a web-based repository for Reynolds-averaged Navier-Stokes turbulence model documentation, including verification and validation cases. This turbulence modeling resource has been established based on feedback from a survey on what is needed to achieve consistency and repeatability in turbulence model implementation and usage, and to document and disseminate information on new turbulence models or improvements to existing models. The various components of the website are described in detail: description of turbulence models, turbulence model readiness rating system, verification cases, validation cases, validation databases, and turbulence manufactured solutions. An outline of future plans of the working group is also provided.
Minimum-complexity helicopter simulation math model
An example of a minimal complexity simulation helicopter math model is presented. Motivating factors are the computational delays, cost, and inflexibility of the very sophisticated math models now in common use. A helicopter model form is given which addresses each of these factors and provides better engineering understanding of the specific handling qualities features which are apparent to the simulator pilot. The technical approach begins with specification of features which are to be modeled, followed by a build up of individual vehicle components and definition of equations. Model matching and estimation procedures are given which enable the modeling of specific helicopters from basic data sources such as flight manuals. Checkout procedures are given which provide for total model validation. A number of possible model extensions and refinement are discussed. Math model computer programs are defined and listed.
Frequency-response techniques for documentation and improvement of rotorcraft simulators
Pilot-in-the-loop characterizations are most naturally formulated in terms of end-to-end frequency responses, so a frequency-response-based method is the natural approach to assessing simulator dynamic fidelity. A comprehensive frequency-response approach used heavily by Ames Research Center researchers was described, and results were presented from a number of simulator fidelity assessment studies. Those studies included UH-60 mathematical model validation and upgrade, ASTOVL linear model extraction, and documentation of the Vertical Motion Simulator (at Ames Research Center) motion and visual system characteristics.
Advanced Technology Training System on Motor-Operated Valves
This paper describes how features from the field of Intelligent Tutoring Systems are applied to the Motor-Operated Valve (MOV) Advanced Technology Training System (ATTS). The MOV ATTS is a training system developed at Galaxy Scientific Corporation for the Central Research Institute of Electric Power Industry in Japan and the Electric Power Research Institute in the United States. The MOV ATTS combines traditional computer-based training approaches with system simulation, integrated expert systems, and student and expert modeling. The primary goal of the MOV ATTS is to reduce human errors that occur during MOV overhaul and repair. The MOV ATTS addresses this goal by providing basic operational information of the MOV, simulating MOV operation, providing troubleshooting practice of MOV failures, and tailoring this training to the needs of each individual student. The MOV ATTS integrates multiple expert models (functional and procedural) to provide advice and feedback to students. The integration also provides expert model validation support to developers. Student modeling is supported by two separate student models: one model registers and updates the student's current knowledge of basic MOV information, while another model logs the student's actions and errors during troubleshooting exercises. These two models are used to provide tailored feedback to the student during the MOV course.