Search NASA⌕ Search

SEARCH · Search NASA

Results for “validations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Application of flight systems methodologies to the validation of knowledge-based systems

Flight and mission-critical systems are verified, qualified for flight, and validated using well-known and well-established techniques. These techniques define the validation methodology used for such systems. In order to verify, qualify, and validate knowledge-based systems (KBS's), the methodology used for conventional systems must be addressed, and the applicability and limitations of that methodology to KBS's must be identified. An outline of how this approach to the validation of KBS's is being developed and used is presented.

Duke, Eugene L.↗

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.↗

NASA sea ice validation program for the Defense Meteorological Satellite Program special sensor microwave imager

Attention is given to the prime objective of the NASA validation program, namely, to establish quantitative relationships between the sea ice parameters derived from the special sensor microwave imager (SSM/I) using an algorithm originally developed for the Nimbus 7 SMMR. The underlying philosophy of the validation program is that confidence in the SSM/I algorithm products is achieved not so much by detailed comparison with localized surface observations as by consistency with independent spatially and temporally coincident data sets. The results of the satellite and aircraft comparisons that serve as the basis for the validation of the NASA SSMI/I sea ice algorithm are presented. High-resolution radiometer and C-band SAR imagery from the March 1988 NASA and Navy SSM/I underflights are used to verify the location of the ice edge and to validate the sea ice concentrations as determined by the SSM/I algorithm. These studies are argued to provide the most comprehensive measure to date of the accuracy of sea ice products derived from a spaceborne multichannel microwave imager.

Cavalieri, Donald J.↗

Validation of Earth Radiation Budget Experiment scanning radiometer data inversion procedures

Validation techniques were implemented in the inversion of scanner radiometer data to assess the accuracy of the top of atmosphere radiant fluxes. An evaluation of SW radiant flux standard deviations for the same scene type shows that they contribute about 6.0 W/sq m for viewing zenith angles less than 55 deg and can reach values of up to 17.6 W/sq m for larger zenith angles in the backward scanning position. Three-channel intercomparison results, presented as color graphic displays and histograms, effectively validate the radiance measurements and the spectral factors. Along-track data were used to validate limb-darkening models and showed good agreement with current ERBE models. These validation techniques were found to be very effective in assessing the quality of the radiant fluxes generated by the ERBE inversion algorithm.

Manalo, Natividad D.↗

CFD validation experiments for hypersonic flows

A roadmap for CFD code validation is introduced. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments could provide new validation data.

Marvin, Joseph G.↗

Ground test validation for precision structures

Future proposed NASA missions will require large precision truss type structures that are deployed or assembled in space. To date, space structures that are important to missions success have been ground tested to validate their performance. Evaluation of the performance requirements of future systems has shown that using current and projected design and test approaches, the structure cannot be adequately validated by ground test. A problem exists since it is believed that unless important structure systems can be validated by ground tests, they will never be adopted for future missions. New design or ground test approaches are necessary to enable future missions. The inability of current approaches to validate future structural systems is discussed.

Wada, Ben K.↗

Display format and highlight validity effects on search performance using complex visual displays

Display format and highlight validity were shown to affect visual display search performance; however, these studies were conducted on small, artificial displays of alphanumeric stimuli. A study manipulating these variables was conducted using realistic, complex Space Shuttle information displays. A 2x2x3 within-subjects analysis of variance found that search times were faster for items in reformatted displays than for current displays. The significant format by highlight validity interaction showed that there was little difference in response time to both current and reformatted displays when the highlight validity was applied; however, under the non or invalid highlight conditions, search times were faster with reformatted displays. Benefits of highlighting and reformatting displays to enhance search and the necessity to consider highlight validity and format characteristics in tandem for predicting search performance are discussed.

Donner, Kimberly A.↗

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.↗

TOVS Pathfinder product validation and intercomparison

Validation and intercomparison is an essential part of the Pathfinder program. Since its organization within the International TOVS Working Group, the TOVS community has continuously emphasized this aspect of the product retrieval problem. In the previous sections of this report, the TOVS Pathfinder SWG has recommended a careful and coherent reorganization and archiving of TOVS radiance data, and three distinct pathways for deriving product variables from this TOVS radiance archive. The importance in taking this multiple path approach to creating climate datasets rests in our firm belief that there is now global 'absolute truth' data for any of the derived physical parameters. Each of the selected methods is based upon a different set of assumptions. The challenge in interpreting Pathfinder data is to determine what alterations in the physical attributes of the environment contribute to evidence of global change extracted from observed or derived Pathfinder datasets. The Pathfinder validation and intercomparison activity must include validation of the forward problem, by which one calculates an estimate of upwelling radiance information from given earth and atmospheric data, and validation of the inverse problem, by which one calculates estimates of earth and atmospheric information from given upwelling satellite spectral radiance data.

Source record↗

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Kahn, Ralph↗

Experimental validation of finite element and boundary element methods for predicting structural vibration and radiated noise

This research report is presented in three parts. In the first part, acoustical analyses were performed on modes of vibration of the housing of a transmission of a gear test rig developed by NASA. The modes of vibration of the transmission housing were measured using experimental modal analysis. The boundary element method (BEM) was used to calculate the sound pressure and sound intensity on the surface of the housing and the radiation efficiency of each mode. The radiation efficiency of each of the transmission housing modes was then compared to theoretical results for a finite baffled plate. In the second part, analytical and experimental validation of methods to predict structural vibration and radiated noise are presented. A rectangular box excited by a mechanical shaker was used as a vibrating structure. Combined finite element method (FEM) and boundary element method (BEM) models of the apparatus were used to predict the noise level radiated from the box. The FEM was used to predict the vibration, while the BEM was used to predict the sound intensity and total radiated sound power using surface vibration as the input data. Vibration predicted by the FEM model was validated by experimental modal analysis; noise predicted by the BEM was validated by measurements of sound intensity. Three types of results are presented for the total radiated sound power: sound power predicted by the BEM model using vibration data measured on the surface of the box; sound power predicted by the FEM/BEM model; and sound power measured by an acoustic intensity scan. In the third part, the structure used in part two was modified. A rib was attached to the top plate of the structure. The FEM and BEM were then used to predict structural vibration and radiated noise respectively. The predicted vibration and radiated noise were then validated through experimentation.

Seybert, A. F.↗

Dryden lectureship in research, a perspective on CFD validation

A comprehensive approach to CFD validation is presented. Requirements from computational and experimental perspectives are given. Experimental validation is emphasized because it ultimately determines the accuracy of CFD modeling and its application to complex problems. The concepts of building block and benchmark experiments are introduced. The types of measurements required of these experiments and their accuracy determination are explained. Contributions from such experiments toward the development and validation of CFD are reviewed and examples provided. Future challenges and strategies for validation are discussed.

Marvin, Joseph G.↗

Results and current status of the NPARC alliance validation effort

The NPARC Alliance is a partnership between the NASA Lewis Research Center (LeRC) and the USAF Arnold Engineering Development Center (AEDC) dedicated to the establishment of a national CFD capability, centered on the NPARC Navier-Stokes computer program. The three main tasks of the Alliance are user support, code development, and validation. The present paper is a status report on the validation effort. It describes the validation approach being taken by the Alliance. Representative results are presented for laminar and turbulent flat plate boundary layers, a supersonic axisymmetric jet, and a glancing shock/turbulent boundary layer interaction. Cases scheduled to be run in the future are also listed. The archive of validation cases is described, including information on how to access it via the Internet.

Towne, Charles E.↗

GOME Calibration and Validation Using Backscatter UV Techniques

GOME radiance, irradiance, and ozone products were validated by NASA Goddard Space Flight Center through three tasks which included, pre-launch calibration comparisons with SBUV and TOMS radiometric standards, validation of GOME Level-1 irradiance and radiance and Level 2 total ozone data products using SBUV/2 and TOMS algorithms and data, and studies of GOME data using the Goddard radiative transfer code. The prelaunch calibration using the NASA large aperture integrating sphere was checked against that provided by TPD. Agreement in the calibration constants, derived in air, between the Goddard and TPD system were better than 3%. Validation of Level-1 irradiance data included comparison of GOME and SSBUV and the UARS solar irradiances measurements. Large wavelength dependent differences, as high as 10%, were noted between GOME and the US instruments. This discrepancy has now been attributed to radiometric sensitivity changes experienced by GOME when operating in a vacuum. GOME Earth radiance data were then compared to the NOAA-14 SBUV/2 radiances. These results show that between 340 and 400 nm the differences in GOME and SBUV/2 data are less than 5% with some wavelength dependence. At wavelengths shorter than 300 nm, differences are of the order of 10% or more where the GOME radiances are larger. To test GOME DOAS retrieved total ozone values, these values were compared with ozone amounts retrieved using GOME radiances in the TOMS version-7 algorithm. The differences showed a solar zenith angle dependence ranging from 0 to 10% where the TOMS algorithm values were higher. GOME radiances below 300 nm were further validated by selecting radiances at wavelengths normally used by SBUV and processing them through the SBUV ozone profile algorithm and then compared to climatological values. The GOME ozone profiles ranged from 10-30% lower over altitude compared to climatological values. This is consistent with the offsets detected in the SBUV/2 radiance comparisons at wavelengths shorter than 300 nm.

Hilsenrath, E.↗

Shape Optimization by Bayesian-Validated Computer-Simulation Surrogates

A nonparametric-validated, surrogate approach to optimization has been applied to the computational optimization of eddy-promoter heat exchangers and to the experimental optimization of a multielement airfoil. In addition to the baseline surrogate framework, a surrogate-Pareto framework has been applied to the two-criteria, eddy-promoter design problem. The Pareto analysis improves the predictability of the surrogate results, preserves generality, and provides a means to rapidly determine design trade-offs. Significant contributions have been made in the geometric description used for the eddy-promoter inclusions as well as to the surrogate framework itself. A level-set based, geometric description has been developed to define the shape of the eddy-promoter inclusions. The level-set technique allows for topology changes (from single-body,eddy-promoter configurations to two-body configurations) without requiring any additional logic. The continuity of the output responses for input variations that cross the boundary between topologies has been demonstrated. Input-output continuity is required for the straightforward application of surrogate techniques in which simplified, interpolative models are fitted through a construction set of data. The surrogate framework developed previously has been extended in a number of ways. First, the formulation for a general, two-output, two-performance metric problem is presented. Surrogates are constructed and validated for the outputs. The performance metrics can be functions of both outputs, as well as explicitly of the inputs, and serve to characterize the design preferences. By segregating the outputs and the performance metrics, an additional level of flexibility is provided to the designer. The validated outputs can be used in future design studies and the error estimates provided by the output validation step still apply, and require no additional appeals to the expensive analysis. Second, a candidate-based a posteriori error analysis capability has been developed which provides probabilistic error estimates on the true performance for a design randomly selected near the surrogate-predicted optimal design.

Patera, Anthony T.↗

Validating Requirements for Fault Tolerant Systems Using Model Checking

Model checking is shown to be an effective tool in validating the behavior of a fault tolerant embedded spacecraft controller. The case study presented here shows that by judiciously abstracting away extraneous complexity, the state space of the model could be exhaustively searched allowing critical functional requirements to be validated down to the design level. Abstracting away detail not germane to the problem of interest leaves by definition a partial specification behind. The success of this procedure shows that it is feasible to effectively validate a partial specification with this technique. Three anomalies were found in the system one of which is an error in the detailed requirements, and the other two are missing/ambiguous requirements. Because the method allows validation of partial specifications, it also is an effective methodology towards maintaining fidelity between a co-evolving specification and an implementation.

Schneider, Francis↗

On the Validation of Satellite-Derived Sea Ice Surface Temperature

The surface temperature of sea ice controls the rate of ice growth and heat exchange between the ocean and the atmosphere. An algorithm for the satellite retrieval of ice surface temperature has recently been published, but due to the lack of validation data has not been extensively tested. In this paper, data from a recent Arctic field experiment is used in an attempt to validate that algorithm. While the procedure is, in principle, straightforward, we demonstrate that validation is complicated by a variety of factors, including incorrectly assumed atmospheric conditions, undetected clouds in the satellite data, spatial and temporal variability in the surface temperature field, and surface and satellite measurement errors. Comparisons between surface temperatures determined from upwelling broadband longwave radiation, spatial measurements of narrow-band radiation, thermocouples buried just below the snow surface, and narrow-band satellite data show differences of 1 to 3 deg. C. The range in these independent measurements indicates the need for specially designed validation experiments utilizing narrow-band radiometers on aircraft to obtain broad spatial coverage.

Key, J.↗

Real-Time Sensor Validation, Signal Reconstruction, and Feature Detection for an RLV Propulsion Testbed

A real-time system for validating sensor health has been developed in support of the reusable launch vehicle program. This system was designed for use in a propulsion testbed as part of an overall effort to improve the safety, diagnostic capability, and cost of operation of the testbed. The sensor validation system was designed and developed at the NASA Lewis Research Center and integrated into a propulsion checkout and control system as part of an industry-NASA partnership, led by Rockwell International for the Marshall Space Flight Center. The system includes modules for sensor validation, signal reconstruction, and feature detection and was designed to maximize portability to other applications. Review of test data from initial integration testing verified real-time operation and showed the system to perform correctly on both hard and soft sensor failure test cases. This paper discusses the design of the sensor validation and supporting modules developed at LeRC and reviews results obtained from initial test cases.

Jankovsky, Amy L.↗