Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Kahn, Ralph↗
NASA NTRS1994

Experimental validation of finite element and boundary element methods for predicting structural vibration and radiated noise

This research report is presented in three parts. In the first part, acoustical analyses were performed on modes of vibration of the housing of a transmission of a gear test rig developed by NASA. The modes of vibration of the transmission housing were measured using experimental modal analysis. The boundary element method (BEM) was used to calculate the sound pressure and sound intensity on the surface of the housing and the radiation efficiency of each mode. The radiation efficiency of each of the transmission housing modes was then compared to theoretical results for a finite baffled plate. In the second part, analytical and experimental validation of methods to predict structural vibration and radiated noise are presented. A rectangular box excited by a mechanical shaker was used as a vibrating structure. Combined finite element method (FEM) and boundary element method (BEM) models of the apparatus were used to predict the noise level radiated from the box. The FEM was used to predict the vibration, while the BEM was used to predict the sound intensity and total radiated sound power using surface vibration as the input data. Vibration predicted by the FEM model was validated by experimental modal analysis; noise predicted by the BEM was validated by measurements of sound intensity. Three types of results are presented for the total radiated sound power: sound power predicted by the BEM model using vibration data measured on the surface of the box; sound power predicted by the FEM/BEM model; and sound power measured by an acoustic intensity scan. In the third part, the structure used in part two was modified. A rib was attached to the top plate of the structure. The FEM and BEM were then used to predict structural vibration and radiated noise respectively. The predicted vibration and radiated noise were then validated through experimentation.

Seybert, A. F.↗
NASA NTRS1993

Dryden lectureship in research, a perspective on CFD validation

A comprehensive approach to CFD validation is presented. Requirements from computational and experimental perspectives are given. Experimental validation is emphasized because it ultimately determines the accuracy of CFD modeling and its application to complex problems. The concepts of building block and benchmark experiments are introduced. The types of measurements required of these experiments and their accuracy determination are explained. Contributions from such experiments toward the development and validation of CFD are reviewed and examples provided. Future challenges and strategies for validation are discussed.

Marvin, Joseph G.↗
NASA NTRS1996

Results and current status of the NPARC alliance validation effort

The NPARC Alliance is a partnership between the NASA Lewis Research Center (LeRC) and the USAF Arnold Engineering Development Center (AEDC) dedicated to the establishment of a national CFD capability, centered on the NPARC Navier-Stokes computer program. The three main tasks of the Alliance are user support, code development, and validation. The present paper is a status report on the validation effort. It describes the validation approach being taken by the Alliance. Representative results are presented for laminar and turbulent flat plate boundary layers, a supersonic axisymmetric jet, and a glancing shock/turbulent boundary layer interaction. Cases scheduled to be run in the future are also listed. The archive of validation cases is described, including information on how to access it via the Internet.

Towne, Charles E.↗
NASA NTRS1996

GOME Calibration and Validation Using Backscatter UV Techniques

GOME radiance, irradiance, and ozone products were validated by NASA Goddard Space Flight Center through three tasks which included, pre-launch calibration comparisons with SBUV and TOMS radiometric standards, validation of GOME Level-1 irradiance and radiance and Level 2 total ozone data products using SBUV/2 and TOMS algorithms and data, and studies of GOME data using the Goddard radiative transfer code. The prelaunch calibration using the NASA large aperture integrating sphere was checked against that provided by TPD. Agreement in the calibration constants, derived in air, between the Goddard and TPD system were better than 3%. Validation of Level-1 irradiance data included comparison of GOME and SSBUV and the UARS solar irradiances measurements. Large wavelength dependent differences, as high as 10%, were noted between GOME and the US instruments. This discrepancy has now been attributed to radiometric sensitivity changes experienced by GOME when operating in a vacuum. GOME Earth radiance data were then compared to the NOAA-14 SBUV/2 radiances. These results show that between 340 and 400 nm the differences in GOME and SBUV/2 data are less than 5% with some wavelength dependence. At wavelengths shorter than 300 nm, differences are of the order of 10% or more where the GOME radiances are larger. To test GOME DOAS retrieved total ozone values, these values were compared with ozone amounts retrieved using GOME radiances in the TOMS version-7 algorithm. The differences showed a solar zenith angle dependence ranging from 0 to 10% where the TOMS algorithm values were higher. GOME radiances below 300 nm were further validated by selecting radiances at wavelengths normally used by SBUV and processing them through the SBUV ozone profile algorithm and then compared to climatological values. The GOME ozone profiles ranged from 10-30% lower over altitude compared to climatological values. This is consistent with the offsets detected in the SBUV/2 radiance comparisons at wavelengths shorter than 300 nm.

Hilsenrath, E.↗
NASA NTRS1997

Shape Optimization by Bayesian-Validated Computer-Simulation Surrogates

A nonparametric-validated, surrogate approach to optimization has been applied to the computational optimization of eddy-promoter heat exchangers and to the experimental optimization of a multielement airfoil. In addition to the baseline surrogate framework, a surrogate-Pareto framework has been applied to the two-criteria, eddy-promoter design problem. The Pareto analysis improves the predictability of the surrogate results, preserves generality, and provides a means to rapidly determine design trade-offs. Significant contributions have been made in the geometric description used for the eddy-promoter inclusions as well as to the surrogate framework itself. A level-set based, geometric description has been developed to define the shape of the eddy-promoter inclusions. The level-set technique allows for topology changes (from single-body,eddy-promoter configurations to two-body configurations) without requiring any additional logic. The continuity of the output responses for input variations that cross the boundary between topologies has been demonstrated. Input-output continuity is required for the straightforward application of surrogate techniques in which simplified, interpolative models are fitted through a construction set of data. The surrogate framework developed previously has been extended in a number of ways. First, the formulation for a general, two-output, two-performance metric problem is presented. Surrogates are constructed and validated for the outputs. The performance metrics can be functions of both outputs, as well as explicitly of the inputs, and serve to characterize the design preferences. By segregating the outputs and the performance metrics, an additional level of flexibility is provided to the designer. The validated outputs can be used in future design studies and the error estimates provided by the output validation step still apply, and require no additional appeals to the expensive analysis. Second, a candidate-based a posteriori error analysis capability has been developed which provides probabilistic error estimates on the true performance for a design randomly selected near the surrogate-predicted optimal design.

Patera, Anthony T.↗
NASA NTRS1997

Validating Requirements for Fault Tolerant Systems Using Model Checking

Model checking is shown to be an effective tool in validating the behavior of a fault tolerant embedded spacecraft controller. The case study presented here shows that by judiciously abstracting away extraneous complexity, the state space of the model could be exhaustively searched allowing critical functional requirements to be validated down to the design level. Abstracting away detail not germane to the problem of interest leaves by definition a partial specification behind. The success of this procedure shows that it is feasible to effectively validate a partial specification with this technique. Three anomalies were found in the system one of which is an error in the detailed requirements, and the other two are missing/ambiguous requirements. Because the method allows validation of partial specifications, it also is an effective methodology towards maintaining fidelity between a co-evolving specification and an implementation.

Schneider, Francis↗
NASA NTRS1994

On the Validation of Satellite-Derived Sea Ice Surface Temperature

The surface temperature of sea ice controls the rate of ice growth and heat exchange between the ocean and the atmosphere. An algorithm for the satellite retrieval of ice surface temperature has recently been published, but due to the lack of validation data has not been extensively tested. In this paper, data from a recent Arctic field experiment is used in an attempt to validate that algorithm. While the procedure is, in principle, straightforward, we demonstrate that validation is complicated by a variety of factors, including incorrectly assumed atmospheric conditions, undetected clouds in the satellite data, spatial and temporal variability in the surface temperature field, and surface and satellite measurement errors. Comparisons between surface temperatures determined from upwelling broadband longwave radiation, spatial measurements of narrow-band radiation, thermocouples buried just below the snow surface, and narrow-band satellite data show differences of 1 to 3 deg. C. The range in these independent measurements indicates the need for specially designed validation experiments utilizing narrow-band radiometers on aircraft to obtain broad spatial coverage.

Key, J.↗
NASA NTRS1998

Real-Time Sensor Validation, Signal Reconstruction, and Feature Detection for an RLV Propulsion Testbed

A real-time system for validating sensor health has been developed in support of the reusable launch vehicle program. This system was designed for use in a propulsion testbed as part of an overall effort to improve the safety, diagnostic capability, and cost of operation of the testbed. The sensor validation system was designed and developed at the NASA Lewis Research Center and integrated into a propulsion checkout and control system as part of an industry-NASA partnership, led by Rockwell International for the Marshall Space Flight Center. The system includes modules for sensor validation, signal reconstruction, and feature detection and was designed to maximize portability to other applications. Review of test data from initial integration testing verified real-time operation and showed the system to perform correctly on both hard and soft sensor failure test cases. This paper discusses the design of the sensor validation and supporting modules developed at LeRC and reviews results obtained from initial test cases.

Jankovsky, Amy L.↗
NASA NTRS1999

Seasonal Characteristics of Non-Meteorological Radar Reflectivity Returns in Central Florida and Their Impact on TRMM Ground Validation

Radar data quality control is a major component to the Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) effort. The quality control algorithm utilizes several adjustable height and reflectivity threshold parameters to remove non-precipitation echoes from ground-based radar data. Spurious radar reflectivity returns not removed during the quality control process may create biases in ground validation rainfall products used to evaluate rainfall measurements retrieved from aboard the TRMM satellite. To better evaluate the performance of the quality control algorithm, WSR-88D radar data from one primary GV site, Melbourne, Florida, are used to determine the seasonal characteristics of non-meteorological radar echoes in cast central Florida during the first year of the TRMM mission. It is demonstrated that unique spurious echo regimes develop throughout the year, leading to different levels of successful non-meteorological echo removal by the quality control algorithm. In addition to the type of non- precipitation echoes present, the success of the algorithm is also greatly dependent upon the amount of precipitation present. Less aggressive attempts to remove non-meteorological echoes must be employed when rain is observed so as not to remove these echoes as well. Therefore, precipitation statistics from ground validation monthly rainfall products will be utilized to further document the quality control algorithm performance. Moreover, these precipitation statistics will be used to demonstrate the relationship between dominant spurious echo regimes and rainfall amount. Finally, monthly statistics of contaminated ground validation radar data will be calculated and the effect on rainfall accumulation products will be discussed.

Robinson, Michael↗
NASA NTRS1999

The New Millennium Program: Validating Advanced Technologies for Future Space Missions

This presentation reviews the activities of the New Millennium Program (NMP) in validating advanced technologies for space missions. The focus of these breakthrough technologies are to enable new capabilities to fulfill the science needs, while reducing costs of future missions. There is a broad spectrum of NMP partners, including government agencies, universities and private industry. The DS-1 was launched on October 24, 1998. Amongst the technologies validated by the NMP on DS-1 are: a Low Power Electronics Experiment, the Power Activation and Switching Module, Multi-Functional Structures. The first two of these technologies are operational and the data analysis is still ongoing. The third program is also operational, and its performance parameters have been verified. The second program, DS-2, was launched January 3 1999. It is expected to impact near Mars southern polar region on 3 December 1999. The technologies used on this mission awaiting validation are an advanced microcontroller, a power microelectronics unit, an evolved water experiment and soil thermal conductivity experiment, Lithium-Thionyl Chloride batteries, the flexible cable interconnect, aeroshell/entry system, and a compact telecom system. EO-1 on schedule for launch in December 1999 carries several technologies to be validated. Amongst these are: a Carbon-Carbon Radiator, an X-band Phased Array Antenna, a pulsed plasma thruster, a wideband advanced recorder processor, an atmospheric corrector, lightweight flexible solar arrays, Advanced Land Imager and the Hyperion instrument

Minning, Charles P.↗
NASA NTRS2001

Techniques of Validation of Aerosol and Water Vapor Retrievals From MODIS

Aerosols are extremely important for global climate studies and modeling in the quest to characterize the global radiation budget and forcing. The physical characteristics, composition, abundance, and spatial distribution and dynamics of aerosols are still very poorly known. Aerosol column optical thickness and other parameters as well as column precipitable water vapor amount are some of the main atmospheric parameters retrieved from the MODIS instrument on board the Terra satellite. To ensure the reliability of these parameters, we have embarked on a very massive validation effort. This involves cross correlation between the retrievals from the satellite data and those obtained from sunphotometer measurements at a large number of ground stations spread throughout the globe. Notable among these ground stations is a large network of over 100 stations coordinated under the Aerosol Robotic Network (AERONET) project. Whereas MODIS retrieves the aerosol parameters throughout the globe once or twice a day during the daytime, the ground measurements cover only discrete locations of the earth, though the retrievals are done several times a day. We have devised a method to. match the MODIS and ground retrievals through spatial statistics for the MODIS data and temporal statistics for the ground data. This has produced good comparisons and has enabled the validation of MODIS aerosol and water vapor retrievals at over 100 discrete locations in various parts of the earth both over the land and over the ocean. Currently, the validation statistical data is produced routinely by the MODIS aerosol group and is even available not only for validation but also for use by the science community for short and long term studies at various parts of the earth. One important advantage is that the system can be expanded to incorporate more locations where ground measurements and other studies may be conducted at any time during the lifetime of MODIS.

Ichoku, Charles↗
NASA NTRS1995

Verification and Validation of Simulation Models for High-Speed Flow Fields

This paper is largely based on the paper titled "Guide to Credible Computational Fluid Dynamics Simulations (Invited)" (AIAA Paper 95-2225). The significance of computational fluid dynamics (CFD) simulations depends solely on their credibility. A customer of CFD products -- simulations and software -- expects that these products are credible for the intended use. Simulation model verification and validation are critical in establishing the credibility of simulations and in certifying simulation software. The only thing that matters in establishing the credibility is uncertainty, not veracity or validity. The sensitivity-uncertainty analysis is the key to the establishment of this credibility. Assessing the credibility of complex simulation results poses a significant challenge. Terminology, concepts, framework, and guidelines are presented for addressing this challenge. Verification assesses whether the problem is solved correctly and estimates the level of computational accuracy of simulations; validation determines whether the right problem is solved and assesses the level of validity of the simulation model by estimating the degree to which simulations accurately represent reality. These concepts and the related guidelines are discussed with examples from high-speed flow fields.

Mehta, Unmeel B.↗
NASA NTRS2002

Land Product Validation

The Land Product Validation (LPV) subgroup of the Committee on Earth Observing Satellites Working Group on Calibration and Validation was formed in 2000. Goals of the LPV subgroup are: 1) to increase the quality and economy of global satellite product validation via developing and promoting international standards and protocols for field sampling, scaling, error budgeting, data exchange and product evaluation; 2) to advocate mission-long validation programs for current and future earth observing satellites.

Morisette, Jeffrey↗
NASA NTRS2002

Land Product Validation

The "Land Product Validation" (LPV) subgroup of the Committee on Earth Observing Satellites Working on Group on Calibration and Validation was formed in 2000. Goals of the LPV subgroup are: (1)to increase the quality and economy of global satellite product validation via developing and promoting international standards and protocols for field sampling, scaling, error budgeting, data exchange and product evaluation, and (2) to advocate mission-long validation programs for current and future earth observing satellites. First-round LPV activities will compliment the research themes of the Global Observation of Forest Cover (GOFC) program, which are: biophysical products, fire/burn scar detection, and land cover mapping. Meetings in June and July of 2001 focused on the first two themes. The GOFC "Forest Cover Characteristics and Changes" meeting provides a forum to initiate LPV activities related to Land Cover. The presentation will start with a summary of the LPV subgroup and its current activities. This will be followed by an overview of areas for potential coordination between the LPV and the GOFC Land Cover Theme.

Morisette, Jeffrey↗
NASA NTRS2003

Aeroservoelastic Model Validation and Test Data Analysis of the F/A-18 Active Aeroelastic Wing

Model validation and flight test data analysis require careful consideration of the effects of uncertainty, noise, and nonlinearity. Uncertainty prevails in the data analysis techniques and results in a composite model uncertainty from unmodeled dynamics, assumptions and mechanics of the estimation procedures, noise, and nonlinearity. A fundamental requirement for reliable and robust model development is an attempt to account for each of these sources of error, in particular, for model validation, robust stability prediction, and flight control system development. This paper is concerned with data processing procedures for uncertainty reduction in model validation for stability estimation and nonlinear identification. F/A-18 Active Aeroelastic Wing (AAW) aircraft data is used to demonstrate signal representation effects on uncertain model development, stability estimation, and nonlinear identification. Data is decomposed using adaptive orthonormal best-basis and wavelet-basis signal decompositions for signal denoising into linear and nonlinear identification algorithms. Nonlinear identification from a wavelet-based Volterra kernel procedure is used to extract nonlinear dynamics from aeroelastic responses, and to assist model development and uncertainty reduction for model validation and stability prediction by removing a class of nonlinearity from the uncertainty.

Brenner, Martin J.↗
NASA NTRS2003

Structured Uncertainty Bound Determination From Data for Control and Performance Validation

This report attempts to document the broad scope of issues that must be satisfactorily resolved before one can expect to methodically obtain, with a reasonable confidence, a near-optimal robust closed loop performance in physical applications. These include elements of signal processing, noise identification, system identification, model validation, and uncertainty modeling. Based on a recently developed methodology involving a parameterization of all model validating uncertainty sets for a given linear fractional transformation (LFT) structure and noise allowance, a new software, Uncertainty Bound Identification (UBID) toolbox, which conveniently executes model validation tests and determine uncertainty bounds from data, has been designed and is currently available. This toolbox also serves to benchmark the current state-of-the-art in uncertainty bound determination and in turn facilitate benchmarking of robust control technology. To help clarify the methodology and use of the new software, two tutorial examples are provided. The first involves the uncertainty characterization of a flexible structure dynamics, and the second example involves a closed loop performance validation of a ducted fan based on an uncertainty bound from data. These examples, along with other simulation and experimental results, also help describe the many factors and assumptions that determine the degree of success in applying robust control theory to practical problems.

Lim, Kyong B.↗
NASA NTRS2004

Validation of EOS Aqua AMSR Sea Ice Products for East Antarctica

This paper presents results from AMSR-E validation activities during a collaborative international cruise onboard the RV Aurora Australis to the East Antarctic sea ice zone (64-65 deg.S, 110-120 deg.E) in the early Austral spring of 2003. The validation strategy entailed an IS-day survey of the statistical characteristics of sea ice and snowcover over a Lagrangian grid 100 x 50 km in size (demarcated by 9 drifting ice beacons) i.e. at a scale representative of Ah4SR pixels. Ice conditions ranged h m consolidated first-year ice to a large polynya offshore from Casey Base. Data sets collected include: snow depth and snow-ice interface temperatures on 24 (?) randomly-selected floes in grid cells within a 10 x 50 km area (using helicopters); detailed snow and ice measurements at 13 dedicated ice stations, one of which lasted for 4 days; time-series measurements of snow temperature and thickness at selected sites; 8 aerial photography and thermal-IR radiometer flights; other satellite products (SAR, AVHRR, MODIS, MISR, ASTER and Envisat MERIS); ice drift data; and ancillary meteorological (ship-based, meteorological buoys, twice-daily radiosondes). These data are applied to a validation of standard AMSR-E ice concentration, snowcover thickness and ice-temperature products. In addition, a validation is carried out of ice-surface skin temperature products h m the NOAA AVHRR and EOS MODIS datasets.

Massom, Rob↗