Search NASASearch

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Validation Methods for Fault-Tolerant avionics and control systems, working group meeting 1

The proceedings of the first working group meeting on validation methods for fault tolerant computer design are presented. The state of the art in fault tolerant computer validation was examined in order to provide a framework for future discussions concerning research issues for the validation of fault tolerant avionics and flight control systems. The development of positions concerning critical aspects of the validation process are given.

Source record

Reliability validation of systems for life-critical applications

A framework is proposed which addresses traditional reliability validation approaches consisting of life testing techniques which are inapplicable for digital flight control systems. A specific validation methodology is identified based on logical proofs, analytical modeling, and experimental testing. Research activities required to support continued development of validation technology are identified, and the validation procedure is driven by the reliability model obtained from the system description. The analytical reliability model is shown to be a proper abstraction of the system under consideration, and a proof of correctness of system design and system scheduler performance is proposed.

Trivedi, K. S.

Metric analysis and data validation across FORTRAN projects

The desire to predict the effort in developing or explaining the quality of software has led to the proposal of several metrics. As a step toward validating these metrics, the Software Engineering Laboratory (SEL) has analyzed the software science metrics, cyclomatic complexity, and various standard program measures for their relation to effort (including design through acceptance testing), development errors (both discrete and weighted according to the amount of time to locate and fix), and one another. The data investigated are collected from a project FORTRAN environment and examined across several projects at once, within individual projects and by reporting accuracy checks demonstrating the need to validate a database. When the data comes from individual programmers or certain validated projects, the metrics' correlations with actual effort seem to be strongest. For modules developed entirely by individual programmers, the validity ratios induce a statistically significant ordering of several of the metrics' correlations. When comparing the strongest correlations, neither software science's E metric cyclomatic complexity not source lines of code appears to relate convincingly better with effort than the others.

Basili, Victor R.

Building validation tools for knowledge-based systems

The Expert Systems Validation Associate (EVA), a validation system under development at the Lockheed Artificial Intelligence Center for more than a year, provides a wide range of validation tools to check the correctness, consistency and completeness of a knowledge-based system. A declarative meta-language (higher-order language), is used to create a generic version of EVA to validate applications written in arbitrary expert system shells. The architecture and functionality of EVA are presented. The functionality includes Structure Check, Logic Check, Extended Structure Check (using semantic information), Extended Logic Check, Semantic Check, Omission Check, Rule Refinement, Control Check, Test Case Generation, Error Localization, and Behavior Verification.

Stachowitz, R. A.

On the validation of a code and a turbulence model appropriate to circulation control airfoils

A computer code for calculating flow about a circulation control airfoil within a wind tunnel test section has been developed. This code is being validated for eventual use as an aid to design such airfoils. The concept of code validation being used is explained. The initial stages of the process have been accomplished. The present code has been applied to a low-subsonic, 2-D flow about a circulation control airfoil for which extensive data exist. Two basic turbulence models and variants thereof have been successfully introduced into the algorithm, the Baldwin-Lomax algebraic and the Jones-Launder two-equation models of turbulence. The variants include adding a history of the jet development for the algebraic model and adding streamwise curvature effects for both models. Numerical difficulties and difficulties in the validation process are discussed. Turbulence model and code improvements to proceed with the validation process are also discussed.

Viegas, J. R.

Application of flight systems methodologies to the validation of knowledge-based systems

Flight and mission-critical systems are verified, qualified for flight, and validated using well-known and well-established techniques. These techniques define the validation methodology used for such systems. In order to verify, qualify, and validate knowledge-based systems (KBS's), the methodology used for conventional systems must be addressed, and the applicability and limitations of that methodology to KBS's must be identified. The author presents an outline of how this approach to the validation of KBS's is being developed and used at the Dryden Flight Research Facility of the NASA Ames Research Center.

Duke, Eugene L.

Fault-tolerant clock synchronization validation methodology

A validation method for the synchronization subsystem of a fault-tolerant computer system is presented. The high reliability requirement of flight-crucial systems precludes the use of most traditional validation methods. The method presented utilizes formal design proof to uncover design and coding errors and experimentation to validate the assumptions of the design proof. The experimental method is described and illustrated by validating the clock synchronization system of the Software Implemented Fault Tolerance computer. The design proof of the algorithm includes a theorem that defines the maximum skew between any two nonfaulty clocks in the system in terms of specific system parameters. Most of these parameters are deterministic. One crucial parameter is the upper bound on the clock read error, which is stochastic. The probability that this upper bound is exceeded is calculated from data obtained by the measurement of system parameters. This probability is then included in a detailed reliability analysis of the system.

Computer systems

On the validation of a code and a turbulence model appropriate to circular control airfoils

A computer code for calculating flow about a circulation control airfoil within a wind tunnel test section was developed. This code is being validated for eventual use as an aid to design such airfoils. The concept of code validation being used is explained. The initial stages of the process were accomplished. The present code was applied to a low subsonic, 2-D flow about a circulation control airfoil for which extensive data exist. Two basic turbulence models and variants thereof were successfully introduced into the algorithm, the Baldwin-Lomax algebraic and the Jones-Launder two equation models of turbulence. The variants include adding a history of the jet development for the algebraic model and adding streamwise curvature effects for both models. Numerical difficulties and difficulties in the validation process are discussed. Turbulence model and code improvements to proceed with the validation process are also discussed.

Viegas, J. R.

Application of flight systems methodologies to the validation of knowledge-based systems

Flight and mission-critical systems are verified, qualified for flight, and validated using well-known and well-established techniques. These techniques define the validation methodology used for such systems. In order to verify, qualify, and validate knowledge-based systems (KBS's), the methodology used for conventional systems must be addressed, and the applicability and limitations of that methodology to KBS's must be identified. An outline of how this approach to the validation of KBS's is being developed and used is presented.

Duke, Eugene L.

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.

NASA sea ice validation program for the Defense Meteorological Satellite Program special sensor microwave imager

Attention is given to the prime objective of the NASA validation program, namely, to establish quantitative relationships between the sea ice parameters derived from the special sensor microwave imager (SSM/I) using an algorithm originally developed for the Nimbus 7 SMMR. The underlying philosophy of the validation program is that confidence in the SSM/I algorithm products is achieved not so much by detailed comparison with localized surface observations as by consistency with independent spatially and temporally coincident data sets. The results of the satellite and aircraft comparisons that serve as the basis for the validation of the NASA SSMI/I sea ice algorithm are presented. High-resolution radiometer and C-band SAR imagery from the March 1988 NASA and Navy SSM/I underflights are used to verify the location of the ice edge and to validate the sea ice concentrations as determined by the SSM/I algorithm. These studies are argued to provide the most comprehensive measure to date of the accuracy of sea ice products derived from a spaceborne multichannel microwave imager.

Cavalieri, Donald J.

Validation of Earth Radiation Budget Experiment scanning radiometer data inversion procedures

Validation techniques were implemented in the inversion of scanner radiometer data to assess the accuracy of the top of atmosphere radiant fluxes. An evaluation of SW radiant flux standard deviations for the same scene type shows that they contribute about 6.0 W/sq m for viewing zenith angles less than 55 deg and can reach values of up to 17.6 W/sq m for larger zenith angles in the backward scanning position. Three-channel intercomparison results, presented as color graphic displays and histograms, effectively validate the radiance measurements and the spectral factors. Along-track data were used to validate limb-darkening models and showed good agreement with current ERBE models. These validation techniques were found to be very effective in assessing the quality of the radiant fluxes generated by the ERBE inversion algorithm.

Manalo, Natividad D.

CFD validation experiments for hypersonic flows

A roadmap for CFD code validation is introduced. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments could provide new validation data.

Marvin, Joseph G.

Ground test validation for precision structures

Future proposed NASA missions will require large precision truss type structures that are deployed or assembled in space. To date, space structures that are important to missions success have been ground tested to validate their performance. Evaluation of the performance requirements of future systems has shown that using current and projected design and test approaches, the structure cannot be adequately validated by ground test. A problem exists since it is believed that unless important structure systems can be validated by ground tests, they will never be adopted for future missions. New design or ground test approaches are necessary to enable future missions. The inability of current approaches to validate future structural systems is discussed.

Wada, Ben K.

Display format and highlight validity effects on search performance using complex visual displays

Display format and highlight validity were shown to affect visual display search performance; however, these studies were conducted on small, artificial displays of alphanumeric stimuli. A study manipulating these variables was conducted using realistic, complex Space Shuttle information displays. A 2x2x3 within-subjects analysis of variance found that search times were faster for items in reformatted displays than for current displays. The significant format by highlight validity interaction showed that there was little difference in response time to both current and reformatted displays when the highlight validity was applied; however, under the non or invalid highlight conditions, search times were faster with reformatted displays. Benefits of highlighting and reformatting displays to enhance search and the necessity to consider highlight validity and format characteristics in tandem for predicting search performance are discussed.

Donner, Kimberly A.

A CFD validation roadmap for hypersonic flows

A roadmap for computational fluid dynamics (CFD) code validation is developed. The elements of the roadmap are consistent with air-breathing vehicle design requirements and related to the important flow path components: forebody, inlet, combustor, and nozzle. Building block and benchmark validation experiments are identified along with their test conditions and measurements. Based on an evaluation criteria, recommendations for an initial CFD validation data base are given and gaps identified where future experiments would provide the needed validation data.

Marvin, Joseph G.

TOVS Pathfinder product validation and intercomparison

Validation and intercomparison is an essential part of the Pathfinder program. Since its organization within the International TOVS Working Group, the TOVS community has continuously emphasized this aspect of the product retrieval problem. In the previous sections of this report, the TOVS Pathfinder SWG has recommended a careful and coherent reorganization and archiving of TOVS radiance data, and three distinct pathways for deriving product variables from this TOVS radiance archive. The importance in taking this multiple path approach to creating climate datasets rests in our firm belief that there is now global 'absolute truth' data for any of the derived physical parameters. Each of the selected methods is based upon a different set of assumptions. The challenge in interpreting Pathfinder data is to determine what alterations in the physical attributes of the environment contribute to evidence of global change extracted from observed or derived Pathfinder datasets. The Pathfinder validation and intercomparison activity must include validation of the forward problem, by which one calculates an estimate of upwelling radiance information from given earth and atmospheric data, and validation of the inverse problem, by which one calculates estimates of earth and atmospheric information from given upwelling satellite spectral radiance data.

Source record