Search NASA⌕ Search

SEARCH · Search NASA

Results for “quantitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Quantitative broadband ultrasonic backscatter - An approach to nondestructive evaluation in acoustically inhomogeneous materials

The use of a broadband backscatter technique to obtain the frequency dependence of the longitudinal-wave ultrasonic backscatter coefficient from a collection of scatterers in a solid is investigated. Measurements of the backscatter coefficient were obtained over the range of ultrasonic wave vector magnitude-glass sphere radius product between 0.1 and 3.0 from model systems consisting of dilute suspensions of randomly distributed crown glass spheres in hardened polyester resin. The results of these measurements were in good agreement with theoretical prediction. Consequently, broadband measurements of the ultrasonic backscatter coefficient may represent a useful approach toward characterizing the physical properties of scatterers in intrinsically inhomogeneous materials such as composites, metals, and ceramics, and may represent an approach toward nondestructive evaluation of these materials.

Odonnell, M.↗

FBI fingerprint identification automation study: AIDS 3 evaluation report. Volume 8: Measures of effectiveness

The development of both quantitative criteria that were used to evaluate conceptional systems for automating the functions for the FBI Identification Division is described. Specific alternative systems for automation were compared by using these developed criteria, defined as Measures of Effectiveness (MOE), to gauge system's performance in attempting to achieve certain goals. The MOE, essentially measurement tools that were developed through the combination of suitable parameters, pertain to each conceivable area of system operation. The methods and approaches used, both in selecting the parameters and in using the resulting MOE, are described.

Mulhall, B. D. L.↗

Towards Measurement of Confidence in Safety Cases

Arguments in safety cases are predominantly qualitative. This is partly attributed to the lack of sufficient design and operational data necessary to measure the achievement of high-dependability targets, particularly for safety-critical functions implemented in software. The subjective nature of many forms of evidence, such as expert judgment and process maturity, also contributes to the overwhelming dependence on qualitative arguments. However, where data for quantitative measurements is systematically collected, quantitative arguments provide far more benefits over qualitative arguments, in assessing confidence in the safety case. In this paper, we propose a basis for developing and evaluating integrated qualitative and quantitative safety arguments based on the Goal Structuring Notation (GSN) and Bayesian Networks (BN). The approach we propose identifies structures within GSN-based arguments where uncertainties can be quantified. BN are then used to provide a means to reason about confidence in a probabilistic way. We illustrate our approach using a fragment of a safety case for an unmanned aerial system and conclude with some preliminary observations

Denney, Ewen↗

U.S. Eastern Continental Shelf Carbon Cycling (USECoS): Modeling, Data Assimilation, and Analysis

Although the oceans play a major role in the uptake of fossil fuel CO2 from the atmosphere, there is much debate about the contribution from continental shelves, since many key shelf fluxes are not yet well quantified: the exchange of carbon across the land-ocean and shelf-slope interfaces, air-sea exchange of CO2, burial, and biological processes including productivity. Our goal is to quantify these carbon fluxes along the eastern U.S. coast using models quantitatively verified by comparison to observations, and to establish a framework for predicting how these fluxes may be modified as a result of climate and land use change. Our research questions build on those addressed with previous NASA funding for the USECoS (U.S. Eastern Continental Shelf Carbon Cycling) project. We have developed a coupled biogeochemical ocean circulation model configured for this study region and have extensively evaluated this model with both in situ and remotely-sensed data. Results indicate that to further reduce uncertainties in the shelf component of the global carbon cycle, future efforts must be directed towards 1) increasing the resolution of the physical model via nesting and 2) making refinements to the biogeochemical model and quantitatively evaluating these via the assimilation of biogeochemical data (in situ and remotely-sensed). These model improvements are essential for better understanding and reducing estimates of uncertainties in current and future carbon transformations and cycling in continental shelf systems. Our approach and science questions are particularly germane to the carbon cycle science goals of the NASA Earth Science Research Program as well as the U.S. Climate Change Research Program and the North American Carbon Program. Our interdisciplinary research team consists of scientists who have expertise in the physics and biogeochemistry of the U.S. eastern continental shelf, remote-sensing data analysis and data assimilative numerical models.

Mannino, Antonio↗

The MODIS Aerosol Algorithm: Critical Evaluation and Plans for Collection 6

For ten years the MODIS aerosol algorithm has been applied to measured MODIS radiances to produce a continuous set of aerosol products, over land and ocean. The MODIS aerosol products are widely used by the scientific and applied science communities for variety of purposes that span operational air quality forecasting in estimates o[ clear-sky direct radiative effects over ocean and aerosol-cloud interactions. The products undergo continual evaluation, including self-consistency checks and comparisons with highly accurate ground-based instruments. The result of these evaluation exercises is a quantitative understanding of the strengths and weaknesses of the retrieval, where and when the products are accurate and the situations where and when accuracy degrades. We intend 10 present results of the most recent critical evaluations including the first comparison of the over ocean products against the shipboard aerosol optical depth measurements of the Marine Aerosol Network (MAN), the demonstration of the lack of sensitivity to size parameter in the over land products and identification of residual problems and regional issues. While the current data set is undergoing evaluation, we are preparing for the next data processing, labeled Collection 6. Collection 6 will include transparent Quality Flags, a 3 km aerosol product and the 500m resolution cloud mask used within the aerosol n:bicvu|. These new products and adjustments to algorithm assumptions should provide users with more options and greater control, as they adapt the product for their own purposes.

Remer, Lorraine↗

Methodology issues concerning the accuracy of kinematic data collection and analysis using the ariel performance analysis system

Kinematics, the study of motion exclusive of the influences of mass and force, is one of the primary methods used for the analysis of human biomechanical systems as well as other types of mechanical systems. The Anthropometry and Biomechanics Laboratory (ABL) in the Crew Interface Analysis section of the Man-Systems Division performs both human body kinematics as well as mechanical system kinematics using the Ariel Performance Analysis System (APAS). The APAS supports both analysis of analog signals (e.g. force plate data collection) as well as digitization and analysis of video data. The current evaluations address several methodology issues concerning the accuracy of the kinematic data collection and analysis used in the ABL. This document describes a series of evaluations performed to gain quantitative data pertaining to position and constant angular velocity movements under several operating conditions. Two-dimensional as well as three-dimensional data collection and analyses were completed in a controlled laboratory environment using typical hardware setups. In addition, an evaluation was performed to evaluate the accuracy impact due to a single axis camera offset. Segment length and positional data exhibited errors within 3 percent when using three-dimensional analysis and yielded errors within 8 percent through two-dimensional analysis (Direct Linear Software). Peak angular velocities displayed errors within 6 percent through three-dimensional analyses and exhibited errors of 12 percent when using two-dimensional analysis (Direct Linear Software). The specific results from this series of evaluations and their impacts on the methodology issues of kinematic data collection and analyses are presented in detail. The accuracy levels observed in these evaluations are also presented.

Wilmington, R. P.↗

Synthetic Vision Systems in GA Cockpit-Evaluation of Basic Maneuvers Performed by Low Time GA Pilots During Transition from VMC to IMC

An experimental investigation was conducted to study the effectiveness of modern flight displays in general aviation cockpits for mitigating Low Visibility Loss of Control and the Controlled Flight Into Terrain accidents. A total of 18 General Aviation (GA) pilots with private pilot, single engine land rating, with no additional instrument training beyond private pilot license requirements, were recruited to evaluate three different display concepts in a fixed-based flight simulator at the NASA Langley Research Center's General Aviation Work Station. Evaluation pilots were asked to continue flight from Visual Meteorological Conditions (VMC) into Instrument Meteorological Conditions (IMC) while performing a series of 4 basic precision maneuvers. During the experiment, relevant pilot/vehicle performance variables, pilot control inputs and physiological data were recorded. Human factors questionnaires and interviews were administered after each scenario. Qualitative and quantitative data have been analyzed and the results are presented here. Pilot performance deviations from the established target values (errors) were computed and compared with the FAA Practical Test Standards. Results of the quantitative data indicate that evaluation pilots committed substantially fewer errors when using the Synthetic Vision Systems (SVS) displays than when they were using conventional instruments. Results of the qualitative data indicate that evaluation pilots perceived themselves to have a much higher level of situation awareness while using the SVS display concept.

Takallu, M. A.↗

Application of remote sensing to monitoring and studying dispersion in ocean dumping

Remotely sensed wide area synoptic data provides information on ocean dumping that is not readily available by other means. A qualitative approach has been used to map features, such as river plumes. Results of quantitative analyses have been used to develop maps showing quantitative distributions of one or more water quality parameters, such as suspended solids or chlorophyll a. Joint NASA/NOAA experiments have been conducted at designated dump areas in the U.S. coastal zones to determine the applicability of aircraft remote sensing systems to map plumes resulting from ocean dumping of sewage sludge and industrial wastes. A second objective is related to the evaluation of previously developed quantitative analysis techniques for studying dispersion of materials in these plumes. It was found that plumes resulting from dumping of four waste materials have distinctive spectral characteristics. The development of a technology for use in a routine monitoring system, based on remote sensing techniques, is discussed.

Johnson, R. W.↗

Temporal Variability of Observed and Simulated Hyperspectral Earth Reflectance

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) is a climate observation system designed to study Earth's climate variability with unprecedented absolute radiometric accuracy and SI traceability. Observation System Simulation Experiments (OSSEs) were developed using GCM output and MODTRAN to simulate CLARREO reflectance measurements during the 21st century as a design tool for the CLARREO hyperspectral shortwave imager. With OSSE simulations of hyperspectral reflectance, Feldman et al. [2011a,b] found that shortwave reflectance is able to detect changes in climate variables during the 21st century and improve time-to-detection compared to broadband measurements. The OSSE has been a powerful tool in the design of the CLARREO imager and for understanding the effect of climate change on the spectral variability of reflectance, but it is important to evaluate how well the OSSE simulates the Earth's present-day spectral variability. For this evaluation we have used hyperspectral reflectance measurements from the Scanning Imaging Absorption Spectrometer for Atmospheric Cartography (SCIAMACHY), a shortwave spectrometer that was operational between March 2002 and April 2012. To study the spectral variability of SCIAMACHY-measured and OSSE-simulated reflectance, we used principal component analysis (PCA), a spectral decomposition technique that identifies dominant modes of variability in a multivariate data set. Using quantitative comparisons of the OSSE and SCIAMACHY PCs, we have quantified how well the OSSE captures the spectral variability of Earth?s climate system at the beginning of the 21st century relative to SCIAMACHY measurements. These results showed that the OSSE and SCIAMACHY data sets share over 99% of their total variance in 2004. Using the PCs and the temporally distributed reflectance spectra projected onto the PCs (PC scores), we can study the temporal variability of the observed and simulated reflectance spectra. Multivariate time series analysis of the PC scores using techniques such as Singular Spectrum Analysis (SSA) and Multichannel SSA will provide information about the temporal variability of the dominant variables. Quantitative comparison techniques can evaluate how well the OSSE reproduces the temporal variability observed by SCIAMACHY spectral reflectance measurements during the first decade of the 21st century. PCA of OSSE-simulated reflectance can also be used to study how the dominant spectral variables change on centennial scales for forced and unforced climate change scenarios. To have confidence in OSSE predictions of the spectral variability of hyperspectral reflectance, it is first necessary for us to evaluate the degree to which the OSSE simulations are able to reproduce the Earth?s present-day spectral variability.

Roberts, Yolanda↗

Research Developments in Nondestructive Evaluation and Structural Health Monitoring for the Sustainment of Composite Aerospace Structures at NASA

The use of composite materials continues to increase in the aerospace community due to the potential benefits of reduced weight, increased strength, and manufacturability. Ongoing work at NASA involves the use of the large-scale composite structures for spacecraft (payload shrouds, cryotanks, crew modules, etc). NASA is also working to enable both the use and sustainment of composites in commercial aircraft structures. One key to the sustainment of these large composite structures is the rapid, in-situ characterization of a wide range of potential defects that may occur during the vehicle's life. Additionally, in many applications it is necessary to monitor changes in these materials over their lifetime. Quantitative characterization through Nondestructive Evaluation (NDE) of defects such as reduced bond strength, microcracking, and delamination damage due to impact, are of particular interest. This paper will present an overview of NASA's applications of NDE technologies being developed for the characterization and sustainment of advanced aerospace composites. The approaches presented include investigation of conventional, guided wave, and phase sensitive ultrasonic methods and infrared thermography techniques for NDE. Finally, the use of simulation tools for optimizing and validating these techniques will also be discussed.

Cramer, K. Elliott↗

Thrust stand evaluation of engine performance improvement algorithms in an F-15 airplane

An investigation is underway to determine the benefits of a new propulsion system optimization algorithm in an F-15 airplane. The performance seeking control (PSC) algorithm optimizes the quasi-steady-state performance of an F100 derivative turbofan engine for several modes of operation. The PSC algorithm uses an onboard software engine model that calculates thrust, stall margin, and other unmeasured variables for use in the optimization. As part of the PSC test program, the F-15 aircraft was operated on a horizontal thrust stand. Thrust was measured with highly accurate load cells. The measured thrust was compared to onboard model estimates and to results from posttest performance programs. Thrust changes using the various PSC modes were recorded. Those results were compared to benefits using the less complex highly integrated digital electronic control (HIDEC) algorithm. The PSC maximum thrust mode increased intermediate power thrust by 10 percent. The PSC engine model did very well at estimating measured thrust and closely followed the transients during optimization. Quantitative results from the evaluation of the algorithms and performance calculation models are included with emphasis on measured thrust results. The report presents a description of the PSC system and a discussion of factors affecting the accuracy of the thrust stand load measurements.

Conners, Timothy R.↗

Analysis of a document/reporting system

An in-depth analysis of the information system within the Data Processing Branch is presented. Quantitative measures are used to evaluate the efficiency and effectiveness of the information system. It is believed that this is the first documented study which utilizes quantitative measures for full scale system analysis. The quantitative measures and techniques for collecting and qualifying the basic data, as described, are applicable to any information system. Therefore this report is considered to be of interest to any persons concerned with the management design, analysis or evaluation of information systems.

Narrow, B.↗

Determination of the geoid from satellite altimeter data

The characteristics of the geoid surface are quantitatively described. A procedure for calculating the satellite altitude is developed. Error sources are described quantitatively, mathematically modeled, and evaluated in computer simulation. Procedures for maximum likelihood processing of altimeter data for recovery of orbit and geopotential information are presented for several geopotential models.

Brown, R. D.↗

The application of acoustic emission technique to fatigue crack measurement

The applicability of acoustic emission technique to measure fatigue cracks in aluminum alloy specimens was investigated. There are several variables, such as the metallurgical and the physical treatment of the specimen, that can affect the level of acoustic activity of a fatigue specimen. It is therefore recommended that the acoustic emission technique be supplemented by other nondestructive evaluation methods to obtain quantitative data on crack growth.

Singh, J. J.↗

Cardiovascular effects of variations in habitual levels of physical activity

Mechanisms involved in human cardiovascular adaption to stress, particularly adaption to different levels of physical activity are determined along with quantitative noninvasive methods for evaluation of cardiovascular function during stess in normal subjects and in individuals with latent or manifest cardiovascular disease. Results are summarized.

Blomqvist, C. G.↗

A review of issues and strategies in nondestructive evaluation of fiber reinforced structural composites

The need for advanced nondestructive evaluation (NDE) techniques for quantitative assessment of the mechanical strength and integrity of fiber composites during manufacture and service and following repair operations is stressed. The discussion covers problems and different approaches in regard to acceptance criteria, calibration standards, and methods for NDE of composites in strength critical applications. Finally, it is concluded that acousto-ultrasonic techniques provide the 'methods of choice' in this area.

Vary, A.↗