Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Daily Ambient Air Pollution Metrics for Five Cities: Evaluation of Data Fusion-Based Estimates and Uncertainties

Spatiotemporal characterization of ambient air pollutant concentrations is increasingly relying on the combination of observations and air quality models to provide well-constrained, spatially and temporally complete pollutant concentration fields. Air quality models, in particular, are attractive, as they characterize the emissions, meteorological, and physiochemical process linkages explicitly while providing continuous spatial structure. However, such modeling is computationally intensive and has biases. The limitations of spatially sparse and temporally incomplete observations can be overcome by blending the data with estimates from a physically and chemically coherent model, driven by emissions and meteorological inputs. We recently developed a data fusion method that blends ambient ground observations and chemical transport-modeled (CTM) data to estimate daily, spatially resolved pollutant concentrations and associatedcorrelations. In this study, we assess the ability of the data fusion method to produce daily metrics (i.e., 1-hr max, 8-hr max, and 24-hr average) of ambient air pollution that capture spatiotemporal air pollution trends for 12 pollutants (CO, NO2, NOx, O3, SO2, PM (sub10), PM (sub 2.5), and five PM (sub 2.5) components) across five metropolitan areas (Atlanta, Birmingham, Dallas, Pittsburgh, and St. Louis), from 2002 to 2008. Three sets of comparisons are performed: (1) the CTM concentrations are evaluated for each pollutant and metropolitan domain, (2) the data fusion concentrations are compared with the monitor data, (3) a comprehensive cross-validation analysis against observed data evaluates the quality of the data fusion model simulations across multiple metropolitan domains. The resulting daily spatial field estimates of air pollutant concentrations and uncertainties are not only consistent with observations, emissions, andmeteorology, but substantially improve CTM-derived results for nearly all pollutants and all cities, with the exception of NO2 for Birmingham. The greatest improvements occur for O3 and PM (sub 2.5). Squared spatiotemporal correlation coefficients range between simulations and observations determined using cross-validation across all cities for air pollutants of secondary and mixed origins are R-squared equal to 0.88-0.93 (O3), 0.81-0.89 (SO4), 0.67-0.83 (PM (sub 2.5)), 0.52-0.72 (NO3), 0.43-0.80 (NH4), 0.32-0.51 (OC), and 0.14-0.71 (PM (sub 10)). Results for relatively homogeneous pollutants of secondary origin, tend to be better than those for more spatially heterogeneous (larger spatial gradients) pollutants of primary origin (NOx, CO, SO2 and EC). Generally, background concentrations and spatial concentration gradients reflect interurban airshed complexity and the effects of regional transport, whereas daily spatial pattern variability shows intra urban consistency in the fused data. With sufficiently high CTM spatial resolution, traffic-related pollutants exhibit gradual concentration gradients that peak toward the urban centers. Ambient pollutant concentration uncertainty estimates for the fused data are both more accurate and smaller than those for either the observations or the model simulations alone.

spatiotemporal fusion↗

Optimization of Regression Models of Experimental Data Using Confirmation Points

A new search metric is discussed that may be used to better assess the predictive capability of different math term combinations during the optimization of a regression model of experimental data. The new search metric can be determined for each tested math term combination if the given experimental data set is split into two subsets. The first subset consists of data points that are only used to determine the coefficients of the regression model. The second subset consists of confirmation points that are exclusively used to test the regression model. The new search metric value is assigned after comparing two values that describe the quality of the fit of each subset. The first value is the standard deviation of the PRESS residuals of the data points. The second value is the standard deviation of the response residuals of the confirmation points. The greater of the two values is used as the new search metric value. This choice guarantees that both standard deviations are always less or equal to the value that is used during the optimization. Experimental data from the calibration of a wind tunnel strain-gage balance is used to illustrate the application of the new search metric. The new search metric ultimately generates an optimized regression model that was already tested at regression model independent confirmation points before it is ever used to predict an unknown response from a set of regressors.

Ulbrich, N.↗

Data simulation for the Lightning Imaging Sensor (LIS)

This project aims to build a data analysis system that will utilize existing video tape scenes of lightning as viewed from space. The resultant data will be used for the design and development of the Lightning Imaging Sensor (LIS) software and algorithm analysis. The desire for statistically significant metrics implies that a large data set needs to be analyzed. Before 1990 the quality and quantity of video was insufficient to build a usable data set. At this point in time, there is usable data from missions STS-34, STS-32, STS-31, STS-41, STS-37, and STS-39. During the summer of 1990, a manual analysis system was developed to demonstrate that the video analysis is feasible and to identify techniques to deduce information that was not directly available. Because the closed circuit television system used on the space shuttle was intended for documentary TV, the current value of the camera focal length and pointing orientation, which are needed for photoanalysis, are not included in the system data. A large effort was needed to discover ancillary data sources as well as develop indirect methods to estimate the necessary parameters. Any data system coping with full motion video faces an enormous bottleneck produced by the large data production rate and the need to move and store the digitized images. The manual system bypassed the video digitizing bottleneck by using a genlock to superimpose pixel coordinates on full motion video. Because the data set had to be obtained point by point by a human operating a computer mouse, the data output rate was small. The loan and subsequent acquisition of a Abekas digital frame store with a real time digitizer moved the bottleneck from data acquisition to a problem of data transfer and storage. The semi-automated analysis procedure was developed using existing equipment and is described. A fully automated system is described in the hope that the components may come on the market at reasonable prices in the next few years.

Boeck, William L.↗

Space shuttle flying qualities and criteria assessment

Work accomplished under a series of study tasks for the Flying Qualities and Flight Control Systems Design Criteria Experiment (OFQ) of the Shuttle Orbiter Experiments Program (OEX) is summarized. The tasks involved review of applicability of existing flying quality and flight control system specification and criteria for the Shuttle; identification of potentially crucial flying quality deficiencies; dynamic modeling of the Shuttle Orbiter pilot/vehicle system in the terminal flight phases; devising a nonintrusive experimental program for extraction and identification of vehicle dynamics, pilot control strategy, and approach and landing performance metrics, and preparation of an OEX approach to produce a data archive and optimize use of the data to develop flying qualities for future space shuttle craft in general. Analytic modeling of the Orbiter's unconventional closed-loop dynamics in landing, modeling pilot control strategies, verification of vehicle dynamics and pilot control strategy from flight data, review of various existent or proposed aircraft flying quality parameters and criteria in comparison with the unique dynamic characteristics and control aspects of the Shuttle in landing; and finally a summary of conclusions and recommendations for developing flying quality criteria and design guides for future Shuttle craft.

Myers, T. T.↗

Precision Assessment of the HPLC Phytoplankton Pigment Dataset Analyzed by NASA to Quantify Global Variability in Support of Ocean Color Remote Sensing

The ability to generate chlorophyll a (Chl a) assessments from ocean color orbital sensors, such as VIIRS and MODIS, that satisfy the requirements to be climate-quality data record (CDR) quality is contingent in part on the quality of the in situ ground or sea truth observations that serve as datasets for vicarious calibration and algorithm validation activities. NASA has a mandate to collect, analyze, and distribute in situ data of the highest possible quality with documented uncertainties and in keeping with established performance metrics. Using a dataset of over 18,000 HPLC phytoplankton pigment samples representing water collected in all major ocean basins analyzed a central laboratory (Field Support Group (FSG) of the Ocean Ecology Laboratory (OEL) at NASA Goddard Space Flight Center (GSFC)), we performed an assessment of the global precision among sample replicates of Chl a as well as major accessory pigments. We investigated the impacts of filtration volume, water basin, collection technique, pigment concentration, and different filtration volumes for replicate filters on replicate filter precision, as well as investigating any pigment-specific differences. Our results quantify sample variability with the goal of understanding any systemic biases or biogeographic influences.

Thomas, Crystal S.↗

Image Compression Algorithm Altered to Improve Stereo Ranging

A report discusses a modification of the ICER image-data-compression algorithm to increase the accuracy of ranging computations performed on compressed stereoscopic image pairs captured by cameras aboard the Mars Exploration Rovers. (ICER and variants thereof were discussed in several prior NASA Tech Briefs articles.) Like many image compressors, ICER was designed to minimize a mean-square-error measure of distortion in reconstructed images as a function of the compressed data volume. The present modification of ICER was preceded by formulation of an alternative error measure, an image-quality metric that focuses on stereoscopic-ranging quality and takes account of image-processing steps in the stereoscopic-ranging process. This metric was used in empirical evaluation of bit planes of wavelet-transform subbands that are generated in ICER. The present modification, which is a change in a bit-plane prioritization rule in ICER, was adopted on the basis of this evaluation. This modification changes the order in which image data are encoded, such that when ICER is used for lossy compression, better stereoscopic-ranging results are obtained as a function of the compressed data volume.

Kiely, Aaron↗

Link Analysis for Space Communication Links Using ARQ Protocol

In space communications, standard link analysis assumes that messages are sent once. For a communication link that uses an error-correction coding scheme, bit-error-rate (BER) or frame-error-rate (FER), and link margins are common metrics that characterize the quality of a link, and they are used to determine the supportable data rate. With the advent of Automatic Repeat-reQuest (ARQ) protocols, when messages are corrupted during transmission, they can be resent multiple times automatically until they are correctly received and acknowledged. The concept of BER, FER, and link margin cannot be directly applied, and the link analysis approach for ARQ links needs to be re-examined.

Cheung, Kar-Ming↗

A New Paradigm for Quality Metrics

SMA metrics have been traditionally represented as either leading and lagging indicators. Traditional ways of viewing these metrics and trending the data is via graphs which reflect one attribute in each graph. The KSC Independent Assessment Team developed a non-traditional method for expressing variation as a ratio (the deviation between the Expected and Actual). This method allows different measures to be plotted on the same graph for trending and comparison to provide a holistic view across a particular theme or discipline. Since all measurements are a ratio of variation and dimensionless, this variation-based metrics approach can be used a new analytical tool which is complimentary to existing value-added metrics tools.

Dimensionless↗

Using Multi-Core Systems for Rover Autonomy

Task Objectives are: (1) Develop and demonstrate key capabilities for rover long-range science operations using multi-core computing, (a) Adapt three rover technologies to execute on SOA multi-core processor (b) Illustrate performance improvements achieved (c) Demonstrate adapted capabilities with rover hardware, (2) Targeting three high-level autonomy technologies (a) Two for onboard data analysis (b) One for onboard command sequencing/planning, (3) Technologies identified as enabling for future missions, (4)Benefits will be measured along several metrics: (a) Execution time / Power requirements (b) Number of data products processed per unit time (c) Solution quality

multi-core↗

Assimilation of TROPICS Radiance Data in Nasa Geos System and Impact Assessments Through Observing System Experiments

Since the first full-scale weather satellite Television Infrared Observation Satellite (TIROS)-1 was launched in 1960 to measure weather patterns from space, the number of satellites carrying various sensors to measure atmospheric properties has increased rapidly. Data from these meteorological satellites have been crucial to the advancement of the NWP forecasts. Especially, space-borne measurements of atmospheric temperature and moisture information provided by microwave sounders were reported to contribute most to positive impacts on global NWP forecasts. Developing and launching an operational weather satellite is a daunting and tremendously expensive mission that requires many years of planning, developments, and maintenance after the launch. Small satellites with low size, weight, and power requirements can reduce the cost associated with the construction and launch of large bus platforms and draw attention of several space agencies and weather technology companies that started investing their resources to develop small satellites and measure the potential benefits and weaknesses. The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Currently five TROPICS cubsats, including TROPICS-pathfinder, are in space and provide the temperature and humidity data from space to the meteorological community. This study seeks to assess the potential impact that the constellation of TROPICS satellites may bring to the global NWP analysis and forecasts by assimilating all-sky TROPICS data and implementing observing system experiments (OSE) using the NASA GEOS system. Various evaluations metrics including forecast skills, fit to other observations such as radiosondes and microwave and infrared sounder are used. Along with the NWP impact assessment, the quality of the TROPICS data is evaluated by looking at observation minus forecast statistics in comparisons with other conventional satellite temperature and humidity sounders.

Min-Jeong Kim↗

Assimilation of TROPICS Radiance Data in NASA GEOS System and Impact Assessments Through Observing System Experiments

Since the first full-scale weather satellite Television Infrared Observation Satellite (TIROS)-1 was launched in 1960 to measure weather patterns from space, the number of satellites carrying various sensors to measure atmospheric properties has increased rapidly. Data from these meteorological satellites have been crucial to the advancement of the NWP forecasts. Especially, space-borne measurements of atmospheric temperature and moisture information provided by microwave sounders were reported to contribute most to positive impacts on global NWP forecasts. Developing and launching an operational weather satellite is a daunting and tremendously expensive mission that requires many years of planning, developments, and maintenance after the launch. Small satellites with low size, weight, and power requirements can reduce the cost associated with the construction and launch of large bus platforms and draw attention of several space agencies and weather technology companies that started investing their resources to develop small satellites and measure the potential benefits and weaknesses. The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Currently five TROPICS cubsats, including TROPICS-pathfinder, are in space and provide the temperature and humidity data from space to the meteorological community. This study seeks to assess the potential impact that the constellation of TROPICS satellites may bring to the global NWP analysis and forecasts by assimilating all-sky TROPICS data and implementing observing system experiments (OSE) using the NASA GEOS system. Various evaluations metrics including forecast skills, fit to other observations such as radiosondes and microwave and infrared sounder are used. Along with the NWP impact assessment, the quality of the TROPICS data is evaluated by looking at observation minus forecast statistics in comparisons with other conventional satellite temperature and humidity sounders.

Min-Jeong Kim↗

The software product assurance metrics study: JPL's software systems quality and productivity

The findings are reported of the Jet Propulsion Laboratory (JPL)/Software Product Assurance (SPA) Metrics Study, conducted as part of a larger JPL effort to improve software quality and productivity. Until recently, no comprehensive data had been assembled on how JPL manages and develops software-intensive systems. The first objective was to collect data on software development from as many projects and for as many years as possible. Results from five projects are discussed. These results reflect 15 years of JPL software development, representing over 100 data points (systems and subsystems), over a third of a billion dollars, over four million lines of code and 28,000 person months. Analysis of this data provides a benchmark for gauging the effectiveness of past, present and future software development work. In addition, the study is meant to encourage projects to record existing metrics data and to gather future data. The SPA long term goal is to integrate the collection of historical data and ongoing project data with future project estimations.

Bush, Marilyn W.↗

NASA Scientific Data Purchase Project: From Collection to User

NASA's Scientific Data Purchase (SDP) project is currently a $70 million operation managed by the Earth Science Applications Directorate at Stennis Space Center. The SDP project was developed in 1997 to purchase scientific data from commercial sources for distribution to NASA Earth science researchers. Our current data holdings include 8TB of remote sensing imagery consisting of 18 products from 4 companies. Our anticipated data volume is 60 TB by 2004, and we will be receiving new data products from several additional companies. Our current system capacity is 24 TB, expandable to 89 TB. Operations include tasking of new data collections, archive ordering, shipment verification, data validation, distribution, metrics, finances, customer feedback, and technical support. The program has been included in the Stennis Space Center Commercial Remote Sensing ISO 9001 registration since its inception. Our operational system includes automatic quality control checks on data received (with MatLab analysis); internally developed, custom Web-based interfaces that tie into commercial-off-the-shelf software; and an integrated relational database that links and tracks all data through operations. We've distributed nearly 1500 datasets, and almost 18,000 data files have been downloaded from our public web site; on a 10-point scale, our customer satisfaction index is 8.32 at a 23% response level. More information about the SDP is available on our Web site.

Nicholson, Lamar↗

Remote sensing evaluation of the Klondike Mining District, Nevada. Part 1: Geology, photography and infrared

During August of 1970 Mission 140 was flown with the NASA P3A aircraft over the Klondike Mining District, Nevada. High quality metric photography, thermal infrared imagery, multispectral photography and multichannel microwave radiometry were obtained. Geology and ground truth data are presented and relationships of the physical attributes of geologic materials to remotely sensed data is discussed. It is concluded that remote sensing data was valuable in the geologic evaluation of the Klondike Mining District and would be of value in other mining districts.

Brennan, P. A.↗

Apparent depth/apparent diameter relation for lunar craters

Photogrammetric measurements from Apollo metric-quality pictures ensure high accuracy of apparent depth (R sub a) and apparent diameter (D sub a) data for fresh lunar craters. R sub a is a direct function of D sub a and the R sub a/D sub a distribution inflects sharply at an apparent diameter of about 15 km. Each of the two resulting subgroups of craters requires two separate least-squares fits. For simple lunar craters (less than 15 km across), the ratio of R sub a to D sub a is about 0.2; the ratio for complex (larger) craters ranges from 0.1 to 0.01. Apparent depth does not exceed 3400 m, regardless of crater size, possibly as a result of isostasy, substrate layering, or curvature of the moon. R sub a/D sub a differences for mare versus terra craters are either absent or are equivocal. The ratio of apparent diameter to rim-crest diameter (D sub a/D sub r) averages 0.83 for smaller craters and 0.86 for larger craters, indicating another simple-to-complex contrast in crater morphology on the moon, and confirms a prediction by R. B. Baldwin for simple craters. Close similarity of D sub a/D sub r for terrestrial experimental craters and simple lunar craters is especially consistent with impact origin for the moon's craters.

Pike, R. J.↗

The Effects of Development Team Skill on Software Product Quality

This paper provides an analysis of the effect of the skill/experience of the software development team on the quality of the final software product. A method for the assessment of software development team skill and experience is proposed, and was derived from a workforce management tool currently in use by the National Aeronautics and Space Administration. Using data from 26 smallscale software development projects, the team skill measures are correlated to 5 software product quality metrics from the ISO/IEC 9126 Software Engineering Product Quality standard. in the analysis of the results, development team skill is found to be a significant factor in the adequacy of the design and implementation. In addition, the results imply that inexperienced software developers are tasked with responsibilities ill-suited to their skill level, and thus have a significant adverse effect on the quality of the software product. Keywords: software quality, development skill, software metrics

Beaver, Justin M.↗

It's All Relative: A Validation of Radiation Quality Comparison Metrics

Historically, the relative biological effectiveness (RBE) has been calculated to quantify the difference between heavy ion and gamma ray radiation. The RBE is then applied to gamma ray data to predict the effects of heavy ions in humans. The RBE is an iso-effect dose-to-dose ratio which, due to its counterintuitive nature, has been commonly miscalculated as an iso-dose effect-to-effect ratio. A paper recently published by Shuryak et al described this second measure intentionally for the first time in 2017, referring to it as the radiation effects ratio (RER). In this study, we utilized simulations to test the ability of both the RBE and the RER to predict known heavy ion effects. RBEs and RERs were calculated using mouse data from Chang et al, and the ability of the RBE and RER to predict the heavy ion data from which they were calculated was verified. Statistical transformations often utilized during data analysis were applied to the gamma and heavy ion data to determine whether RBE and RER are each uniquely defined measures. Scale changes are expected when translating effects from mice to humans and between human populations; gamma and heavy ion data were transformed to represent potential scale changes. The ability of the RBE and RER to predict the transformed heavy ion data from the transformed gamma data was then tested. The RBE but not the RER was uniquely defined after all statistical transformations. The RBE correctly predicted the scale-transformed heavy ion data, while the RER did not. This presentation describes potential implications for both metrics in light of these findings.

Chappell, L. J.↗

Estimation and Bias Correction of Aerosol Abundance using Data-driven Machine Learning and Remote Sensing

Air quality information is increasingly becoming a public health concern, since some of the aerosol particles pose harmful effects to peoples health. One widely available metric of aerosol abundance is the aerosol optical depth (AOD). The AOD is the integrated light extinction coefficient over a vertical atmospheric column of unit cross section, which represents the extent to which the aerosols in that vertical profile prevent the transmission of light by absorption or scattering. The comparison between the AOD measured from the ground-based Aerosol Robotic Network (AERONET) system and the satellite MODIS instruments at 550 nm shows that there is a bias between the two data products. We performed a comprehensive analysis exploring possible factors which may be contributing to the inter-instrumental bias between MODIS and AERONET. The analysis used several measured variables, including the MODIS AOD, as input in order to train a neural network in regression mode to predict the AERONET AOD values. This not only allowed us to obtain an estimate, but also allowed us to infer the optimal sets of variables that played an important role in the prediction. In addition, we applied machine learning to infer the global abundance of ground level PM2.5 from the AOD data and other ancillary satellite and meteorology products. This research is part of our goal to provide air quality information, which can also be useful for global epidemiology studies.

Malakar, Nabin K.↗