Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Telemetry Metrics: Monitoring Data Quality in the Spacecraft Ground Data System

During the launch of Mars Odyssey, ground data system (GDS) engineers experienced a glitch in the ground data system that caused us to re-evaluate how we looked at spacecraft telemetry, particularly during the spacecraft development period and for critical spacecraft events in flight. Spacecraft telemetry told the subsystem and instrument engineers about the health and status of the spacecraft, but there was surprisingly little information about how well the ground data system was doing in getting information from the spacecraft to the engineers.The problem for the Mars Odyssey launch was with a single channel not updating as often as expected. Spacecraft engineers considered calling off the Launch but eventually decided that this particular channel did not provide information that was crucial for launch. It was only after the post launch acquisition of the Odyssey signal that ground data system engineers heard there had been a concern about the channel....

Mars↗
NASA NTRS2007

Progress in Flaps Down Flight Reynolds Number Testing Techniques at the NTF

A series of NASA/Boeing cooperative low speed wind tunnel tests was conducted in the National Transonic Facility (NTF) between 2003 and 2004 using a semi-span high lift model representative of the 777-200 aircraft. The objective of this work was to develop the capability to acquire high quality, low speed (flaps down) wind tunnel data at up to flight Reynolds numbers in a facility originally optimized for high speed full span models. In the course of testing, a number of facility and procedural improvements were identified and implemented. The impact of these improvements on key testing metrics data quality, productivity, and so forth - was significant, and is discussed here, together with the relevance of these metrics as applied to cryogenic wind tunnel testing in general. Details of the improvements at the NTF are discussed in AIAA-2006-0508 (Recent Improvements in Semi-span Testing at the National Transonic Facility). The development work at the NTF culminated with validation testing of a 787-8 semi-span model at full flight Reynolds number in the first quarter of 2006.

Payne, Frank↗
NASA NTRS2012

NASA In Situ Data Needs to Support the Operational Calibration and Validation of Ocean Color Satellite Data Products

Calibrating ocean color satellite instruments and validating their data products requires temporal and spatial abundances of high quality in situ oceanographic data. The Consortium for Ocean Leadership Ocean Observing Initiative (OOl) is currently implementing a distributed array of in-water sensors that could provide a significant contribution to future ocean color activities. This workshop will scope the optimal way to use and possibly supplement the planned OOl infrastructure to maximize its utility and relevance for calibration and validation activities that support existing and planned NASA ocean color missions. Here, I present the current state of the art of NASA validation of ocean color data products, with attention to autonomous time-series (e.g., the AERONET -OC network of above-water radiometers), and outline NASA needs for data quality assurance metrics and adherence to community-vetted data collection protocols

Werdel, P. Jeremy↗
NASA NTRS2016

A New Look at Data Usage by Using Metadata Attributes as Indicators of Data Quality

This study reviews the key metrics (users, distributed volume, and files) in multiple ways to gain an understanding of the significance of the metadata. Characterizing the usability of data by key metadata elements, such as discipline and study area, will assist in understanding how the user needs have evolved over time. The data usage pattern based on product level provides insight into the level of data quality. In addition, the data metrics by various services, such as the Open-source Project for a Network Data Access Protocol (OPeNDAP) and subsets, address how these services have extended the usage of data. Over-all, this study presents the usage of data and metadata by metrics analyses, which may assist data centers in better supporting the needs of the users.

metadata↗
NASA NTRSDate not supplied

Elevating the Quality of Space Omics Sequencing Data: Innovations and Methodologies from NASA GeneLab Sample Processing Laboratory

NASA’s GeneLab, part of the NASA Open Science Data Repository, is a space-related database that hosts a diverse range of transcriptomics, proteomics, epigenomics and genomics data. The NASA GeneLab Sample Processing Laboratory (SPL) generates omics data from biological experiments conducted aboard the International Space Station, Space Shuttle and space related ground experiments, this omics data then hosted on the GeneLab repository. Samples generated such experiments pose numerous technical challenges such as small experimental sample size, variance in dissection times, limited tissue preservation methods, prolonged storage time, and more. GeneLab SPL team had developed specialized expertise in nucleic acid extraction, library preparation and sequencing of such biological samples via extensive training and years of experience. In order to ensure data accuracy and consistency across experiments, SPL has developed standardized protocols for each species and tissue type. These protocols in conjunction with quality control metrics and data standards are crucial in generating of high-quality data. SPL protocols and standards have been developed in collaboration with the scientific community and had been made publicly available on the GeneLab portal, guaranteeing comparability of datasets across spaceflight experiments. To ensure reliability of data generation, SPL leverages cutting-edge innovations in laboratory automation for sample processing. By leveraging these state-of-the-art platforms, SPL achieves high levels of data reproducibility while significantly minimizing sources of bias and variability, especially across experiments with large numbers of samples. Over the past few years, the space biology investigator community has accessed SPL-generated data from the Open Science Data Repository for a myriad of data re-analysis and re-use studies. We observe a trend that in-house SPL-generated data consistently outperforms outsourced sequencing data in terms of technical standards, quality control metrics, timeliness of data delivery, and sequencing and reagent efficiency. Superior data generation has and will continue to enable discoveries in disease, diagnostic tools, and the biological effects of long duration spaceflight.

GeneLab↗
NASA NTRSDate not supplied

Elevating the Quality of Space Omics Sequencing Data: Innovations and Methodologies from NASA GeneLab Sample Processing Laboratory

NASA’s GeneLab, part of the NASA Open Science Data Repository, is a space-related database that hosts a diverse range of transcriptomics, proteomics, epigenomics and genomics data. The NASA GeneLab Sample Processing Laboratory (SPL) generates omics data from biological experiments conducted aboard the International Space Station, Space Shuttle and space related ground experiments, this omics data then hosted on the GeneLab repository. Samples generated such experiments pose numerous technical challenges such as small experimental sample size, variance in dissection times, limited tissue preservation methods, prolonged storage time, and more. GeneLab SPL team had developed specialized expertise in nucleic acid extraction, library preparation and sequencing of such biological samples via extensive training and years of experience. In order to ensure data accuracy and consistency across experiments, SPL has developed standardized protocols for each species and tissue type. These protocols in conjunction with quality control metrics and data standards are crucial in generating of high-quality data. SPL protocols and standards have been developed in collaboration with the scientific community and had been made publicly available on the GeneLab portal, guaranteeing comparability of datasets across spaceflight experiments. To ensure reliability of data generation, SPL leverages cutting-edge innovations in laboratory automation for sample processing. By leveraging these state-of-the-art platforms, SPL achieves high levels of data reproducibility while significantly minimizing sources of bias and variability, especially across experiments with large numbers of samples. Over the past few years, the space biology investigator community has accessed SPL-generated data from the Open Science Data Repository for a myriad of data re-analysis and re-use studies. We observe a trend that in-house SPL-generated data consistently outperforms outsourced sequencing data in terms of technical standards, quality control metrics, timeliness of data delivery, and sequencing and reagent efficiency. Superior data generation has and will continue to enable discoveries in disease, diagnostic tools, and the biological effects of long duration spaceflight.

GeneLab↗
NASA NTRS2010

Evaluation of Dual Pressurized Rover Operations During Simulated Planetary Surface Exploration

Introduction: A pair of small pressurized rovers (Space Exploration Vehicles, or SEVs) is at the center of the Global Point-of-Departure architecture for future human planetary exploration. Simultaneous operation of multiple crewed surface assets should maximize productive crew time, minimize overhead, and preserve contingency return paths. Methods: A 14-day mission simulation was conducted in the Arizona desert as part of NASA?s 2010 Desert Research and Technology Studies (DRATS). The simulation involved two SEV concept vehicles performing geological exploration under varied operational modes affecting both the extent to which the SEVs must maintain real-time communications with mission control ("Continuous" vs. "Twice-a-Day") and their proximity to each other ("Lead-and-Follow" vs. "Divide-and-Conquer"). As part of a minimalist lunar architecture, no communications relay satellites were assumed. Two-person crews consisting of an astronaut and a field geologist operated each SEV, day and night, throughout the entire 14-day mission, only leaving via the suit ports to perform simulated extravehicular activities. Standard metrics enabled quantification of the habitability and usability of all aspects of the SEV concept vehicles throughout the mission, as well as comparison of the extent to which the operating modes affected crew productivity and performance. Practically significant differences in the relevant metrics were prospectively defined for the testing of all hypotheses. Results and Discussion: Data showed a significant 14% increase in available science time (AST) during Lead-and-Follow mode compared with Divide-and-Conquer, primarily because of the minimal overhead required to maintain communications during Lead-and-Follow. In Lead-and-Follow mode, there was a non-significant 2% increase in AST during Twice-a-Day vs. Continuous communications. Situational awareness of the other vehicle?s location, activities, and contingency return constraints were enhanced during Lead-and-Follow and Twice-a-Day communications modes due to line-of-sight and direct SEV-to-SEV communication. Preliminary analysis of Scientific Data Quality and Observation Quality metrics showed no significant differences between modes.

Abercromby, Andrew F. J.↗
NASA NTRSDate not supplied

Lucy Orbit Determination Performance From Launch Through EGA-1

Lucy is a 12-year long NASA Discovery-class mission which launched on October 16, 2021 and is currently on its way to the Jupiter-Trojan asteroids at the L4 and L5 Lagrange points. On its journey to the Trojan asteroids, Lucy will also fly by two main belt asteroids, and perform 3 Earth fly bys. This paper summarizes primarily the Orbit Determination (OD) aspect of the first year of the mission from launch through the first Earth fly by (EGA-1). Some challenges were encountered for OD as part of the +Y solar array not fully deploying, but these were resolved within the first year of flight. The high quality radio-metric data from the Deep Space Network including 2- and 3-way Doppler, sequential 2-way ranging, complemented by delta differential one-way ranging (∆DOR) has enabled the OD team to characterize the Solar Radiation Pressure force, resolve desaturation maneuvers, generate both maneuver reconstructions and accurate long-term predicted trajectories. This paper discusses the filter setup and strategies implemented, as well as the OD performance from launch, through cruise, and including EGA-1.

Jeroen L. Geeraert↗
NASA NTRS2018

An Overall Assessment of JPSS-2 VIIRS Radiometric Performance Based on Pre-Launch Testing

The Visible Infrared Imaging Radiometer Suite (VIIRS) on-board the second Joint Polar Satellite System (JPSS) completed its sensor level testing in February 2018. The JPSS-2 (J2) mission is scheduled to launch in 2022 and will be very similar to its two predecessor missions, the Suomi National Polar-orbiting Partnership (SNPP) mission, launched on 28 October 2011 and JPSS-1 (renamed NOAA-20) launched on 18 November 2017. VIIRS instrument has 22 spectral bands covering the spectrum between 0.4 and 12.6 μm: 14 reflective solar bands (RSB), 7 thermal emissive bands (TEB) and one day-night band (DNB). It is a cross-track scanning radiometer capable of providing global measurements through observations at two spatial resolutions, 375 m and 750 m at nadir for the imaging bands and moderate bands, respectively. This paper will provide an overview of J2 VIIRS characterization methodologies and calibration performance during the pre-launch testing phases performed by the National Aeronautics and Space Administration (NASA) VIIRS Characterization Support Team (VCST) to evaluate the at-launch baseline radiometric performance and generate the parameters needed to populate the sensor data record (SDR) Look-Up-Tables (LUTs). Our analysis results confirmed the good performance of J2 VIIRS, in general as good as previous VIIRS instruments and all non-compliances are expected to have low impact on data quality. Key sensor performance metrics include the signal to noise ratio (SNR), radiance dynamic range, reflective and emissive bands calibration performance, polarization sensitivity, spectral performance, response versus scan-angle (RVS) and scattered light response. A set of performance metrics generated during the pre-launch testing program will be compared to both the SNPP and JPSS-1 VIIRS sensors.

Oudrari, Hassan↗
NASA NTRS2006

A Comparison of Visual Statistics for the Image Enhancement of FORESITE Aerial Images with Those of Major Image Classes

Aerial images from the Follow-On Radar, Enhanced and Synthetic Vision Systems Integration Technology Evaluation (FORESITE) flight tests with the NASA Langley Research Center's research Boeing 757 were acquired during severe haze and haze/mixed clouds visibility conditions. These images were enhanced using the Visual Servo (VS) process that makes use of the Multiscale Retinex. The images were then quantified with visual quality metrics used internally with the VS. One of these metrics, the Visual Contrast Measure, has been computed for hundreds of FORESITE images, and for major classes of imaging--terrestrial (consumer), orbital Earth observations, orbital Mars surface imaging, NOAA aerial photographs, and underwater imaging. The metric quantifies both the degree of visual impairment of the original, un-enhanced images as well as the degree of visibility improvement achieved by the enhancement process. The large aggregate data exhibits trends relating to degree of atmospheric visibility attenuation, and its impact on limits of enhancement performance for the various image classes. Overall results support the idea that in most cases that do not involve extreme reduction in visibility, large gains in visual contrast are routinely achieved by VS processing. Additionally, for very poor visibility imaging, lesser, but still substantial, gains in visual contrast are also routinely achieved. Further, the data suggest that these visual quality metrics can be used as external standalone metrics for establishing performance parameters.

Johnson, Daniel J.↗
NASA NTRS1993

Software metrics: The key to quality software on the NCC project

Network Control Center (NCC) Project metrics are captured during the implementation and testing phases of the NCCDS software development lifecycle. The metrics data collection and reporting function has interfaces with all elements of the NCC project. Close collaboration with all project elements has resulted in the development of a defined and repeatable set of metrics processes. The resulting data are used to plan and monitor release activities on a weekly basis. The use of graphical outputs facilitates the interpretation of progress and status. The successful application of metrics throughout the NCC project has been instrumental in the delivery of quality software. The use of metrics on the NCC Project supports the needs of the technical and managerial staff. This paper describes the project, the functions supported by metrics, the data that are collected and reported, how the data are used, and the improvements in the quality of deliverable software since the metrics processes and products have been in use.

Burns, Patricia J.↗
NASA NTRS2006

A Perspective on DSN System Performance Analysis

This paper discusses the performance analysis effort being carried out in the NASA Deep Space Network. The activity involves root cause analysis of failures and assessment of key performance metrics. The root cause analysis helps pinpoint the true cause of observed problems so that proper correction can be effected. The assessment currently focuses on three aspects: (1) data delivery metrics such as Quantity, Quality, Continuity, and Latency; (2) link-performance metrics such as antenna pointing, system noise temperature, Doppler noise, frequency and time synchronization, wide-area-network loading, link-configuration setup time; and (3) reliability, maintainability, availability metrics. The analysis establishes whether the current system is meeting its specifications and if so, how much margin is available. The findings help identify the weak points in the system and direct attention of programmatic investment for performance improvement.

Deep Space Network (DSN)↗
NASA NTRS2012

Optical Sensors for Planetary Radiant Energy (OSPREy): Calibration and Validation of Current and Next-Generation NASA Missions

A principal objective of the Optical Sensors for Planetary Radiance Energy (OSPREy) activity is to establish an above-water radiometer system as a lower-cost alternative to existing in-water systems for the collection of ground-truth observations. The goal is to be able to make high-quality measurements satisfying the accuracy requirements for the vicarious calibration and algorithm validation of next-generation satellites that make ocean color and atmospheric measurements. This means the measurements will have a documented uncertainty satisfying the established performance metrics for producing climate-quality data records. The OSPREy approach is based on enhancing commercial-off-the-shelf fixed-wavelength and hyperspectral sensors to create hybridspectral instruments with an improved accuracy and spectral resolution, as well as a dynamic range permitting sea, Sun, sky, and Moon observations. Greater spectral diversity in the ultraviolet (UV) will be exploited to separate the living and nonliving components of marine ecosystems; UV bands will also be used to flag and improve atmospheric correction algorithms in the presence of absorbing aerosols. The short-wave infrared (SWIR) is expected to improve atmospheric correction, because the ocean is radiometrically blacker at these wavelengths. This report describes the development of the sensors, including unique capabilities like three-axis polarimetry; the documented uncertainty will be presented in a subsequent report.

Hooker, Stanford B.↗
NASA NTRSDate not supplied

Astronaut Sleep Duration Varies by Timing of Scheduled Sleep

INTRODUCTION: Studies find that humans average approximately six hours of sleep per night in space, which is less than they sleep on Earth. Such short sleep duration has been associated with reduced alertness and performance in space. It is unclear whether this sleep loss is related to modifiable factors, such as irregular scheduling, poor sleep environment, and excessive workload or due to features of spaceflight that alter physiology (e.g., microgravity). Recent missions have afforded crew better, more stable sleep and work schedules, and an improved sleep environment. Despite these improvements, schedules do still vary enough to cause decrements in sleep duration. METHODS: Crewmembers (n = 19) who volunteered for the NASA Standard Measures protocol between January 2019 and March 2022 were provided with actiwatches (Phillips, Respironics, Bend OR) that they wore for two bouts of data collection lasting two weeks each before flight (at approximately L-270 and L-180), either continuously (n = 9) or for two weeks every two months while in space (n = 10), and for seven days postflight, immediately upon return to Earth (R+0). A regularly scheduled (or “nominal”) sleep episode would take place between the hours of 9:30pm and 6:00am. We looked at sleep outcomes (sleep duration, wake after sleep onset [WASO], sleep efficiency) depending on the distance from nominal sleep offset to see whether scheduled sleep period affected sleep durations and other metrics of sleep quality. RESULTS: Crewmembers provided data from 402 nights preflight, 2,137 nights inflight, and 275 nights postflight. They averaged 7.33 hours of sleep per night (± 1.16, SD) in space. Though this was significantly less sleep than they achieved preflight (7.87 ± 1.10) or postflight (7.75 ± 1.43, p < .01), this duration of sleep meets the recommended amount for optimal human health and well-being. For every hour after the nominal sleep period a crewmember woke up, their total sleep increased by 25 minutes (up to 5 hours). CONCLUSIONS: We conclude that humans are capable of achieving sufficient sleep in space, especially when their schedules afford adequate sleep (namely, schedules that phase delay rather than advance). Future studies are needed to determine whether microgravity impacts sleep architecture and sleep quality. Going forward, it is imperative that crewmembers are provided with stable schedules, with moderate workload, and environments that are conducive to sleep.

fatigue↗
NASA NTRS1972

Testing of the Apollo 15 Metric Camera System.

Description of tests conducted (1) to assess the quality of Apollo 15 Metric Camera System data and (2) to develop production procedures for total block reduction. Three strips of metric photography over the Hadley Rille area were selected for the tests. These photographs were utilized in a series of evaluation tests culminating in an orbitally constrained block triangulation solution. Results show that film deformations up to 25 and 5 microns are present in the mapping and stellar materials, respectively. Stellar reductions can provide mapping camera orientations with an accuracy that is consistent with the accuracies of other parameters in the triangulation solutions. Pointing accuracies of 4 to 10 microns can be expected for the mapping camera materials, depending on variations in resolution caused by changing sun angle conditions.

Helmering, R. J.↗
NASA NTRS2010

Analysis of Sting Balance Calibration Data Using Optimized Regression Models

Calibration data of a wind tunnel sting balance was processed using a candidate math model search algorithm that recommends an optimized regression model for the data analysis. During the calibration the normal force and the moment at the balance moment center were selected as independent calibration variables. The sting balance itself had two moment gages. Therefore, after analyzing the connection between calibration loads and gage outputs, it was decided to choose the difference and the sum of the gage outputs as the two responses that best describe the behavior of the balance. The math model search algorithm was applied to these two responses. An optimized regression model was obtained for each response. Classical strain gage balance load transformations and the equations of the deflection of a cantilever beam under load are used to show that the search algorithm s two optimized regression models are supported by a theoretical analysis of the relationship between the applied calibration loads and the measured gage outputs. The analysis of the sting balance calibration data set is a rare example of a situation when terms of a regression model of a balance can directly be derived from first principles of physics. In addition, it is interesting to note that the search algorithm recommended the correct regression model term combinations using only a set of statistical quality metrics that were applied to the experimental data during the algorithm s term selection process.

Ulbrich, N.↗
NASA NTRS2022

An Overall Assessment of JPSS-3 VIIRS Radiometric Performance Based on Pre-Launch Testing

Satellite imagery and data are playing an increasingly important role in scientific studies of the Earth and its climate. The scientific community has been demanding ever-increasing capabilities and accuracy from the data provided by these satellites. One key instrument on board a series of satellite platforms is the Visible Infrared Imaging Radiometer Suite (VIIRS), which provides high-quality data of the Earth from low Earth orbit covering the visible to long-wave infrared parts of the spectrum. The fourth build in the series, set to be launched on the Joint Polar-orbiting Satellite System 3 (JPSS-3) platform, has recently completed its main ground calibration program and is set to be integrated into the satellite bus in the near future. This calibration program covered a comprehensive series of performance metrics designed to demonstrate the quality of the science data and ensure the instrument can maintain its calibration successfully once on-orbit. The subject of this work covers the radiometric calibration metrics including dynamic range, signal-to-noise ratio/noise equivalent differential temperature (SNR/NEdT), polarization sensitivity, scattered light response, relative spectral response, response versus scan angle, and uniformity, as well as uncertainties; all key metrics met or exceeded their design requirements with some minor exceptions. Comparisons to previous builds will also be provided.

JPSS-3↗
NASA NTRS1983

Metric analysis and data validation across FORTRAN projects

The desire to predict the effort in developing or explaining the quality of software has led to the proposal of several metrics. As a step toward validating these metrics, the Software Engineering Laboratory (SEL) has analyzed the software science metrics, cyclomatic complexity, and various standard program measures for their relation to effort (including design through acceptance testing), development errors (both discrete and weighted according to the amount of time to locate and fix), and one another. The data investigated are collected from a project FORTRAN environment and examined across several projects at once, within individual projects and by reporting accuracy checks demonstrating the need to validate a database. When the data comes from individual programmers or certain validated projects, the metrics' correlations with actual effort seem to be strongest. For modules developed entirely by individual programmers, the validity ratios induce a statistically significant ordering of several of the metrics' correlations. When comparing the strongest correlations, neither software science's E metric cyclomatic complexity not source lines of code appears to relate convincingly better with effort than the others.

Basili, Victor R.↗