Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Data Quality Assessment Methods for the Eastern Range 915 MHz Wind Profiler Network

The Eastern Range installed a network of five 915 MHz Doppler Radar Wind Profilers with Radio Acoustic Sounding Systems in the Cape Canaveral Air Station/Kennedy Space Center area to provide three-dimensional wind speed and direction and virtual temperature estimates in the boundary layer. The Applied Meteorology Unit, staffed by ENSCO, Inc., was tasked by the 45th Weather Squadron, the Spaceflight Meteorology Group, and the National Weather Service in Melbourne, Florida to investigate methods which will help forecasters assess profiler network data quality when developing forecasts and warnings for critical ground, launch and landing operations. Four routines were evaluated in this study: a consensus time period check a precipitation contamination check, a median filter, and the Weber-Wuertz (WW) algorithm. No routine was able to effectively flag suspect data when used by itself. Therefore, the routines were used in different combinations. An evaluation of all possible combinations revealed two that provided the best results. The precipitation contamination and consensus time routines were used in both combinations. The median filter or WW was used as the final routine in the combinations to flag all other suspect data points.

Lambert, Winifred C.↗

Ares I-X Launch Vehicle Modal Test Measurements and Data Quality Assessments

The Ares I-X modal test program consisted of three modal tests conducted at the Vehicle Assembly Building at NASA s Kennedy Space Center. The first test was performed on the 71-foot 53,000-pound top segment of the Ares I-X launch vehicle known as Super Stack 5 and the second test was performed on the 66-foot 146,000- pound middle segment known as Super Stack 1. For these tests, two 250 lb-peak electro-dynamic shakers were used to excite bending and shell modes with the test articles resting on the floor. The third modal test was performed on the 327-foot 1,800,000-pound Ares I-X launch vehicle mounted to the Mobile Launcher Platform. The excitation for this test consisted of four 1000+ lb-peak hydraulic shakers arranged to excite the vehicle s cantilevered bending modes. Because the frequencies of interest for these modal tests ranged from 0.02 to 30 Hz, high sensitivity capacitive accelerometers were used. Excitation techniques included impact, burst random, pure random, and force controlled sine sweep. This paper provides the test details for the companion papers covering the Ares I-X finite element model calibration process. Topics to be discussed include test setups, procedures, measurements, data quality assessments, and consistency of modal parameter estimates.

Templeton, Justin D.↗

Artemis I Flight Instrumentation Data Quality Assessment and Processing

This paper is in support of the SciTech 2024 Space Launch System Aerosciences Special Sessions being organized by Brent Pomeroy and Jeremy Pinier. On November 16th, 2022, NASA launched the inaugural test flight of the Space Launch System (SLS) carrying the Orion capsule into a high orbit far beyond the Moon. The launch vehicle was instrumented with over three thousand flight instrumentation sensors, which monitored aerodynamic, acoustic, structural, and thermal environments. These data are intended to validate experimental and numerical tools used to predict the design environments which the vehicle experiences during launch and ascent. Prior to launch, tests were performed at the SLS Systems Integration Laboratory (SIL) using flight-like avionics and on the integrated flight hardware of Artemis I at the Vehicle Assembly Building (VAB). The purpose of these tests was to characterize the data acquisition units (DAUs) used to record and telemeter flight data to ground stations in order to assure that flight test objectives can be achieved and to quantify the expected quality of the flight data. In addition, pre-flight assessment and development of tools and methods used to process and disseminate flight data at the Huntsville Operations Support Center (HOSC) were conducted and adjustments made with respect to DAU time-synchronization prior to and after the flight. This paper summarizes these tests and some aspects of the post processing of data are discussed.

Developmental Flight Instrumentation↗

Artemis I Flight Instrumentation Data Quality Assessment and Processing

This paper is in support of the SciTech 2024 Space Launch System Aerosciences Special Sessions being organized by Brent Pomeroy and Jeremy Pinier. On November 16th, 2022, NASA launched an inaugural test flight of the Space Launch System (SLS) carrying the Orion capsule around the moon. The vehicle was instrumented with thousands of Developmental Flight Instrumentation (DFI) sensors, which monitored aerodynamic, acoustic, structural, and thermal environments. These data are used to validate experimental and numerical tools used to predict conditions the vehicle experiences during ascent. Prior to launch, a set of tests were performed to quantify the expected quality of the DFI flight data. These included testing of individual components, such as data acquisition units, at the Systems Integration Laboratory (SIL) and testing of integrated vehicle components at the Vehicle Assembly Building (VAB). This paper summarizes these tests. Some aspects of post processing of data are also discussed.

Developmental Flight Instrumentation↗

Rain attenuation measurements: Variability and data quality assessment

Year to year variations in the cumulative distributions of rain rate or rain attenuation are evident in any of the published measurements for a single propagation path that span a period of several years of observation. These variations must be described by models for the prediction of rain attenuation statistics. Now that a large measurement data base has been assembled by the International Radio Consultative Committee, the information needed to assess variability is available. On the basis of 252 sample cumulative distribution functions for the occurrence of attenuation by rain, the expected year to year variation in attenuation at a fixed probability level in the 0.1 to 0.001 percent of a year range is estimated to be 27 percent. The expected deviation from an attenuation model prediction for a single year of observations is estimated to exceed 33 percent when any of the available global rain climate model are employed to estimate the rain rate statistics. The probability distribution for the variation in attenuation or rain rate at a fixed fraction of a year is lognormal. The lognormal behavior of the variate was used to compile the statistics for variability.

Crane, Robert K.↗

The use of thematic mapper simulator calibration data for assessment of data quality

In flight calibration data collected from the thematic mapper simulator (TMS) were used to assess the quality of Earth scan data. The following results are indicated: (1) based on limited samples, individual TMS channels have noise which varies from channel to channel, but remains constant within a channel; (2) short term variations of more than 5% in the average values of calibration source responses indicate problems; and (3) absolute radiometric calibration is unlikely to be meaningful in a temporal sense due to single point calibration methods used.

Forman, M. L.↗

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗

A Testbed Demonstration of an Intelligent Archive in a Knowledge Building System

The last decade's influx of raw data and derived geophysical parameters from several Earth observing satellites to NASA data centers has created a data-rich environment for Earth science research and applications. While advances in hardware and information management have made it possible to archive petabytes of data and distribute terabytes of data daily to a broad community of users, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications in order to realize the full potential of these valuable datasets. In examining what is needed to enable this progress in the data provider environment that exists today and is expected to evolve in the next several years, we arrived at the concept of an Intelligent Archive in context of a Knowledge Building System (IA/KBS). Our prior work and associated papers investigated usage scenarios, required capabilities, system architecture, data volume issues, and supporting technologies. We identified six key capabilities of an IA/KBS: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting. Among these capabilities, large-scale data mining is perceived by many in the community to be an area of technical risk. One of the main reasons for this is that standard data mining research and algorithms operate on datasets that are several orders of magnitude smaller than the actual sizes of datasets maintained by realistic earth science data archives. Therefore, we defined a test-bed activity to implement a large-scale data mining algorithm in a pseudo-operational scale environment and to examine any issues involved. The application chosen for applying the data mining algorithm is wildfire prediction over the continental U.S. This paper reports a number of observations based on our experience with this test-bed. While proof-of-concept for data mining scalability and utility has been a major goal for the research reported here, it was not the only one. The other five capabilities of an WKBS named above have been considered as well, and an assessment of the implications of our experience for these other areas will also be presented. The lessons learned through the testbed effort and presented in this paper will benefit technologists, scientists, and system operators as they consider introducing IA/KBS capabilities into production systems.

Ramapriyan, Hampapuram↗

An Intelligent Archive Testbed Incorporating Data Mining

Many significant advances have occurred during the last two decades in remote sensing instrumentation, computation, storage, and communication technology. A series of Earth observing satellites have been launched by U.S. and international agencies and have been operating and collecting global data on a regular basis. These advances have created a data rich environment for scientific research and applications. NASA s Earth Observing System (EOS) Data and Information System (EOSDIS) has been operational since August 1994 with support for pre-EOS data. Currently, EOSDIS supports all the EOS missions including Terra (1999), Aqua (2002), ICESat (2002) and Aura (2004). EOSDIS has been effectively capturing, processing and archiving several terabytes of standard data products each day. It has also been distributing these data products at a rate of several terabytes per day to a diverse and globally distributed user community (Ramapriyan et al. 2009). There are other NASA-sponsored data system activities including measurement-based systems such as the Ocean Data Processing System and the Precipitation Processing system, and several projects under the Research, Education and Applications Solutions Network (REASoN), Making Earth Science Data Records for Use in Research Environments (MEaSUREs), and the Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) programs. Together, these activities provide a rich set of resources constituting a value chain for users to obtain data at various levels ranging from raw radiances to interdisciplinary model outputs. The result has been a significant leap in our understanding of the Earth systems that all humans depend on for their enjoyment, livelihood, and survival. The trend in the community today is towards many distributed sets of providers of data and services. Despite this, visions for the future include users being able to locate, fuse and utilize data with location transparency and high degree of interoperability, and being able to convert data to information and usable knowledge in an efficient, convenient manner, aided significantly by automation (Ramapriyan et al. 2004; NASA 2005). We can look upon the distributed provider environment with capabilities to convert data to information and to knowledge as an Intelligent Archive in the Context of a Knowledge Building system (IA-KBS). Some of the key capabilities of an IA-KBS are: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting (Ramapriyan et al. 2004).

Ramapriyan, H.↗

What Is the OPP Approach to the Next Generation of Laboratory Requirements

Planetary Protection Quality Management System NASA’s Office of Planetary Protection uses a quality-based process evaluation approach to verify planetary protection bioburden compliance over a project’s life cycle. The verification strategy shifts from a comparative direct assay approach validating hardware bioburden at a “moment in time,” to one that implements a continual quality assurance demonstration of the analytical process via established data requirements, laboratory operational, and management parameters throughout the mission’s entire assembly process. Laboratory quality-based systems and management strategies are standardized and implemented across government and industry. A standardized laboratory quality system approach increases transparency throughout the project’s life cycle and aligns planetary protection analytical approaches with government and industry practices to support both NASA and commercial endeavors. Strategies include the implementation of a laboratory quality management structure that documents and routinely validates parameters critical to experimental design and data collection, provides data quality assessment parameters, and ultimately validates that the collected data is of sufficient quality and quantity to meet the specified technical goals. Planetary protection can draw on these practices to provide a systematic process-based quality approach to support planetary protection validation and compliance requirements. Quality approaches including data quality objectives, method performance, data acceptance criteria and the associated laboratory quality management system are presented to provide an overview and framework for a planetary protection laboratory quality management system.

Amy Baker↗

Increasing Efficiency at the NTF by Optimizing Model AoA Positioning

The National Transonic Facility (NTF) at NASA Langley Research Center (LaRC) is a national resource for aeronautical research and development. The government, military and private industries rely on the capability of this facility for realistic flight data. Reducing the operation costs and keeping the NTF affordable is essential for aeronautics research. The NTF is undertaking an effort to reduce the time between data points during a pitch polar. This reduction is being driven by the operating costs of a cryogenic facility. If the time per data point can be reduced, a substantial cost savings can be realized from a reduction in liquid nitrogen (LN2) consumption. It is known that angle-of-attack (AoA) positioning is the longest lead-time item between points. In January 2005 a test was conducted at the NTF to determine the cause of the long lead-time so that an effort could be made to improve efficiency. The AoA signal at the NTF originates from onboard instrumentation then travels through a number of different systems including the signal conditioner, digital voltmeter, and the data system where the AoA angle is calculated. It is then fed into a closed loop control system that sets the model position. Each process along this path adds to the time per data point affecting the efficiency of the data taking process. Due to the nature of the closed loop feed back AoA control and the signal path, it takes approximately 18 seconds to take one pitch pause point with a typical AoA increment. Options are being investigated to reduce the time delay between points by modifying the signal path. These options include: reduced signal filtering, using analog channels instead of a digital volt meter (DVM), re-routing the signal directly to the AoA control computer and implementing new control algorithms. Each of these has potential to reduce the positioning time and together the savings could be significant. These timesaving efforts are essential but must be weighed against possible loss of data quality. For example, a reduction in filtering can introduce noise into the signal and using analog channels could result in some loss of accuracy. Data quality assessments need to be performed concurrently with timesaving techniques since data quality parameters are essential in maintaining facility integrity. This paper will highlight time saving efforts being undertaken or studied at the NTF. It will outline the instrumentation and computer systems involved in setting of the model pitch attitude then suggest changes to the process and discuss how these system changes would effect the time between data points. It also discusses the issue of data quality and how the potential efficiency changes in the system could affect it. Lastly, it will discuss the possibility of using an open loop control system and give some pros and cons of this method.

Crawford, Bradley L.↗

Challenges in Development of Online Visualization and Analysis Tools for Satellite Data

Over the years, various online visualization and analysis tools have been developed to facilitate satellite data access and help scientific users around the world to conduct research and develop applications (e.g., data product evaluation, what-if questions, etc.). For those who are new to satellite data products, using them can be a daunting task due to many obstacles in data processing such as data formats, complex data structures, special software packages, unfamiliar terminology, etc., especially when one is not sure whether a dataset is suitable for his/er research project. Even for experienced users, developing software for data processing and analysis can be a costly and time-consuming task. Online visualization tools can overcome many of these difficulties and allow users to focus on scientific questions. For example, Giovanni (the Geospatial Interactive Online Visualization and Analysis Infrastructure, https://giovanni.gsfc.nasa.gov), developed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), allows access over 1900 satellite and model variables in 82 measurement groups of 8 disciplines without downloading data and software. Main features include basic functions for data analysis and visualization, data provenance, output data in different formats (ASCII, NetCDF, GeoTIFF), and more. Over the years, ~1700 peer-reviewed publications in different disciplines have been benefited from Giovanni in research activities (e.g. initial investigation, what-if questions, product evaluation). Despite the success of online visualization and analysis tools, challenges and new opportunities still exist and more can be done with new requirements and technology. Examples are: a) how to increase the efficiency of dataset search by enhancing intuitive aspects; b) how to facilitate interdisciplinary research; c) how to provide data quality information; d) how to engage users to participate in data quality assessment; and more. NASA Earth Observing System Data and Information System (EOSDIS) satellite-based data products are processed at various levels ranging from Level 0 to Level 4. While most users use data products at higher levels (Level-3 and 4), products at lower levels are still important for case studies, algorithm development, ground validation, etc. In this presentation, we will use Giovanni as an example to present and discuss challenges and near-future opportunities for satellite data online visualization and analysis tools.

Liu, Zhong↗

Examples L-Band Interference will be Presented and Discussed, as well as the Importance of L-Band Soil Moisture Observations

Examples of L-band interference will be presented and discussed, as well as the importance of L-band soil moisture observations, as part of this one-day GEOSS workshop XXXVII on "Data Quality and Radio Spectrum Allocation Impact on Earth Observations" will address the broad challenges of data quality and the impact of generating reliable information for decision makers who are Earth data users but not necessarily experts in the Earth observation field. GEO has initiated a data quality assessment task (DA-09-01a) and workshop users will review and debate the directions and challenges of this effort. Radio spectrum allocation is an element of data availability and data quality, and is also associated with a GEO task (AR-06-11). A recent U.S. National Research Council report on spectrum management will be addressed as part of the workshop. Key representatives from industry, academia, and government will provide invited talks on these and related issues that impact GEOSS implementation.

Kim, Edward↗

Study on spectral/radiometric characteristics of the Thematic Mapper for land use applications

Progress under the LANDSAT-4 and 5 Image Data Quality Assessment program for the Thematic Mapper is described. An initial screening of LANDSAT-5 data is performed. Tools are developed to allow access to TIPS-format data. Analysis of scan direction related signal droop is resumed with detailed analysis of nighttime data. A new mathematical model is developed to describe the effect. Coherent noise of a lower frequency than previously reported is discovered and analyzed. Coincident LANDSAT-4 TM and MSS data are analyzed to improve understanding of radiometric relationships between similar wavebands in the two sensors.

Malila, W. A.↗

Study of spectral/radiometric characteristics of the Thematic Mapper for land use applications

Progress during ERIM's tenth quarter of effort under the LANDSAT-4 and 5 Image Data Quality Assessment program for the Thematic Mapper is described. Coincident LANDSAT-4 and 5 fully corrected (CCT-PT) TM data are analyzed in more detail and revised band-by-band relationships between the two sensors derived. An analysis technique employing the matching of cumulative distributions is developed and used and is believed to offer advantages over the histogram matching procedure currently used to produce LANDSAT data. Multiplicative factors ranging from 0.987 to 1.145 and offsets ranging from -2.7 to -6.2 video quantum levels are required to cause LANDSAT-5 data to match LANDSAT-4 data values. Evidence of low level clipping is found in TM Bands 5 and 7 of LANDSAT-5 but not LANDSAT-4. Analysis of the information content of LANDSAT TM and MSS data is continued. Components of information loss are identified and quantified and the effects of coarsened quantization are explored.

Malila, W. A.↗

Study of spectral/radiometric characteristics of the Thematic Mapper for land use applications

Progress during the Environmental Research Institute of Michigan-ERIM's and 5 image data quality assessment program for the thematic mapper is described. Analyses of LANDSAT 5 TM radiometric characteristics were performed. Effects which had earlier been found in LANDSAT 4 TM data were found to be present in LANDSAT 5 data as well, including: (1) scan direction related signal droop; (2) scan correlated level shifts; and (3) low frequency coherent noise. Coincident LANDSAT 4 and 5 raw TM data were analyzed, and band by band relationships between the two sensors were derived. Earlier efforts which developed an information theoretic measure of multispectral information content were continued, comparing TM and MSS information content.

Malila, W. A.↗