Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

Exploring the effects of data quality, data worth, and redundancy of CO2 gas pressure and saturation data on reservoir characterization through PEST Inversion

This study examined the impacts of reservoir properties on CO2 migration after subsurface injection and evaluated the possibility of characterizing reservoir properties using CO2 monitoring data such as saturation distribution. The injection reservoir was assumed to be located 1400-1500 m below the ground surface such that CO2 remained in the supercritical state. The reservoir was assumed to contain layers with alternating conductive and resistive properties, which is analogous to actual geological formations such as the Mount Simon Sandstone unit. The CO2 injection simulation used a cylindrical grid setting in which the injection well was situated at the center of the domain, which extended up to 8000 m from the injection well. The CO2 migration was simulated using the PNNL-developed simulator STOMP-CO2e (the water-salt-CO2 module). We adopted a nonlinear parameter estimation and optimization modeling software package, PEST, for automated reservoir parameter estimation. We explored the effects of data quality, data worth, and data redundancy on the detectability of reservoir parameters using CO2 saturation monitoring data, by comparing PEST inversion results using data with different levels of noises, various numbers of monitoring wells and locations, and different data collection spacing and temporal sampling intervals. This study yielded insight into the use of CO2 saturation monitoring data for reservoir characterization and how to design the monitoring system to optimize data worth and reduce data redundancy.

Carbon sequestration↗
NASA NTRS2020

MODIS and VIIRS Calibration and Characterization in Support of Producing Long-Term High-Quality Data Products

Terra and Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) have successfully operated since their launches in 1999 and 2002, respectively, and generated various data products to support the Earth remote sensing disciplines and users worldwide for their research activities and applications, including studies of the Earth system, and its changes over time and geographic regions. The MODIS data have also significantly contributed to the continuity of multi-decadal satellite data records and led to major advances in the Earth remote sensing field. The long-term data records from MODIS observations have been and will continue to be extended by the Visible Infrared Imaging Radiometer Suite (VIIRS) instruments, currently operated aboard the Suomi-National Polar-Orbiting Partnership (NPP) and NOAA-20 satellites. The data quality of satellite instruments strongly depends on their calibration accuracy and stability. In order to help scientists and users gain a better understanding of MODIS and VIIRS data quality, this paper provides an overview of their on-orbit calibration methodologies, approaches, and results derived from instrument on-board calibrators and lunar observations, as well as select Earth view targets. What is also discussed is the calibration consistency between MODIS and VIIRS and its potential impact on producing multi-sensor long-term data records. As illustrated, the overall performance of both MODIS and VIIRS continues to meet their design requirements.

MODIS↗
DOE OSTI2022

Using Synchrophasor Status Word as Data Quality Indicator: What to Expect in the Field?

Data quality plays a crucial role in successful applications of synchrophasor data in power system operation and control. This paper presents the results of a data quality analysis of a multi-year field-recorded synchrophasor dataset. The analysis has identified several typical data quality issues encountered in the field data. An examination of the PMU status words included with the dataset has revealed several inconsistent implementations and the lack of correlation between the PMU data quality and the status word, which impacts the usefulness of such information. Our investigation has concluded that the status word alone as found in the recorded field dataset could not be used as a reliable indicator of data quality for field-recorded data. Several recommendations are proposed to improve the usefulness of the PMU status word.

Cheng, Zheyuan↗
DOE OSTI2017

Hunting Data Rogues at Scale: Data Quality Control for Observational Data in Research Infrastructures

Data quality control is one of the most time consuming activities within Research Infrastructures (RIs), especially when involving observational data and multiple data providers. In this work we report on our ongoing development of data rogues, a scalable approach to manage data quality issues for observational data within RIs. The motivation for this work started with the creation of the FLUXNET2015 dataset, which includes carbon, water, and energy fluxes plus micrometeorological and ancillary data measured in over 200 sites around the world. To create an uniform dataset, including derived data products, extensive work on data quality control was needed. The unpredictable nature of observational data quality issues makes the automation of data quality control inherently difficult. Developed based on this experience, the data rogues methodology allows for increased automation of quality control activities by systematically identifying, cataloging, and documenting implementations of solutions to data issues. We believe this methodology can be extended and applied to others domains and types of data, making the automation of data quality control a more tractable problem.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
NASA NTRS1981

Data Quality: 1979 Southeastern Virginia Urban Plume Study (SEV-UPS): Surface and Airborne studies

The SEV-UPS field study conducted during August 1979 involved the coordinated air quality data collection efforts of three different organizations operating a total of four aircraft and 12 ground stations. Incorporated into plans for that program were numerous quality assurance activities designed to identify potential hazards for data quality in time for their correction and to take data to allow assessment of the consistency of the data from different stations. The purpose of this study was to document QA procedures that were performed by participating agencies and revise data from all platforms for mutual compatibility. For the latter effort, cases were identified on 21 occasions on seven different days where two or more monitoring systems were operating in the same location at nearly the same time. Data from the systems involved were tabulated in 200 m altitude segments, averaged and compared to detect any bias between measurements made from different systems. The results of these comparisons along with the results of independent performance audits are presented.

White, J. H.↗
DOE OSTI2020

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

FedFleet 2024: Fleet Data Quality - Understanding and Improving Your Agency's FAST Fleet Data Quality Metric? [Slides]

This presentation presents an overview of how the team supporting the Federal Automotive Statistical Tool (FAST) project for DOE and GSA view and assess the quality of fleet data submissions from federal agencies. It also discusses ways in which agencies can improve the quality of their fleet data and of their fleet data submissions. FAST is a web-based information system sponsored by GSA's Office of Government-wide Policy and DOE's Federal Energy Management Program to collect information about the US federal government's fleet of motor vehicles; FAST is developed, maintained, and supported by DOE's Idaho National Laboratory (INL).

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS2013

A Signal Detection Theory Approach to Evaluating Oculometer Data Quality

Currently, data quality is described in terms of spatial and temporal accuracy and precision [Holmqvist et al. in press]. While this approach provides precise errors in pixels, or visual angle, often experiments are more concerned with whether subjects'points of gaze can be said to be reliable with respect to experimentally-relevant areas of interest. This paper proposes a method to characterize oculometer data quality using Signal Detection Theory (SDT) [Marcum 1947]. SDT classification results in four cases: Hit (correct report of a signal), Miss (failure to report a ), False Alarm (a signal falsely reported), Correct Reject (absence of a signal correctly reported). A technique is proposed where subjects' are directed to look at points in and outside of an AOI, and the resulting Points of Gaze (POG) are classified as Hits (points known to be internal to an AOI are classified as such), Misses (AOI points are not indicated as such), False Alarms (points external to AOIs are indicated as in the AOI), or Correct Rejects (points external to the AOI are indicated as such). SDT metrics describe performance in terms of discriminability, sensitivity, and specificity. This paper presentation will provide the procedure for conducting this assessment and an example of data collected for AOIs in a simulated flightdeck environment.

Latorella, Kara↗
DOE OSTI2014

Monitoring and data quality assessment of the ATLAS liquid argon calorimeter

The liquid argon calorimeter is a key component of the ATLAS detector installed at the CERN Large Hadron Collider. The primary purpose of this calorimeter is the measurement of electron and photon kinematic properties. It also provides a crucial input for measuring jets and missing transverse momentum. An advanced data monitoring procedure was designed to quickly identify issues that would affect detector performance and ensure that only the best quality data are used for physics analysis. This article presents the validation procedure developed during the 2011 and 2012 LHC data-taking periods, in which more than 98% of the proton-proton luminosity recorded by ATLAS at a centre-of-mass energy of 7-8 TeV had calorimeter data quality suitable for physics analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Data quality assurance for the Majorana Demonstrator

The Majorana Demonstrator is an experiment constructed to search for neutrinoless double-beta decays in germanium-76 and to demonstrate the feasibility to deploy a large-scale experiment in a phased and modular fashion. It consists of two modular arrays of natural and 7648 Ge-enriched germanium detectors totalling 44.1 kg, located at the 4850' level of the Sanford Underground Research Facility in Lead, South Dakota, USA. Any Neutrinoless double-beta decay search requires a thorough understanding of the background and the signal energy spectra. This talk will discuss the various techniques employed to ensure the integrity of the measured spectra. Data collection is monitored with a thorough set of checks, and subsequent careful analysis is performed to qualify the data for higher level physics analysis. Instrumental background events are tagged for removal, and problematic channels are removed from consideration as necessary.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Perspectives on Citizen Science Data Quality

Information about data quality helps potential data users to determine whether and how data can be used and enables the analysis and interpretation of such data. Providing data quality information improves opportunities for data reuse by increasing the trustworthiness of the data. Recognizing the need for improving the quality of citizen science data, we describe quality assessment and quality control (QA/QC) issues for these data and offer perspectives on aspects of improving or ensuring citizen science data quality and for conducting research on related issues.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Scanning ARM Cloud Radars. Part II: Data Quality Control and Processing

The Scanning ARM Cloud Radars (SACR’s) are the primary instruments for documenting the four-dimensional structure and evolution of clouds within a 20-30 km radius from the ARM fixed and mobile sites. Here, the post-processing of the calibrated SACR measurements is discussed. First, a feature mask algorithm that objectively determines the presence of significant radar returns is described. The feature mask algorithm is based on the statistical properties of radar receiver noise. It accounts for atmospheric emission and is applicable even for SACR profiles with few or no signal-free range gates. Using the nearest-in-time atmospheric sounding, the SACR radar reflectivities are corrected for gaseous attenuation (water vapor and oxygen) using a line-by-line absorption model. Despite having a high pulse repetition frequency, the SACR has a narrow Nyquist velocity limit and thus Doppler velocity folding is commonly observed. An unfolding algorithm that makes use of a first guess for the true Doppler velocity using horizontal wind measurements from the nearest sounding is described. The retrieval of the horizontal wind profile from the HS-RHI SACR scan observations and/or nearest sounding is described. The retrieved horizontal wind profile can be used to adaptively configure SACR scan strategies that depend on wind direction. Several remaining challenges are discussed, including the removal of insect and second-trip echoes. The described algorithms significantly enhance SACR data quality and constitute an important step towards the utilization of SACR measurements for cloud research.

climate↗
DOE OSTI2021

Quality Data Essential for Modeling Water Cycles Effectively

The experimental and observational data is the backbone of effective modeling of all aspects of water cycles. As the computer technology used for these data gathering efforts has improved dramatically in the recent decades, the environmental conditions these instruments are subjected to remain pretty much the same. These measuring instruments are exposed to the sun light, wind, rain, snow and ice; and they are immersed in dirt, water and mud. All of these are damaging to the electronics components used for data gathering, storage, and transmission, which creates many different kinds of data quality issues that affect the quality and reliability of modeling and prediction efforts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

SDSS-IV MaNGA IFS GALAXY SURVEY—SURVEY DESIGN, EXECUTION, AND INITIAL DATA QUALITY

The MaNGA Survey (Mapping Nearby Galaxies at Apache Point Observatory) is one of three core programs in the Sloan Digital Sky Survey IV. It is obtaining integral field spectroscopy for 10,000 nearby galaxies at a spectral resolution of R ∼ 2000 from 3622 to 10354 Å. The design of the survey is driven by a set of science requirements on the precision of estimates of the following properties: star formation rate surface density, gas metallicity, stellar population age, metallicity, and abundance ratio, and their gradients; stellar and gas kinematics; and enclosed gravitational mass as a function of radius. We describe how these science requirements set the depth of the observations and dictate sample selection. The majority of targeted galaxies are selected to ensure uniform spatial coverage in units of effective radius (R{sub e}) while maximizing spatial resolution. About two-thirds of the sample is covered out to 1.5 R{sub e} (Primary sample), and one-third of the sample is covered to 2.5 R{sub e} (Secondary sample). We describe the survey execution with details that would be useful in the design of similar future surveys. We also present statistics on the achieved data quality, specifically the point-spread function, sampling uniformity, spectral resolution, sky subtraction, and flux calibration. For our Primary sample, the median r -band signal-to-noise ratio is ∼70 per 1.4 Å pixel for spectra stacked between 1 R{sub e} and 1.5 R{sub e}. Measurements of various galaxy properties from the first-year data show that we are meeting or exceeding the defined requirements for the majority of our science goals.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Evolution of the Data Quality Monitoring and Prompt Processing System in the proto DUNE-SP experiment

The DUNE Collaboration currently operates an experimental program based at CERN which includes a beam test and an extended cosmic ray run of two large-scale prototypes of the massive Liquid Argon Time Projection Chamber (LArTPC) for the DUNE Far Detector. The volume of data collected by the single-phase prototype (protoDUNE-SP) amounts to 3PB and the sustained rate of data sent to mass storage is O(100) MB/s. Data Quality Monitoring was implemented by directing a fraction of the data stream to the protoDUNE prompt processing system (p3s) which is optimized for continuous low-latency calculation of the vital detector metrics and various graphics including event displays. It served a crucial role throughout the life cycle of the experiment. We present our experience in leveraging the CERN computing environment and operating the system over an extended period of time, while adapting to evolving requirements and computing platform.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1978

Process air quality data

Air quality sampling was conducted. Data for air quality parameters, recorded on written forms, punched cards or magnetic tape, are available for 1972 through 1975. Computer software was developed to (1) calculate several daily statistical measures of location, (2) plot time histories of data or the calculated daily statistics, (3) calculate simple correlation coefficients, and (4) plot scatter diagrams. Computer software was developed for processing air quality data to include time series analysis and goodness of fit tests. Computer software was developed to (1) calculate a larger number of daily statistical measures of location, and a number of daily monthly and yearly measures of location, dispersion, skewness and kurtosis, (2) decompose the extended time series model and (3) perform some goodness of fit tests. The computer program is described, documented and illustrated by examples. Recommendations are made for continuation of the development of research on processing air quality data.

Butler, C. M.↗
NASA NTRSDate not supplied

Data Quality Challenges for Analysis Ready Data (ARD)

Data quality plays a critical role in research and applications. The Earth Science Information Partners (ESIP) Information Quality Cluster (IQC) defines four aspects of information quality: Science, Product, Stewardship, and Services. The ESIP IQC has become internationally recognized as an authoritative and responsive resource of information and guidance to data producers and distributors on how to implement data quality standards and best practices for their science data systems, datasets, and data/metadata dissemination services. In recent years, cloud computing environments have provided scale-up capabilities such as data archives and services, enabling interdisciplinary science and applications. More value-added products are expected from data service providers, including Analysis Ready Data (ARD). ARD refers to data that has been preprocessed into a form that allows immediate analysis by the end user, processed to a minimum set of requirements and provides interoperability over time and across multiple datasets. Once a dataset has been developed from its original form to produce ARD, what quality characteristics should the derived dataset or ARD possess? Also, is it safe to assume that the quality of the ARD is consistent with the quality of the source data, or are there special attributes to an ARD that would warrant a secondary, independent quality assessment? What provenance (also called “data lineage”) information needs to be included in ARD? It is important to answer these questions, especially given the ease of use of ARD, and the consequent temptation by users to trust ARD without understanding the limitations or possible variations in quality compared to the source data. In this presentation, we will discuss data quality challenges for ARD products and services and introduce IQC for participation.

data quality↗