Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

Landsat-4 MSS and Thematic Mapper data quality and information content analysis

Landsat-4 Thematic Mapper and Multispectral Scanner data were analyzed to obtain information on data quality and information content. Geometric evaluations were performed to test band-to-band registration accuracy. Thematic Mapper overall system resolution was evaluated using scene objects which demonstrated sharp high contrast edge responses. Radiometric evaluation included detector relative calibration, effects of resampling, and coherent noise effects. Information content evaluation was carried out using clustering, principal components, transformed divergence separability measure, and numerous supervised classifiers on data from Iowa and Illinois. A detailed spectral class analysis (multispectral classification) was carried out on data from the Des Moines, IA area to compare the information content of the MSS and TM for a large number of scene classes.

Anuta, P. E.↗
DOE OSTI2020

Southeast Regional CO 2 Utilization and Storage Acceleration Partnership (SECARB-USA): Data Quality Methodology (4.2.1)

SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects. All of the data needs to evaluate a site are somewhat interconnected. We used criterion (2) above to determine if the data collection design would have to be modified to meet the need; if this was commonly true a linkage was shown. The application of this cross index to sites in the subsequent tasks will demonstrate that the demand for data types varies site-to-site and project-to-project. Examples of factors to be considered are the complexity of the geology, the injection goals such as rate and duration of the injection, and the types of risk and risk tolerance of key stakeholders. In future tasks the team will compare the demand for data with existing data availability. This will, in turn, determine when data needs to be acquired to support project development. For example, in a project area with complex structure, 3-D seismic data may be needed earlier and more urgently than in an area with simple rock body geometries. In some locations, a 3-D seismic survey has already been collected and can be purchased. In other locations the project developer will need to collect these data. For another example, a project near an urban area or near to a park may generate earlier and more substantive public concern than a site that is developed in mined lands. A calculation using the derivative from table 1 will show the different investment needs. Project cost will vary corresponding to data criticality and data availability.

42 ENGINEERING↗
DOE OSTI2021

Stream discharge and water quality data for East Fork Poplar Creek beginning 2012

This data note describes 15-min discharge and in situ water quality data at two locations along East Fork Poplar Creek in east Tennessee, USA. Data records include temperature, gauge height, water surface elevation above mean sea level, and volumetric discharge. Water quality measurements include temperature, specific conductance, pH, dissolved oxygen (percent saturation and concentration), turbidity, and less extensive fDOM data at one site. The data records begin in 2012 at one site and 2015 at the second site; monitoring at both sites is ongoing (as of 2021). The goal of this data collection is to improve understanding of watershed functions, hydrologic dynamics, and material flux. The data will contribute to site conceptual and numerical models, exposure and risk evaluation, remediation selection and design, and performance monitoring. The data are publicly available and can be accessed via unique url or DOI.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1974

Statistical summary of air quality data for metropolitian Cleveland, Ohio, 1967 - 1972: Total suspended particulates, nitrogen dioxide, and sulfur dioxide

Air-quality data for metropolitan Cleveland, Ohio, from 1967 through 1972 were collated and statistically analyzed. Total suspended particulates (TSP) departed from lognormal distribution in 1972. Nitrogen dioxide and sulfur dioxide, departed significantly from lognormal distributions in 1972. In Cleveland the Ohio standards were not met. However, the data indicate a general improvement in air quality. Unusually high precipitation (43% above the average in 1972) may be responsible in lowering these values from the 1971 levels. The mean values of TSP, NO2, and SO2 are 104, 191, and 83 microgram/cu m respectively.

King, R. B.↗
DOE OSTI2024

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Hydra: Computer Vision for Online Data Quality Monitoring

Hydra is a system utilizing computer vision for near real-time data quality monitoring. Currently operational across all of Jefferson Lab’s experimental halls, it reduces the workload of shift takers by autonomously monitoring diagnostic plots during experiments. Hydra uses "off-the-shelf" supervised learning technologies and is supported by a comprehensive MySQL database. To simplify access, web apps have been developed to facilitate both labeling and monitoring of Hydra’s inferences. Hydra can connect with the alarm system and incorporates complete historical tracking, enabling it to identify issues that shift takers could miss. When issues are detected, a natural first question is: "Why does Hydra think there is a problem?" To answer, Hydra employs Gradient-weighted Class Activation Maps (GradCAM) to identify regions of the image that are important for the specific classification. This interpretive layer enhances transparency and trustworthiness, which is essential for integration with experiment workflows and operation. The Hydra system, results, and sociological considerations for deployment will be discussed.

Jeske, Torri↗
NASA NTRS2011

Use and Limitations of a Climate-Quality Data Record to Study Temperature Trends on the Greenland Ice Sheet

Enhanced melting of the Greenland Ice Sheet has been documented in recent literature along with surface-temperature increases measured using infrared satellite data since 1981. Using a recently-developed climate-quality data record, 11- and 12-year trends in the clear-sky ice-surface temperature (IST) of the Greenland Ice Sheet have been studied using the Moderate-Resolution Imaging Spectroradiometer (MODIS) IST product. Daily and monthly MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 are now available at 6.25-km spatial resolution on a polar stereographic grid as described in Hall et al. (submitted). This record will be elevated in status to a climate-data record (CDR) when more years of data become available either from the MODIS on the Terra or Aqua satellites, or from the Visible Infrared Imager Radiometer Suite (VIIRS) to be launched in October 2011. Maps showing the maximum extent of melt for the entire ice sheet and for the six major drainage basins have been developed from the MODIS IST dataset. Twelve-year trends of the duration of the melt season on the ice sheet vary in different drainage basins with some basins melting progressively earlier over the course of the study period. Some (but not all) of the basins also show a progressively-longer duration of melt. IST 12-year trends are compared with in-situ data, and climate data from the Modern Era Retrospective-Analysis for Research and Applications (MERRA) Reanalysis.

Hall, Dorothy K.↗
DOE OSTI2023

RE Data Explorer is Expanding Public Access to High-Quality Data and Analytics

The Renewable Energy (RE) Data Explorer is an innovative and intuitive web platform from the U.S. Agency for International Development (USAID)-National Renewable Energy Laboratory (NREL) Partnership that enables users to easily access high-quality renewable energy resource data and applied analytics.

ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1972

Statistical summary and trend evaluation of air quality data for Cleveland, Ohio in 1967 to 1971: Total suspended particulate, nitrogen dioxide, and sulfur dioxide

Air quality data for Cleveland, Ohio, for the period of 1967 to 1971 were collated and subjected to statistical analysis. The total suspended particulate component is lognormally distributed; while sulfur dioxide and nitrogen dioxide are reasonably approximated by lognormal distributions. Only sulfur dioxide, in some residential neighborhoods, meets Ohio air quality standards. Air quality has definitely improved in the industrial valley, while in the rest of the city, only sulfur dioxide has shown consistent improvement. A pollution index is introduced which displays directly the degree to which the environmental air conforms to mandated standards.

Neustadter, H. E.↗
DOE OSTI2025

Online and Offline Data Quality Monitoring for the Mu2e Calorimeter

This thesis presents the design, implementation, and validation of a calorimeter Data Quality Monitoring (DQM) toolchain for the Mu2e experiment at Fermilab. Mu2e searches for charged lepton flavor violation via coherent muon-to-electron conversion in the field of an aluminum nucleus, $\mu^- Al \rightarrow e^-Al$, a process whose observation would constitute clear evidence of physics beyond the Standard Model. Achieving target sensitivity requires stringent control of detector performance and data integrity during acquisition, as subtle issues in readout configuration, data formatting, or electronics behavior can compromise reconstruction and bias downstream analyzes. To address these challenges, this work develops a multi-layer DQM approach spanning both raw data validation and reconstructed digi-level diagnostics. At the low level, a fragment analysis component performs word- and bit-field decoding of calorimeter readout blocks, enabling sanity checks of the expected structure and producing detailed error and integrity statistics useful for commissioning and troubleshooting. At the digi level, the CaloDigiDQM analyzer is implemented within the art framework and transforms each CaloDigiCollection into a structured hierarchy of ROOT histograms designed for fast drill-down diagnostics. The module generates coherent monitoring views at global, disk, board, and channel granularity, including occupancy, waveform-derived features (baseline, RMS, peak amplitude and position), and left-right sensor consistency metrics. Detector-aware channel-to-electronics mapping is performed through the conditions system (CaloDAQMap), ensuring that diagnostics remain aligned with hardware identifiers used in operations. For end-to-end testing without reliance on live DAQ data, a synthetic CaloDigi producer is developed to generate realistic waveforms with controlled noise and pulse shapes. The resulting system supports both offline ROOT-file production and online operation, including optional histogram streaming through otsdaq via ots::HistoSender. This toolchain provides a practical and scalable foundation for calorimeter commissioning and stable data collection, enabling early detection of anomalies and reducing operational risk for Mu2e.

Vakulenko, Mark [Drew U.] (ORCID:0009000276197818)↗
DOE OSTI2025

Hydra: An AI-Based Framework for Interpretable and Portable Data Quality Monitoring

Hydra is an advanced framework designed for training and managing AI models for near real time data quality monitoring at Jefferson Lab. Deployed in all four experimental halls, Hydra has analyzed over 2 million images and has extended its capabilities to offline monitoring and validation. Hydra utilizes computer vision to continually analyze sets of images of monitoring plots generated 24/7 during experiments. Generally, these sets of images are produced at a rate and quantity that is exceedingly difficult for shift crews to effectively monitor. Significant effort has been devoted to enhancing Hydra’s user interface, to ensure that it provides clear, actionable insights for shift workers and other users. Gradient Weighted Class Activation Maps (GradCAM) provide added interpretability, allowing users to visualize important regions of the image for classification. Hydra has been containerized to enable the creation of portable demos and seamless integration with container-based technologies such as Kubernetes and Docker. With the user interface enhancements and containerization, Hydra can be rapidly deployed for new use cases and experiments. This talk will describe the Hydra framework, its user interface and experience, and the challenges inherent in its design and deployment.

Britton, Thomas [Thomas Jefferson National Acceler↗
NASA NTRS2011

Effects of Active Sting Damping on Common Research Model Data Quality

Recent tests using the Common Research Model (CRM) at the Langley National Transonic Facility (NTF) and the Ames 11-foot Transonic Wind Tunnel (11' TWT) produced large sets of data that have been used to examine the effects of active damping on transonic tunnel aerodynamic data quality. In particular, large statistically significant sets of repeat data demonstrate that the active damping system had no apparent effect on drag, lift and pitching moment repeatability during warm testing conditions, while simultaneously enabling aerodynamic data to be obtained post stall. A small set of cryogenic (high Reynolds number) repeat data was obtained at the NTF and again showed a negligible effect on data repeatability. However, due to a degradation of control power in the active damping system cryogenically, the ability to obtain test data post-stall was not achieved during cryogenic testing. Additionally, comparisons of data repeatability between NTF and 11-ft TWT CRM data led to further (warm) testing at the NTF which demonstrated that for a modest increase in data sampling time, a 2-3 factor improvement in drag, and pitching moment repeatability was readily achieved not related with the active damping system.

Acheson, Michael J.↗
NASA NTRS2012

A Satellite-Derived Climate-Quality Data Record of the Clear-Sky Surface Temperature of the Greenland Ice Sheet

We have developed a climate-quality data record of the clear-sky surface temperature of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) ice-surface temperature (1ST) algorithm. A climate-data record (CDR) is a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. We present daily and monthly MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 at 6.25-km spatial resolution on a polar stereographic grid. This record will be elevated in status to a CDR when at least nine more years of data become available either from MODIS Terra or Aqua, or from the Visible Infrared Imager Radiometer Suite (VIIRS) to be launched in October 2011. Our ultimate goal is to develop a CDR that starts in 1981 with the Advanced Very High Resolution (AVHRR) Polar Pathfinder (APP) dataset and continues with MODIS data from 2000 to the present, and into the VIIRS era. Differences in the APP and MODIS cloud masks have so far precluded the current 1ST records from spanning both the APP and MODIS time series in a seamless manner though this will be revisited when the APP dataset has been reprocessed. The complete MODIS 1ST daily and monthly data record is available online.

Hall, Dorothy K.↗
DOE OSTI2022

AI Data Quality Monitoring with Hydra

Hydra is an extensible framework for training and managing AI for near real time monitoring that aims to replace the tedious and repetitive data quality monitoring activities the shift crew and online monitoring coordinator typically perform. It continuously scans incoming data in the form of monitoring plots for signs of problems, flagging them for human review. A web app was developed such that experts can efficiently label images for training. Labels are stored in a database for use in training and model validation. Backed up by a comprehensive database, it utilizes an additional web based front-end for viewing the current monitoring status from anywhere in the world. The system has been in production use for the GlueX experiment at Jefferson Lab for more than 2 years with new features still under active development.

Britton, Thomas↗
DOE OSTI2015

Data Quality Objectives Supporting the Environmental Direct Radiation Monitoring Program for the Idaho National Laboratory

This document presents the development of the data quality objectives (DQOs) for the Idaho National Laboratory (INL) Environmental Direct Radiation Monitoring Program and follows the Environmental Protection Agency (EPA) DQO process (EPA 2006). This document also develops and presents the logic to determine the specific number of direct radiation monitoring locations around INL facilities on the desert west of Idaho Falls and in Idaho Falls, at locations bordering the INL Site, and in the surrounding regional area. The selection logic follows the guidance from the Department of Energy (DOE) (2015) for environmental surveillance of DOE facilities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Hydra: computer vision for data quality monitoring

Hydra, initially developed for Hall-D in 2019, is a system that utilizes computer vision to perform near real time data quality monitoring. Since then, it has been deployed across all experimental halls at Jefferson Lab, with the CLAS12 collaboration in Hall-B being the first outside of GlueX to fully utilize Hydra. The system comprises back end processes that manage the models, their inferences, and the data flow. Finally, the front-end components, accessible via web pages, allow detector experts and shift crews to view and interact with the system.

47 OTHER INSTRUMENTATION↗