Data Quality Assessment Using SERI-QC
This presentation provides an overview of data quality assessment using SERI QC.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation provides an overview of data quality assessment using SERI QC.
This document describes the data quality objectives to select archived samples located at the 222-S Laboratory for Fluid Bed Steam Reformer testing. The type, quantity and quality of the data required to select the samples for Fluid Bed Steam Reformer testing are discussed. In order to maximize the efficiency and minimize the time to treat Hanford tank waste in the Waste Treatment and Immobilization Plant, additional treatment processes may be required. One of the potential treatment processes is the fluid bed steam reformer (FBSR). A determination of the adequacy of the FBSR process to treat Hanford tank waste is required. The initial step in determining the adequacy of the FBSR process is to select archived waste samples from the 222-S Laboratory that will be used to test the FBSR process. Analyses of the selected samples will be required to confirm the samples meet the testing criteria.
This poster provides an overview of data quality assessment using SERI QC.
This chapter provides a comprehensive overview of the main steps for algorithmic sensor signal quality assessment, which can enhance the decision-making process for water resource recovery facility (WRRF) operation and optimization. It introduces the concept of redundancy as the basis for data quality assessment. It also explains the typical data processing pipeline, which consists of preliminary analysis, data pre-processing, and specific algorithmic approaches. Each of these processes is presented and discussed in three separate sections. Importantly, this chapter introduces the main approaches for data quality assessment, provides guidelines for selecting the most suitable one and the key performance indicators to evaluate them and explains how to collect metadata through such an algorithmic approach.
The Compact Muon Solenoid (CMS) experiment is a general-purpose detector for high-energy collision at the Large Hadron Collider (LHC) at CERN. It employs an online data quality monitoring (DQM) system to promptly spot and diagnose particle data acquisition problems to avoid data quality loss. In this study, we present a semi-supervised spatio-temporal anomaly detection (AD) monitoring system for the physics particle reading channels of the Hadron Calorimeter (HCAL) of the CMS using three-dimensional digi-occupancy map data of the DQM. We propose the GraphSTAD system, which employs convolutional and graph neural networks to learn local spatial characteristics induced by particles traversing the detector and the global behavior owing to shared backend circuit connections and housing boxes of the channels, respectively. Recurrent neural networks capture the temporal evolution of the extracted spatial features. We validate the accuracy of the proposed AD system in capturing diverse channel fault types using the LHC collision data sets. The GraphSTAD system achieves production-level accuracy and is being integrated into the CMS core production system for real-time monitoring of the HCAL. We provide a quantitative performance comparison with alternative benchmark models to demonstrate the promising leverage of the presented system.
This document describes the data quality objectives to select archived samples located at the 222-S Laboratory for Bench-Scale Reforming testing. The type, quantity, and quality of the data required to select the samples for Fluid Bed Steam Reformer testing are discussed. In order to maximize the efficiency and minimize the time to treat Hanford tank waste in the Waste Treatment and Immobilization Plant, additional treatment processes may be required. One of the potential treatment processes is the fluidized bed steam reformer. A determination of the adequacy of the fluidized bed steam reformer process to treat Hanford tank waste is required. The initial step in determining the adequacy of the fluidized bed steam reformer process is to select archived waste samples from the 222-S Laboratory that will be used in a bench scale tests. Analyses of the selected samples will be required to confirm the samples meet the shipping requirements and for comparison to the bench scale reformer (BSR) test sample selection requirements.
Technical key performance indicators (KPIs) are important metrics used to assess and quantitatively summarize various aspects of photovoltaic (PV) systems, including long-term performance, economic viability, and carbon footprint. Herein, a group of experts of the International Energy Agency's Photovoltaic Power Systems Programme Task 13 collect and describ the most important technical KPIs used in the industry. Thereby, a set of best practices for reliably handling PV system data is presented and the impact of data quality and climatic variability on KPI calculation is investigated. Further, the effective use of technical KPIs allows triggering data-driven and informed decisions to optimize PV systems and providing a comprehensive overview of how PV systems operate across different conditions and climates. With the worldwide growth of the PV industry, more companies operate/own PV systems in different regions, where the climatic and seasonal profiles differ. This requires context-aware evaluation of KPIs, or the judicious application of multiple KPIs, to ensure that each asset is evaluated correctly. Beyond that, there is untapped potential in the utilization of KPIs through geospatial mapping and extrapolation of fleet KPIs. This study demonstrates that the uncertainty in KPI estimation is not well understood and depends on data quality, climatic variability, and system configuration.
Using a semi-supervised machine learning approach we present a real-time anomaly detection system based on an autoencoder used for online data quality monitoring of the CMS electromagnetic calorimeter operating at the CERN LHC. We introduce a novel method that maximizes the anomaly detection performance making use of the time-dependence of anomalies and the spatial variations in the detector response. The autoencoder-based system efficiently detects anomalies in real time and maintains a very low false discovery rate. We validate the performance of this novel system with anomalies from LHC collision data taken in 2018 and 2022. In addition, results are presented after deploying the autoencoder-based system in the CMS online Data Quality Monitoring workflow at the beginning of LHC Run 3 resulting in the system to detect issues that were missed by the existing system.
This report summarizes the results of the data quality assessment that was performed on the analytical data generated in connection with the 2008/2009 surface water, sediment, and soil data collection; groundwater upwelling investigation sample collection; and fish tissue sample collection.
This report summarizes the results of the data quality assessment that was performed on the analytical data generated in connection with the 2008/2009 surface water, sediment, and soil data collection; groundwater upwelling investigation sample collection; and fish tissue sample collection.
SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no-go decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects.
This presentation presents a brief overview of the collection of information about the US government's fleet of motor vehicles using the Federal Automotive Statistical Tool (FAST), discusses the makeup and operation of the vehicle fleet during FY 2022 and discusses quality of the submitted data. FAST is a web-based information system sponsored by GSA's Office of Government-wide Policy and DOE's Federal Energy Management Program to collect information about the US federal government's fleet of motor vehicles; FAST is developed, maintained, and supported by DOE's Idaho National Laboratory (INL).
This presentation presents a brief overview of the collection of information about the US government's fleet of motor vehicles using the Federal Automotive Statistical Tool (FAST), discusses the makeup and operation of the vehicle fleet during FY 2021, discusses quality of the submitted data, and touches on future aspects of fleet data collection and reporting. FAST is a web-based information system sponsored by GSA's Office of Government-wide Policy and DOE's Federal Energy Management Program to collect information about the US federal government's fleet of motor vehicles; FAST is developed, maintained, and supported by DOE's Idaho National Laboratory (INL).
Since the mid 1980s, the Idaho National Laboratory (INL) has been involved with numerous projects to collect operational reactor data, develop data tools, and trend and analyze that data for the U.S. Nuclear Regulatory Commission (NRC). Because the data are used in subsequent risk analyses, the NRC must have confidence in the quality of the data delivered. The NRC tasked the INL to establish a comprehensive data quality assurance program. A key element of that effort was to establish a set of requirements based on industry and government standards, guidance and good practices. This paper discusses where these were found, the process of extracting the requirements and recommendations from the source materials, and the consolidation of them into a concise set of 22 standards, guidance and practices for technical data quality. While this set was created specifically for the data programs within the NRC’s Office of Research, they have broad application to many high-technology industries.
SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects. All of the data needs to evaluate a site are somewhat interconnected. We used criterion (2) above to determine if the data collection design would have to be modified to meet the need; if this was commonly true a linkage was shown. The application of this cross index to sites in the subsequent tasks will demonstrate that the demand for data types varies site-to-site and project-to-project. Examples of factors to be considered are the complexity of the geology, the injection goals such as rate and duration of the injection, and the types of risk and risk tolerance of key stakeholders. In future tasks the team will compare the demand for data with existing data availability. This will, in turn, determine when data needs to be acquired to support project development. For example, in a project area with complex structure, 3-D seismic data may be needed earlier and more urgently than in an area with simple rock body geometries. In some locations, a 3-D seismic survey has already been collected and can be purchased. In other locations the project developer will need to collect these data. For another example, a project near an urban area or near to a park may generate earlier and more substantive public concern than a site that is developed in mined lands. A calculation using the derivative from table 1 will show the different investment needs. Project cost will vary corresponding to data criticality and data availability.
This data note describes 15-min discharge and in situ water quality data at two locations along East Fork Poplar Creek in east Tennessee, USA. Data records include temperature, gauge height, water surface elevation above mean sea level, and volumetric discharge. Water quality measurements include temperature, specific conductance, pH, dissolved oxygen (percent saturation and concentration), turbidity, and less extensive fDOM data at one site. The data records begin in 2012 at one site and 2015 at the second site; monitoring at both sites is ongoing (as of 2021). The goal of this data collection is to improve understanding of watershed functions, hydrologic dynamics, and material flux. The data will contribute to site conceptual and numerical models, exposure and risk evaluation, remediation selection and design, and performance monitoring. The data are publicly available and can be accessed via unique url or DOI.
Southeast Offshore Storage Resource Assessment (SOSRA): Data Quality and Coverage Evaluation (Deliverable 4.2.a)
Summary The paper is devoted to the development of a statistical framework for air quality assessment at the country level and for the evaluation of the ambient population exposure and risk with respect to airborne pollutants. The framework is based on a multivariate space–time model and on aggregated indices defined at different levels of aggregation in space and time. The indices are evaluated, uncertainty included, by considering both the model outputs and the information on the population spatial distribution. The framework is applied to the analysis of air quality data for Scotland for 2009 referring to European and Scottish air quality legislation.