Jason 1 data quality assessment and dealising from high-frequency wind and pressure variability
Explore the source record for details and available documents.
altimetry TOPEX Jason-1 GRACE dealias↗
SEARCH · Search NASA
Results for “data quality assessment”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Pycheron: A Python-Based Seismic Waveform Data Quality Control Software Package
Supplementing an existing high-quality seismic monitoring network with openly available station data could improve coverage and decrease magnitudes of completeness; however, this can present challenges when varying levels of data quality exist. Without discerning the quality of openly available data, using it poses significant data management, analysis, and interpretation issues. Incorporating additional stations without properly identifying and mitigating data quality problems can degrade overall monitoring capability. If openly available stations are to be used routinely, a robust, automated data quality assessment for a wide range of quality control (QC) issues is essential. To meet this need, we developed Pycheron, a Python-based library for QC of seismic waveform data. Pycheron was initially based on the Incorporated Research Institutions for Seismology’s Modular Utility for STAtistical kNowledge Gathering but has been expanded to include more functionality. Pycheron can be implemented at the beginning of a data processing pipeline or can process stand-alone data sets. Its objectives are to (1) identify specific QC issues; (2) automatically assess data quality and instrumentation health; (3) serve as a basic service that all data processing builds on by alerting downstream processing algorithms to any quality degradation; and (4) improve our ability to process orders of magnitudes more data through performance optimizations. This article provides an overview of Pycheron, its features, basic workflow, and an example application using a synthetic QC data set.
58 GEOSCIENCES↗
Data Qualification Framework
Proposed Data Qualification System Background Originally developed as a data qualification system for the Bioenergy Feedstock Library Provide data users a means of assessing data quality based on user driven quality metrics. Give users information regarding common data quality metrics to determine and assess the data quality. Potential Use Same type of quality assessment framework could be potentially applied to other databases and/or datasets for common assessment. Provide metric for assessment of appropriateness of data for various uses.
09 BIOMASS FUELS↗
The use of thematic mapper simulator calibration data for assessment of data quality
In flight calibration data collected from the thematic mapper simulator (TMS) were used to assess the quality of Earth scan data. The following results are indicated: (1) based on limited samples, individual TMS channels have noise which varies from channel to channel, but remains constant within a channel; (2) short term variations of more than 5% in the average values of calibration source responses indicate problems; and (3) absolute radiometric calibration is unlikely to be meaningful in a temporal sense due to single point calibration methods used.
Forman, M. L.↗
Recommendations for Radiological Data Assessment Implementation
Since thorough verification, validation, and data quality assessment (DQA) processes may delay incident commanders and elected and appointed officials from making key decisions, the U.S. Department of Homeland Security (DHS) National Urban Security Technology Laboratory (NUSTL) tasked Pacific Northwest National Laboratory (PNNL) to develop tools and guidance for the federal, state, local, tribal, and territorial (FSLTT) responders using research, discussions with select FSLTT responders, and the experiences of subject matter experts in incident response. This report provides NUSTL with recommendations on best practices for verification, validation, and data quality assessment for the data collected by responders during a radiological or nuclear event. The purpose of this report is to inform the development of a DQA toolkit aimed at the needs of data assessors during the response to a radiological incident.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
A Robust Event Diagnostics Platform: Integrating Tensor Analytics and Machine Learning into Real-time Grid Monitoring
The objective of this project is to develop a robust event diagnostics (RED) platform by integrating state-of-the-art tensor analytics and machine learning into real-time grid monitoring. The proposed platform can effectively analyze and discover the information hiding within the provided PMU data for effective real-time grid monitoring. The proposed RED platform provides a set of robust diagnostics tools for grid operation and management, including 1) data quality assessment, 2) data completion, 3) event detection, and 4) robust event classification. All the functionalities of the RED platform can help the operator to make informed decisions and respond in a timely manner. The developed RED platform will serve as an innovative advisory tool to reliably identify key events and discover new insights about the events and grid characteristics in the PMU data, and contribute to the efficient, safe, reliable operation and design of the nation’s electric system.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Development of an Uncertainty Model for the National Transonic Facility
This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.
Walter, Joel A.↗
Practical procedures for sensor quality assessment
Sensors are increasingly deployed for process monitoring and control. These produce on-line measurements at a high frequency, in parallel with low-frequency laboratory measurements. Compared to laboratory practices, sensor data quality assessment and control practices are far less structured at most utilities. This leads to inaccurate sensor data with unknown uncertainty factors.This chapter shows how to establish standard operating procedures (SOPs) to support sensor data quality assessment and control and subsequent maintenance actions by producing relevant sensor metadata. Furthermore, SOPs are provided for the most commonly used wastewater quality sensors, inspired by utility and academic best practices. This chapter builds on definitions provided in Chapter 3 and provides additional definitions specifically related to sensors maintenance. Chapter 6 complements the methods in this chapter, which are based on reference measurements, with data-analytical techniques.
Alferes, Janelcy↗
On-the-fly data assessment for high-throughput x-ray diffraction measurements
Investment in brighter sources and larger and faster detectors has accelerated the speed of data acquisition at national user facilities. The accelerated data acquisition offers many opportunities for the discovery of new materials, but it also presents a daunting challenge. The rate of data acquisition far exceeds the current speed of data quality assessment, resulting in less than optimal data and data coverage, which in extreme cases forces recollection of data. Herein, we show how this challenge can be addressed through the development of an approach that makes routine data assessment automatic and instantaneous. By extracting and visualizing customized attributes in real time, data quality and coverage, as well as other scientifically relevant information contained in large data sets, is highlighted. Deployment of such an approach not only improves the quality of data but also helps optimize the usage of expensive characterization resources by prioritizing measurements of the highest scientific impact. We anticipate our approach will become a starting point for a sophisticated decision-tree that optimizes data quality and maximizes scientific content in real time through automation. Finally, with these efforts to integrate more automation in data collection and analysis, we can truly take advantage of the accelerating speed of data acquisition.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
A Testbed Demonstration of an Intelligent Archive in a Knowledge Building System
The last decade's influx of raw data and derived geophysical parameters from several Earth observing satellites to NASA data centers has created a data-rich environment for Earth science research and applications. While advances in hardware and information management have made it possible to archive petabytes of data and distribute terabytes of data daily to a broad community of users, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications in order to realize the full potential of these valuable datasets. In examining what is needed to enable this progress in the data provider environment that exists today and is expected to evolve in the next several years, we arrived at the concept of an Intelligent Archive in context of a Knowledge Building System (IA/KBS). Our prior work and associated papers investigated usage scenarios, required capabilities, system architecture, data volume issues, and supporting technologies. We identified six key capabilities of an IA/KBS: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting. Among these capabilities, large-scale data mining is perceived by many in the community to be an area of technical risk. One of the main reasons for this is that standard data mining research and algorithms operate on datasets that are several orders of magnitude smaller than the actual sizes of datasets maintained by realistic earth science data archives. Therefore, we defined a test-bed activity to implement a large-scale data mining algorithm in a pseudo-operational scale environment and to examine any issues involved. The application chosen for applying the data mining algorithm is wildfire prediction over the continental U.S. This paper reports a number of observations based on our experience with this test-bed. While proof-of-concept for data mining scalability and utility has been a major goal for the research reported here, it was not the only one. The other five capabilities of an WKBS named above have been considered as well, and an assessment of the implications of our experience for these other areas will also be presented. The lessons learned through the testbed effort and presented in this paper will benefit technologists, scientists, and system operators as they consider introducing IA/KBS capabilities into production systems.
Ramapriyan, Hampapuram↗
An Intelligent Archive Testbed Incorporating Data Mining
Many significant advances have occurred during the last two decades in remote sensing instrumentation, computation, storage, and communication technology. A series of Earth observing satellites have been launched by U.S. and international agencies and have been operating and collecting global data on a regular basis. These advances have created a data rich environment for scientific research and applications. NASA s Earth Observing System (EOS) Data and Information System (EOSDIS) has been operational since August 1994 with support for pre-EOS data. Currently, EOSDIS supports all the EOS missions including Terra (1999), Aqua (2002), ICESat (2002) and Aura (2004). EOSDIS has been effectively capturing, processing and archiving several terabytes of standard data products each day. It has also been distributing these data products at a rate of several terabytes per day to a diverse and globally distributed user community (Ramapriyan et al. 2009). There are other NASA-sponsored data system activities including measurement-based systems such as the Ocean Data Processing System and the Precipitation Processing system, and several projects under the Research, Education and Applications Solutions Network (REASoN), Making Earth Science Data Records for Use in Research Environments (MEaSUREs), and the Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) programs. Together, these activities provide a rich set of resources constituting a value chain for users to obtain data at various levels ranging from raw radiances to interdisciplinary model outputs. The result has been a significant leap in our understanding of the Earth systems that all humans depend on for their enjoyment, livelihood, and survival. The trend in the community today is towards many distributed sets of providers of data and services. Despite this, visions for the future include users being able to locate, fuse and utilize data with location transparency and high degree of interoperability, and being able to convert data to information and usable knowledge in an efficient, convenient manner, aided significantly by automation (Ramapriyan et al. 2004; NASA 2005). We can look upon the distributed provider environment with capabilities to convert data to information and to knowledge as an Intelligent Archive in the Context of a Knowledge Building system (IA-KBS). Some of the key capabilities of an IA-KBS are: Virtual Product Generation, Significant Event Detection, Automated Data Quality Assessment, Large-Scale Data Mining, Dynamic Feedback Loop, and Data Discovery and Efficient Requesting (Ramapriyan et al. 2004).
Ramapriyan, H.↗
Evaluation and Suitability of Using SERI QC Software for Estimating Measurement Uncertainty
SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report (the first of six in the Data Quality and Uncertainty Integration project) reviews and evaluates the software to determine its suitability for determining the estimated expanded measurement uncertainty of solar measurement data by including operational factors. Using redundancy incorporated in three-component (global, direct, diffuse) solar measurements, SERI QC can quantify the standard uncertainty estimates for estimating uncertainty. With minor modifications, SERI QC will provide an operational uncertainty to be used in conjunction with the National Renewable Energy Laboratory method for instrument uncertainty to provide an integrated estimate of solar measurement data sets. These modifications will capitalize on SERI QC's evaluation of data quality, including data input validation and a variety of built-in solar routines, and will further develop the utility of the software.
14 SOLAR ENERGY↗
Radiative Flux Analysis (RADFLUXANAL) Value-Added Product: Retrieval of Clear-Sky Broadband Radiative Fluxes and Other Derived Values
The Radiative Flux Analysis (RADFLUX) is a technique for using surface broadband radiation measurements for detecting periods of clear (i.e., cloudless) skies, and using the detected clear-sky data to fit functions that are then used to produce continuous clear-sky estimates. The clear-sky estimates and measurements are then used in various ways to infer cloud macrophysical properties. This value-added product (VAP) is based on methodologies developed by Dr. Charles N. Long as referenced in the papers below. It is an updated version of an earlier value-added data product called the Shortwave (SW) Clear-Sky Detection and Fitting Algorithm (SWCLRID). Two major improvements were made over the SWCLRID data product: 1) input data were first run through the Data Quality Assessment for Atmospheric Radiation Measurement (ARM) Radiation Data (QCRAD) VAP to better screen for data quality, and 2) additional processing was implemented to also include longwave (LW) clear sky estimates and derived values.
54 ENVIRONMENTAL SCIENCES↗
What Is the OPP Approach to the Next Generation of Laboratory Requirements
Planetary Protection Quality Management System NASA’s Office of Planetary Protection uses a quality-based process evaluation approach to verify planetary protection bioburden compliance over a project’s life cycle. The verification strategy shifts from a comparative direct assay approach validating hardware bioburden at a “moment in time,” to one that implements a continual quality assurance demonstration of the analytical process via established data requirements, laboratory operational, and management parameters throughout the mission’s entire assembly process. Laboratory quality-based systems and management strategies are standardized and implemented across government and industry. A standardized laboratory quality system approach increases transparency throughout the project’s life cycle and aligns planetary protection analytical approaches with government and industry practices to support both NASA and commercial endeavors. Strategies include the implementation of a laboratory quality management structure that documents and routinely validates parameters critical to experimental design and data collection, provides data quality assessment parameters, and ultimately validates that the collected data is of sufficient quality and quantity to meet the specified technical goals. Planetary protection can draw on these practices to provide a systematic process-based quality approach to support planetary protection validation and compliance requirements. Quality approaches including data quality objectives, method performance, data acceptance criteria and the associated laboratory quality management system are presented to provide an overview and framework for a planetary protection laboratory quality management system.
Amy Baker↗
Quality Ranking of Unary Fluoride Salt Property Data in MSTDB-TP
Molten salt reactor developers rely on thermal property data to design, license and operate the reactors they are developing. The Molten Salt Thermal Database-Thermophysical Properties (MSTDB-TP) is being developed under the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program and managed by Oak Ridge National Laboratory. The MSTDB-TP is intended to serve as a single source of measured thermophysical property values for a wide variety of molten salt systems available to researchers, molten salt reactor developers, and regulators. These properties include melting and boiling points, heat capacity, density, viscosity and thermal diffusivity and conductivity. Published measurements of molten salt properties are lacking for many salts and the data that are available are often inconsistent. This creates a challenge for MSR developers in determining which property values to select when designing their reactors. The MSDTDB-TP collects all available property data and down-selects to preferred data sets or correlations. It is the purpose of this work to apply a recently developed ranking system that indicates the quality of property values listed in the database to inform decisions about how to use the available data. Quality assessments and rankings are being applied to data in MSTDB-TP to provide an indication of the quality of the data available. A previous report detailed the ranking system that was followed.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Increasing Efficiency at the NTF by Optimizing Model AoA Positioning
The National Transonic Facility (NTF) at NASA Langley Research Center (LaRC) is a national resource for aeronautical research and development. The government, military and private industries rely on the capability of this facility for realistic flight data. Reducing the operation costs and keeping the NTF affordable is essential for aeronautics research. The NTF is undertaking an effort to reduce the time between data points during a pitch polar. This reduction is being driven by the operating costs of a cryogenic facility. If the time per data point can be reduced, a substantial cost savings can be realized from a reduction in liquid nitrogen (LN2) consumption. It is known that angle-of-attack (AoA) positioning is the longest lead-time item between points. In January 2005 a test was conducted at the NTF to determine the cause of the long lead-time so that an effort could be made to improve efficiency. The AoA signal at the NTF originates from onboard instrumentation then travels through a number of different systems including the signal conditioner, digital voltmeter, and the data system where the AoA angle is calculated. It is then fed into a closed loop control system that sets the model position. Each process along this path adds to the time per data point affecting the efficiency of the data taking process. Due to the nature of the closed loop feed back AoA control and the signal path, it takes approximately 18 seconds to take one pitch pause point with a typical AoA increment. Options are being investigated to reduce the time delay between points by modifying the signal path. These options include: reduced signal filtering, using analog channels instead of a digital volt meter (DVM), re-routing the signal directly to the AoA control computer and implementing new control algorithms. Each of these has potential to reduce the positioning time and together the savings could be significant. These timesaving efforts are essential but must be weighed against possible loss of data quality. For example, a reduction in filtering can introduce noise into the signal and using analog channels could result in some loss of accuracy. Data quality assessments need to be performed concurrently with timesaving techniques since data quality parameters are essential in maintaining facility integrity. This paper will highlight time saving efforts being undertaken or studied at the NTF. It will outline the instrumentation and computer systems involved in setting of the model pitch attitude then suggest changes to the process and discuss how these system changes would effect the time between data points. It also discusses the issue of data quality and how the potential efficiency changes in the system could affect it. Lastly, it will discuss the possibility of using an open loop control system and give some pros and cons of this method.
Crawford, Bradley L.↗
Environmental performance of household waste management in Europe - An example of 7 countries
Highlights: • Attributional LCA of household waste management in 7 EU countries. • Country-specific technologies and waste composition are crucial for impacts. • Proper waste management is a benefit to society. • Waste hierarchy focus needs to change from quantity to quality. • Need for overall improvement in waste data. - Abstract: An attributional life cycle assessment (LCA) of the management of 1 ton of household waste was conducted in accordance with ISO 14044:2006 and the ILCD Handbook for seven European countries, namely Germany, Denmark, France, UK, Italy, Poland and Greece, representing different household waste compositions, waste management practices, technologies, and energy systems. National data were collected from a range of sources regarding household waste composition, household sorting efficiency, collection, waste treatments, recycling, electricity and heat composition, and technological efficiencies. The objective was to quantify the environmental performance in the different countries, in order to analyze the sources of the main environmental impacts and national differences which affect the results. In most of the seven countries, household waste management provides environmental benefits when considering the benefits of recycling of materials and recovering and utilization of energy. Environmental benefits come from paper recycling and, to a lesser extent, the recycling of metals and glass. Waste-to-energy plants can lead to an environmental load (as in France) or a saving (Germany and Denmark), depending mainly on the composition of the energy being substituted. Sensitivity analysis and a data quality assessment identified a range of critical parameters, suggesting from where better data should be obtained. The study concluded that household waste management is environmentally the best in European countries with a minimum reliance on landfilling, also induced by the implementation of the Waste Hierarchy, though environmental performance does not correlate clearly with the rate of material recycling. From an environmental point of view, this calls for a change in the waste management paradigm, with less focus on where the waste is routed and more of a focus on the quality and utilization of recovered materials and energy.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗