Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Traditional Look at SPE Phase 1 Surface Seismic Data: Far-Field Instruments, Measurements, and Analysis

We visually examined surface seismic data from the Source Physics Experiment (SPE) Phase-1 chemical explosions in preparation for waveform analysis and interpretation. Recording stations included far-field (near source) geophone lines, and both permanent network, reoccupied USArray, and temporary stations at local and regional distances. We found that near-source waveforms are dominated by broad band compressional (P), and band limited surface wave (Rg) (< 10 Hz) phases. Distinct, consistent shear (S) phases are difficult to observe visually even with a comprehensive bank of frequency bands. Secondary phases are indistinct at near-local distances, unlike for earthquake sources, especially at the high frequencies of interest for discrimination (e.g. 4-8 Hz), likely due to intense near surface scattering. S phases begin to emerge from the scattered background at and beyond 100 km. We identified regional Pn, Pg and Lg phases to 446 km for SPE-5. The data set is, unfortunately, plagued by poorly recorded instrument responses, or, possibly, time varying site amplification due to human interaction with sensors. Instrument response issues should be fixable, and this should be attempted to make this a truly, high-quality data set for use by the monitoring community.

58 GEOSCIENCES↗

Hybrid geological modeling: Combining machine learning and multiple-point statistics

Accurately modeling and constructing a geologically realistic subsurface model remains an outstanding problem as the morphology controls the flow behaviors. Particularly, one of the pattern-based methods, namely cross-correlation based simulation, has been proved to be an effective way to reconstruct a realistic model, at both small and large scales. However, conditioning to point data in the large-scale problems is still a crucial issue in these algorithms, since there is always a trade-off between the quality of the realizations and the degree of point data reproduction. Specifically, it is not practical to build a training image (TI) which includes all the possibilities and variabilities. Therefore, finding a pattern that can represent the point data and, at the same time, preserving the connectivities is difficult. This leads to producing highly-connected realizations with a significant mismatch or poor models with a reasonable degree of point data reproduction. To accurately reproduce the densely distributed hard data, pixel-based methods can also produce some unrealistic artifacts around the hard data. In this paper, to overcome this challenge, however, we use pattern-based methods as they often produce more disconnected geobodies when dealing with dense hard data, and proposed a hybrid algorithm using the pattern-based methods and convolutional neural network (CNN). The trained CNN model is utilized to improve the quality of conditioning to point data for the original realizations generated by the pattern-based algorithm. As such, the mismatch locations are identified, and the same regions are used in the training of CNN to mimic the procedure through which a missing region can be filled. To evaluate the performance of the proposed hybrid algorithm, it is tested on cases with different dimensions and different numbers of facies. Then, the newly improved realizations are compared with the initial realizations generated by the pattern-based algorithm. The comparison is also conducted by the flow simulation test. And it indicates that the proposed hybrid algorithm can better reproduce the point data, while the connectivities are better preserved.

58 GEOSCIENCES↗

Information Quality Cluster and Usability

The Information Quality Cluster (IQC) of the Federation of Earth Science Information Partners (ESIP) has been active since 2014 with membership from multiple organizations including NASA and NOAA. The purpose of this presentation is to foster collaboration between the IQC and the ESIP Usability Cluster. The IQC's activities are motivated partly by the guidelines on information quality from several federal agencies. The agencies developed the guidelines complying with a request in 2002 from the Office of Management and Budget (OMB). The OMB request resulted from a congressional mandate, namely, Section 515 of the Treasury and General Government Appropriations Act for Fiscal Year 2001 (Public Law 106-554; H.R. 5658). NASA's guidelines, for example, emphasize the need for high information quality indicating the various types of public users of information from NASA's missions and programs. The IQC's vision is to become an authoritative and responsive resource of information and guidance to data providers on how best to implement data quality standards and best practices, so that the implementations comply with the various agencies' guidelines, as well as provide users with the best quality of information possible. The IQC interacts with various national and international organizations and encourages collaboration for exchange of information. The IQC considers four aspects of information quality: Scientific Quality, Product Quality, Stewardship Quality and Service Quality. The IQC has considered several use cases to identify issues in capturing, describing, providing access to, and enabling use of information on quality. Several of these use cases point to issues about the usability of information. Collaboration between the IQC and Usability Cluster will be beneficial for arriving at solutions to such issues.

Remote Sensing; Data Systems; Information Quality;↗

Ionosphere Plasma State Determination in Low Earth Orbit from International Space Station Plasma Monitor

A plasma diagnostic package is deployed on the International Space Station (ISS). The system - a Floating Potential Measurement Unit (FPMU) - is used by NASA to monitor the electrical floating potential of the vehicle to assure astronaut safety during extravehicular activity. However, data from the unit also reflects the ionosphere state and seems to represent an unutilized scientific resource in the form of an archive of scientific plasma state data. The unit comprises a Floating Potential probe and two Langmuir probes. There is also an unused but active plasma impedance probe. The data, at one second cadence, are collected, typically for a two week period surrounding extravehicular activity events. Data is also collected any time a visiting vehicle docks with ISS and also when any large solar events occur. The telemetry system is unusual because the package is mounted on a television camera stanchion and its data is impressed on a video signal that is transmitted to the ground and streamed by internet to two off center laboratory locations. The data quality has in the past been challenged by weaknesses in the integrated ground station and distribution systems. These issues, since mid‐2010, have been largely resolved and the ground stations have been upgraded. Downstream data reduction has been developed using physics based modeling of the electron and ion collecting character in the plasma. Recursive algorithms determine plasma density and temperature from the raw Langmuir probe current voltage sweeps and this is made available in real time for situational awareness. The purpose of this paper is to describe and record the algorithm for data reduction and to show that the Floating probe and Langmuir probes are capable of providing long term plasma state measurement in the ionosphere. Geophysical features such as the Appleton anomaly and high latitude modulation at the edge of the Auroral zones are regularly observed in the nearly circular, 51 deg inclined, 400 km altitude ISS orbit. Evidence of waves in the ion collection current data is seen in geographic zones known to exhibit the spread‐F phenomenon. An anomaly in the current collection characteristic of the cylindrical probe appears also too be organized by the geomagnetic field.

Kramer, Leonard↗

CMS Data transfer operations after the first years of LHC collisions

CMS experiment utilizes distributed computing infrastructure and its performance heavily depends on the fast and smooth distribution of data between different CMS sites. Data must be transferred from the Tier-0 (CERN) to the Tier-1s for processing, storing and archiving, and time and good quality are vital to avoid overflowing CERN storage buffers. At the same time, processed data has to be distributed from Tier-1 sites to all Tier-2 sites for physics analysis while Monte Carlo simulations sent back to Tier-1 sites for further archival. At the core of all transferring machinery is PhEDEx (Physics Experiment Data Export) data transfer system. It is very important to ensure reliable operation of the system, and the operational tasks comprise monitoring and debugging all transfer issues. Based on transfer quality information Site Readiness tool is used to create plans for resources utilization in the future. We review the operational procedures created to enforce reliable data delivery to CMS distributed sites all over the world. Additionally, we need to keep data and meta-data consistent at all sites and both on disk and on tape. In this presentation, we describe the principles and actions taken to keep data consistent on sites storage systems and central CMS Data Replication Database (TMDB/DBS) while ensuring fast and reliable data samples delivery of hundreds of terabytes to the entire CMS physics community.

Kaselis, Rapolas↗

Integrating Theory and Practice: Applying the Quality Improvement Paradigm to Product Line Engineering

My assertion is that not only are product lines a relevant research topic, but that the tools used by empirical software engineering researchers can address observed practical problems. Our experience at NASA has been there are often externally proposed solutions available, but that we have had difficulties applying them in our particular context. We have also focused on return on investment issues when evaluating product lines, and while these are important, one can not attain objective data on success or failure until several applications from a product family have been deployed. The use of the Quality Improvement Paradigm (QIP) can address these issues: (1) Planning an adoption path from an organization's current state to a product line approach; (2) Constructing a development process to fit the organization's adoption path; (3) Evaluation of product line development processes as the project is being developed. The QIP consists of the following six steps: (1) Characterize the project and its environment; (2) Set quantifiable goals for successful project performance; (3) Choose the appropriate process models, supporting methods, and tools for the project; (4) Execute the process, analyze interim results, and provide real-time feedback for corrective action; (5) Analyze the results of completed projects and recommend improvements; and (6) Package the lessons learned as updated and refined process models. A figure shows the QIP in detail. The iterative nature of the QIP supports an incremental development approach to product lines, and the project learning and feedback provide the necessary early evaluations.

Stark, Michael↗

Reporting Quality of Randomized, Controlled Trials Evaluating Combined Chemoradiotherapy in Nasopharyngeal Carcinoma

Purpose: To comprehensively assess the reporting quality of randomized, controlled trials (RCTs) in nasopharyngeal carcinoma (NPC), and to identify significant predictors of quality. Methods and Materials: Two investigators searched MEDLINE and EMBASE for RCTs published between January 1988 and December 2015 that assessed the effect of combined chemoradiotherapy for NPC. The overall quality of each report was assessed using a 28-point overall quality score (OQS) based on the 2010 Consolidated Standards of Reporting Trials (CONSORT) statement. To provide baseline data for further evaluation, we also investigated the reporting quality of certain important issues in detail, including key methodologic items (allocation concealment, blinding, intention-to-treat principle), endpoints, follow-up, subgroup analyses, and adverse events. Results: We retrieved 24 relevant RCTs including 6591 patients. Median 2010 OQS was 15.5 (range, 10-24). Half of the items in the 2010 OQS were poorly reported in at least 40% of trials. Multivariable regression models revealed that publication after 2010 and high impact factor were significant predictors of improved 2010 OQS. Additionally, many issues that we consider significant were not reported adequately. Conclusions: Despite publication of the CONSORT statement more than a decade ago, overall reporting quality for RCTs in NPC was unsatisfactory. Additionally, substantial selectivity and heterogeneity exists in reporting of certain crucial issues. This survey provides the first prompt for NPC trial investigators to improve reporting quality according to the CONSORT statement; increased scrutiny and diligence by editors and peer reviewers is also required.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Where Is the Provenance? Ethical Replicability and Reproducibility in GIScience and Its Critical Applications

As replicability and reproducibility (R&R) crises develop within emerging convergent inquiry, ethical use of provenance information is central to the establishment and preservation of trust in critical applications of GIScience and geospatial technologies. Today large volumes of geospatial data are generated at high velocity from satellite sensors and unmanned aircraft systems, citizen sensors, geolocation-based data services, global navigation satellite systems, and so on. The extensive use of these data for applications such as disaster and humanitarian response raises the issue of R&R from competing perspectives of location privacy and geospatial data quality. Although geospatial data can be integrated and linked with contextual information to identify individuals’ movements, steps taken to ensure privacy can complicate the multiuser development of high-quality geospatial workflows. Provenance information as digital records of historical (retrospective) and potential future (prospective) geospatial processes is often overlooked, misunderstood, or inadequately addressed. We explore the relationship between provenance information, location privacy, and geospatial data quality in the context of R&R with a focus on disaster analytics. Here, we argue that in the era of big data and deep learning, GIScientists and associated institutions bear greater responsibility both for geospatial workflow quality and for location privacy. Given vastly heterogenous computational landscapes, we provide practical recommendations for ethically driven provenance and R&R research and development within the GIScience community and beyond.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

The diffuse galactic gamma ray emission

The EGRET (Energetic Gamma-Ray Experiment Telescope) detector will provide a much more detailed view of the diffuse galactic gamma ray intensity in terms of higher resolution, greater statistical significance, and broader energy range than earlier missions. These observations will furnish insight into a number of very important questions related to the dynamics and structure of the Galaxy. A diffuse emission model is being developed that incorporates the latest information on matter distribution and source functions. In addition, it is tailored to the EGRET instrument response functions. The analysis code of the model maintains flexibility to accommodate the quality of the data that is anticipated. The discussion here focuses on the issues of the distributions of matter, cosmic rays, and radiation fields, and on the important source functions that enter into the model calculation of diffuse emission.

Bertsch, David L.↗

A day-to-day comparison study of Seasat scatterometer winds with winds observed from islands in the tropical Pacific

The winds derived from the Seasat-A Satellite Scatterometer (SASS) measurements have been the subject of great interest since the 1978 mission, because of the promise of radically improved wind observations over the world ocean. Due to the early end of the mission, only a few of the planned ground truth validation experiments could be made, and the subsequent lack of sufficient high quality independent wind data for comparison has limited the ability to resolve critical issues regarding the scatterometer's performance and the correct interpretation of its signal. Operational weather observations were made of ocean winds independent of Seasat mission plans during the Seasat mission period; the results are reported of a comparison study using such observations. Previous verification with in situ winds has been primarily in middle latitudes (GOASEX, JASIN, and NDBO buoys); winds observed from nine tropical Pacific islands are compared with nearly contemporaneous measurements taken by SASS during overpasses of the islands.

Davison, Jerry↗

Fusing GeoNEX and VIIRS Surface BRDF Retrievals: Exploring a GEO-LEO Synergy

The Bidirectional Reflectance Distribution Function or BRDF, which describes the dependency of surface reflectance on the illumination-view geometries, are the foundation of many high-level satellite products for terrestrial and aquatic system monitoring. The latest geostationary sensors like GOES ABI provide high frequent (~10 minutes) observations of the Earth surface that feature continuously changing sun angles, allowing us to retrieve surface BRDF with dedicated atmospheric correction algorithms like MAIAC (Multi-Angle Implementation of Atmospheric Correction). For mid-latitude locations, because geostationary satellites have fixed view angles in the back-scattering directions, the angular sampling of surface BRDF by GEO sensors is not comprehensive. This study explores a GEO-LEO synergy to address this issue. We first extract concurrent GeoNEX and VIIRS BRDF data with the best quality (cloud-free and low aerosol loading) at chosen AERONET sites. We then compare the magnitude and the shape factors of the two set of BRDF parameters as well as their variations through the season. We calculate the “distances” between the GeoNEX and VIIRS BRDF by using them to cross-predict the top-of-atmosphere reflectance measured by their counterpart and evaluating the corresponding prediction errors. This metric allows us to derive a set of optimized BRDF parameters that minimize such distances or prediction errors, which are considered as the fused BRDF result. We validate the algorithm with reserved AERONET data and then apply it to generate the GEO-LEO BRDF synergy over CONUS. We expect the fused BRDF to have reduced uncertainties as compared to the source GeoNEX or VIIRS data and may find broadly application in deriving other high-level satellite products.

Geostationary satellite↗

Challenges of open data in aquatic sciences: issues faced by data users and data providers

Free use and redistribution of data (i.e., Open Data) increases the reproducibility, transparency, and pace of aquatic sciences research. However, barriers to both data users and data providers may limit the adoption of Open Data practices. Here, we describe common Open Data challenges faced by data users and data providers within the aquatic sciences community (i.e., oceanography, limnology, hydrology, and others). These challenges were synthesized from literature, authors’ experiences, and a broad survey of 174 data users and data providers across academia, government agencies, industry, and other sectors. Through this work, we identified seven main challenges: 1) metadata shortcomings, 2) variable data quality and reusability, 3) open data inaccessibility, 4) lack of standardization, 5) authorship and acknowledgement issues 6) lack of funding, and 7) unequal barriers around the globe. Our key recommendation is to improve resources to advance Open Data practices. This includes dedicated funds for capacity building, hiring and maintaining of skilled personnel, and robust digital infrastructures for preparation, storage, and long-term maintenance of Open Data. Further, to incentivize data sharing we reinforce the need for standardized best practices to handle data acknowledgement and citations for both data users and data providers. We also highlight and discuss regional disparities in resources and research practices within a global perspective.

54 ENVIRONMENTAL SCIENCES↗

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗

Critical Evaluation of 0-30 km Profile Information in Ground-Based Zenith-Sky and Satellite-Measured Backscattered UV Radiation

We now have several decades of experience in deriving vertical ozone profiles from the measurements of diffuse ultraviolet radiation by both ground and satellite-based instruments using Umkehr and BUV techniques. Continuing technological advances are pushing the state-of-the-art of these measurements to high spectral resolution and broader wavelength coverage. These modern instruments include the ground-based Brewer and satellite-based Global Ozone Monitoring Experiment (GOME) instruments, as well as advanced instruments being developed by ESA(SCIAMACHY), Netherlands(OMI) and Japan(ODUS). However, one of the issues that remains unresolved is the 0-30 km ozone profile information retrievable from these measurements. Though it is commonly believed that both the Umkehr and the satellite-based BUV techniques have very limited profile information below 30 km, there are those who argue that the data from these instruments should continue to be reported in this altitude range for they compare well with ozonesondes and hence there is useful scientific information. Others claim that the limitations of the Umkehr and BUV techniques are largely due to their low spectral resolution, and that the profile information below 30 km can be greatly improved by going to high spectral resolution instruments, such as Brewer and GOME. The purpose of this paper is to provide a critical evaluation of the 0-30 km ozone profile information in the various UV remote sensing techniques. We use a database of individual ozone profiles created using ozonesondes and SAGE and 4D ozone fields generated by data assimilation techniques to simulate radiances measured by the various techniques. We then apply a common inversion approach to all the methods to systematically examine how much profile information is available simply from the knowledge of total ozone, how much additional profile information is added by the traditional Dobson Umkehr and satellite buv techniques, and how much better one can do by adding additional wavelengths and by going to higher spectral resolution. An open and honest discussion of these issues is critical to provide the ozone science community a realistic assessment of the quality of data in the lower stratosphere and troposphere expected from both past and future instruments.

Bhartia, Pawan↗

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Many of these power plants have spatiotemporal coherence that can be utilized for improving model accuracy. We have demonstrated in this paper the FAIRification of spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. Going further, we have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. To solve the issue of data missingness, we propose the use of St-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

FAST FY 2018 Data Call: A Preliminary Review [Slides]

This presentation provides an overview of fiscal year 2018 federal motor vehicle fleet data at the individual vehicle level during the fall of 2018, a preliminary summary of the data collected, and how the collecting project has reviewed that information for potential quality issues. This presentation will be given at the March 2019 INTERFUEL group meeting, hosted by DOE's Federal Energy Management Program (DOE FEMP). The information is collected through the Federal Automotive Statistical Tool (FAST) project. FAST is a Web-based information system managed by the US Department of Energy, the US General Services Administration, and the Energy Information Administration. FAST is used to collect information about the fleet of motor vehicles used and managed by the Federal government. FAST is developed and maintained by DOE's Idaho National Laboratory (INL).

99 GENERAL AND MISCELLANEOUS↗

Improved Management of the Technical Interfaces Between the Hanford Tank Farm Operator and the Hanford Waste Treatment Plant - 13383

The Department of Energy (DOE) is constructing the Waste Treatment and Immobilization Plant (WTP) at the Hanford site in Washington to treat and immobilize approximately 114 million gallons of high level radioactive waste (after all retrievals are accomplished). In order for the WTP to be designed and operated successfully, close coordination between the WTP engineering, procurement, and construction contractor, Bechtel National, Inc. and the tank farms operating contractor (TOC), Washington River Protection Solutions, LLC, is necessary. To develop optimal solutions for DOE and for the treatment of the waste, it is important to deal with the fact that two different prime contractors, with somewhat differing contracts, are tasked with retrieving and delivering the waste and for treating and immobilizing that waste. The WTP and the TOC have over the years cooperated to manage the technical interface. To manage what is becoming a much more complicated interface as the WTP design progresses and new technical issues have been identified, an organizational change was made by WTP and TOC in November of 2011. This organizational change created a co-located integrated project team (IPT) to deal with mutual and interface issues. The Technical Organization within the One System IPT includes employees from both TOC and WTP. This team has worked on a variety of technical issues of mutual interest and concern. Technical issues currently being addressed include: - The waste acceptance criteria; - Waste feed delivery and the associated data quality objectives (DQO); - Evaluation of the effects of performing a riser cut on a single shell tank on WTP operations; - The disposition of secondary waste from both TOC and WTP; - The close coordination of the TOC double shell tank mixing and sampling program and the Large Scale Integrated Test (LSIT) program for pulse jet mixers at WTP along with the associated responses to the Defense Nuclear Facilities Safety Board (DNFSB) Recommendation 2010-2; - Development of a set of alternatives to the current baseline that involve aspects of direct feed, feed conditioning, and design changes. The One System Technical Organization has served WTP, TOC, and DOE well in managing and resolving issues at the interface. This paper describes the organizational structure used to improve the interface and several examples of technical interface issues that have been successfully addressed by the new organization. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗