Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

TU-A-18A-01: Basic Principles of PET/CT, Calibration Methods and Contrast Recovery Across Multiple Cameras

This continuing education session will discuss the physical principles of PET/CT imaging and characterization of contrast recovery using accreditation phantoms. A detailed overview will be given on the physical principles of PET including positron decay physics, 2D and 3D data acquisition, time-of-flight, scatter correction, CT attenuation correction, and image reconstruction. Instrument quality control and calibration procedures will be discussed. Technical challenges, common image artifacts and strategies to mitigate these issues will also be discussed. Data will be presented on acquisition techniques and reconstruction parameters affecting contrast recovery. The discussion will emphasize the minimization of reconstruction differences in quantification metrics such as SUV and contrast recovery coefficients for the NEMA and ACR clinical trial phantoms. Data from new and older generation scanners will be shown including comparison of contrast recovery measurements to their analytical solutions. The goal of this session is to update attendees on the quality control and calibration of PET/CT scanners, on methods to establish a common calibration for PET/CT scanners to control for instrument variance across multiple sites. Learning Objectives: Review the physical principles of PET/CT, quality control and calibration Gain further understanding on how to apply techniques for improving quantitative agreement across multiple cameras Describe the differences between measured and expected contrast recovery for the NEMA and ACR PET phantoms.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Traditional Look at SPE Phase 1 Surface Seismic Data: Far-Field Instruments, Measurements, and Analysis

We visually examined surface seismic data from the Source Physics Experiment (SPE) Phase-1 chemical explosions in preparation for waveform analysis and interpretation. Recording stations included far-field (near source) geophone lines, and both permanent network, reoccupied USArray, and temporary stations at local and regional distances. We found that near-source waveforms are dominated by broad band compressional (P), and band limited surface wave (Rg) (< 10 Hz) phases. Distinct, consistent shear (S) phases are difficult to observe visually even with a comprehensive bank of frequency bands. Secondary phases are indistinct at near-local distances, unlike for earthquake sources, especially at the high frequencies of interest for discrimination (e.g. 4-8 Hz), likely due to intense near surface scattering. S phases begin to emerge from the scattered background at and beyond 100 km. We identified regional Pn, Pg and Lg phases to 446 km for SPE-5. The data set is, unfortunately, plagued by poorly recorded instrument responses, or, possibly, time varying site amplification due to human interaction with sensors. Instrument response issues should be fixable, and this should be attempted to make this a truly, high-quality data set for use by the monitoring community.

58 GEOSCIENCES↗

Hybrid geological modeling: Combining machine learning and multiple-point statistics

Accurately modeling and constructing a geologically realistic subsurface model remains an outstanding problem as the morphology controls the flow behaviors. Particularly, one of the pattern-based methods, namely cross-correlation based simulation, has been proved to be an effective way to reconstruct a realistic model, at both small and large scales. However, conditioning to point data in the large-scale problems is still a crucial issue in these algorithms, since there is always a trade-off between the quality of the realizations and the degree of point data reproduction. Specifically, it is not practical to build a training image (TI) which includes all the possibilities and variabilities. Therefore, finding a pattern that can represent the point data and, at the same time, preserving the connectivities is difficult. This leads to producing highly-connected realizations with a significant mismatch or poor models with a reasonable degree of point data reproduction. To accurately reproduce the densely distributed hard data, pixel-based methods can also produce some unrealistic artifacts around the hard data. In this paper, to overcome this challenge, however, we use pattern-based methods as they often produce more disconnected geobodies when dealing with dense hard data, and proposed a hybrid algorithm using the pattern-based methods and convolutional neural network (CNN). The trained CNN model is utilized to improve the quality of conditioning to point data for the original realizations generated by the pattern-based algorithm. As such, the mismatch locations are identified, and the same regions are used in the training of CNN to mimic the procedure through which a missing region can be filled. To evaluate the performance of the proposed hybrid algorithm, it is tested on cases with different dimensions and different numbers of facies. Then, the newly improved realizations are compared with the initial realizations generated by the pattern-based algorithm. The comparison is also conducted by the flow simulation test. And it indicates that the proposed hybrid algorithm can better reproduce the point data, while the connectivities are better preserved.

58 GEOSCIENCES↗

CMS Data transfer operations after the first years of LHC collisions

CMS experiment utilizes distributed computing infrastructure and its performance heavily depends on the fast and smooth distribution of data between different CMS sites. Data must be transferred from the Tier-0 (CERN) to the Tier-1s for processing, storing and archiving, and time and good quality are vital to avoid overflowing CERN storage buffers. At the same time, processed data has to be distributed from Tier-1 sites to all Tier-2 sites for physics analysis while Monte Carlo simulations sent back to Tier-1 sites for further archival. At the core of all transferring machinery is PhEDEx (Physics Experiment Data Export) data transfer system. It is very important to ensure reliable operation of the system, and the operational tasks comprise monitoring and debugging all transfer issues. Based on transfer quality information Site Readiness tool is used to create plans for resources utilization in the future. We review the operational procedures created to enforce reliable data delivery to CMS distributed sites all over the world. Additionally, we need to keep data and meta-data consistent at all sites and both on disk and on tape. In this presentation, we describe the principles and actions taken to keep data consistent on sites storage systems and central CMS Data Replication Database (TMDB/DBS) while ensuring fast and reliable data samples delivery of hundreds of terabytes to the entire CMS physics community.

Kaselis, Rapolas↗

Reporting Quality of Randomized, Controlled Trials Evaluating Combined Chemoradiotherapy in Nasopharyngeal Carcinoma

Purpose: To comprehensively assess the reporting quality of randomized, controlled trials (RCTs) in nasopharyngeal carcinoma (NPC), and to identify significant predictors of quality. Methods and Materials: Two investigators searched MEDLINE and EMBASE for RCTs published between January 1988 and December 2015 that assessed the effect of combined chemoradiotherapy for NPC. The overall quality of each report was assessed using a 28-point overall quality score (OQS) based on the 2010 Consolidated Standards of Reporting Trials (CONSORT) statement. To provide baseline data for further evaluation, we also investigated the reporting quality of certain important issues in detail, including key methodologic items (allocation concealment, blinding, intention-to-treat principle), endpoints, follow-up, subgroup analyses, and adverse events. Results: We retrieved 24 relevant RCTs including 6591 patients. Median 2010 OQS was 15.5 (range, 10-24). Half of the items in the 2010 OQS were poorly reported in at least 40% of trials. Multivariable regression models revealed that publication after 2010 and high impact factor were significant predictors of improved 2010 OQS. Additionally, many issues that we consider significant were not reported adequately. Conclusions: Despite publication of the CONSORT statement more than a decade ago, overall reporting quality for RCTs in NPC was unsatisfactory. Additionally, substantial selectivity and heterogeneity exists in reporting of certain crucial issues. This survey provides the first prompt for NPC trial investigators to improve reporting quality according to the CONSORT statement; increased scrutiny and diligence by editors and peer reviewers is also required.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Where Is the Provenance? Ethical Replicability and Reproducibility in GIScience and Its Critical Applications

As replicability and reproducibility (R&R) crises develop within emerging convergent inquiry, ethical use of provenance information is central to the establishment and preservation of trust in critical applications of GIScience and geospatial technologies. Today large volumes of geospatial data are generated at high velocity from satellite sensors and unmanned aircraft systems, citizen sensors, geolocation-based data services, global navigation satellite systems, and so on. The extensive use of these data for applications such as disaster and humanitarian response raises the issue of R&R from competing perspectives of location privacy and geospatial data quality. Although geospatial data can be integrated and linked with contextual information to identify individuals’ movements, steps taken to ensure privacy can complicate the multiuser development of high-quality geospatial workflows. Provenance information as digital records of historical (retrospective) and potential future (prospective) geospatial processes is often overlooked, misunderstood, or inadequately addressed. We explore the relationship between provenance information, location privacy, and geospatial data quality in the context of R&R with a focus on disaster analytics. Here, we argue that in the era of big data and deep learning, GIScientists and associated institutions bear greater responsibility both for geospatial workflow quality and for location privacy. Given vastly heterogenous computational landscapes, we provide practical recommendations for ethically driven provenance and R&R research and development within the GIScience community and beyond.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Challenges of open data in aquatic sciences: issues faced by data users and data providers

Free use and redistribution of data (i.e., Open Data) increases the reproducibility, transparency, and pace of aquatic sciences research. However, barriers to both data users and data providers may limit the adoption of Open Data practices. Here, we describe common Open Data challenges faced by data users and data providers within the aquatic sciences community (i.e., oceanography, limnology, hydrology, and others). These challenges were synthesized from literature, authors’ experiences, and a broad survey of 174 data users and data providers across academia, government agencies, industry, and other sectors. Through this work, we identified seven main challenges: 1) metadata shortcomings, 2) variable data quality and reusability, 3) open data inaccessibility, 4) lack of standardization, 5) authorship and acknowledgement issues 6) lack of funding, and 7) unequal barriers around the globe. Our key recommendation is to improve resources to advance Open Data practices. This includes dedicated funds for capacity building, hiring and maintaining of skilled personnel, and robust digital infrastructures for preparation, storage, and long-term maintenance of Open Data. Further, to incentivize data sharing we reinforce the need for standardized best practices to handle data acknowledgement and citations for both data users and data providers. We also highlight and discuss regional disparities in resources and research practices within a global perspective.

54 ENVIRONMENTAL SCIENCES↗

Curation of Ground-Truth Validated Benchmarking Datasets for Fault Detection & Diagnostics Tools

Fault detection and diagnostics (FDD) analytical tools for heating, ventilation and air conditioning (HVAC) systems represent one of the most active areas of smart building technology development. A diversity of techniques is used for FDD analytics, spanning physical models, black box, and rule-based approaches, and researchers continuously strive to develop improved algorithms. With FDD algorithm numbers now in the hundreds, there is a need for performance evaluation of these algorithms in order to assess improvements, improve costeffectiveness, and to prioritize investment in the further development of these technologies. A persistent challenge of FDD advance has been the lack of common datasets to benchmark the performance accuracy of FDD algorithms. This paper summarizes the successful curation of HVAC operational data, paired with validated ground-truth information regarding the presence and absence of faults. The current dataset, consisting of both simulation and experimental data, will evolve to include a larger set of HVAC systems with the objective of creating the largest publicly available dataset to be used by FDD developers, users, and researchers to compare and contrast performance accuracy across FDD algorithms, helping to drive improvements that will spur greater market adoption of FDD tools. Furthermore, in order to avoid previously observed issues with contributed datasets and ensure high quality and consistency of future submissions, the development of data validation and ground-truth assessment protocol is detailed in this study.

Casillas, Armando↗

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Many of these power plants have spatiotemporal coherence that can be utilized for improving model accuracy. We have demonstrated in this paper the FAIRification of spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. Going further, we have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. To solve the issue of data missingness, we propose the use of St-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

FAST FY 2018 Data Call: A Preliminary Review [Slides]

This presentation provides an overview of fiscal year 2018 federal motor vehicle fleet data at the individual vehicle level during the fall of 2018, a preliminary summary of the data collected, and how the collecting project has reviewed that information for potential quality issues. This presentation will be given at the March 2019 INTERFUEL group meeting, hosted by DOE's Federal Energy Management Program (DOE FEMP). The information is collected through the Federal Automotive Statistical Tool (FAST) project. FAST is a Web-based information system managed by the US Department of Energy, the US General Services Administration, and the Energy Information Administration. FAST is used to collect information about the fleet of motor vehicles used and managed by the Federal government. FAST is developed and maintained by DOE's Idaho National Laboratory (INL).

99 GENERAL AND MISCELLANEOUS↗

Improved Management of the Technical Interfaces Between the Hanford Tank Farm Operator and the Hanford Waste Treatment Plant - 13383

The Department of Energy (DOE) is constructing the Waste Treatment and Immobilization Plant (WTP) at the Hanford site in Washington to treat and immobilize approximately 114 million gallons of high level radioactive waste (after all retrievals are accomplished). In order for the WTP to be designed and operated successfully, close coordination between the WTP engineering, procurement, and construction contractor, Bechtel National, Inc. and the tank farms operating contractor (TOC), Washington River Protection Solutions, LLC, is necessary. To develop optimal solutions for DOE and for the treatment of the waste, it is important to deal with the fact that two different prime contractors, with somewhat differing contracts, are tasked with retrieving and delivering the waste and for treating and immobilizing that waste. The WTP and the TOC have over the years cooperated to manage the technical interface. To manage what is becoming a much more complicated interface as the WTP design progresses and new technical issues have been identified, an organizational change was made by WTP and TOC in November of 2011. This organizational change created a co-located integrated project team (IPT) to deal with mutual and interface issues. The Technical Organization within the One System IPT includes employees from both TOC and WTP. This team has worked on a variety of technical issues of mutual interest and concern. Technical issues currently being addressed include: - The waste acceptance criteria; - Waste feed delivery and the associated data quality objectives (DQO); - Evaluation of the effects of performing a riser cut on a single shell tank on WTP operations; - The disposition of secondary waste from both TOC and WTP; - The close coordination of the TOC double shell tank mixing and sampling program and the Large Scale Integrated Test (LSIT) program for pulse jet mixers at WTP along with the associated responses to the Defense Nuclear Facilities Safety Board (DNFSB) Recommendation 2010-2; - Development of a set of alternatives to the current baseline that involve aspects of direct feed, feed conditioning, and design changes. The One System Technical Organization has served WTP, TOC, and DOE well in managing and resolving issues at the interface. This paper describes the organizational structure used to improve the interface and several examples of technical interface issues that have been successfully addressed by the new organization. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Second data release of the Hyper Suprime-Cam Subaru Strategic Program

This paper presents the second data release of the Hyper Suprime-Cam Subaru Strategic Program, a wide-field optical imaging survey using the 8.2 m Subaru Telescope. We report the release includes data from 174 nights of observation through 2018 January. The Wide layer data cover about 300 deg$^2$ in all five broad-band filters ($grizy$) to the nominal survey exposure (10 min in $gr$ and 20 min in $izy$). Partially observed areas are also included in the release; about 1100 deg$^2$ is observed in at least one filter and one exposure. The median seeing in the i-band is ${0_{.}^{\prime \prime }6}$, demonstrating the superb image quality of the survey. The Deep (26 deg$^2$) and UltraDeep (4 deg$^2$) data are jointly processed and the UltraDeep-COSMOS field reaches an unprecedented depth of $i\sim 28$ at $5 \, \sigma$ for point sources. In addition to the broad-band data, narrow-band data are also available in the Deep and UltraDeep fields. This release includes a major update to the processing pipeline, including improved sky subtraction, PSF modeling, object detection, and artifact rejection. The overall data quality has been improved, but this release is not without problems; there is a persistent deblender problem as well as new issues with masks around bright stars. The user is encouraged to review the issue list before utilizing the data for scientific explorations. All the image products as well as catalog products are available for download. The catalogs are also loaded into a database, which provides an easy interface for users to retrieve data for objects of interest. In addition to these main data products, detailed galaxy shape measurements withheld from Public Data Release 1 (PDR1) are now available to the community. The shape catalog is drawn from the S16A internal release, which has a larger area than PDR1 (160 deg$^2$). All products are available at the data release site, https://hsc-release.mtk.nao.ac.jp/.

79 ASTRONOMY AND ASTROPHYSICS↗

Fault-tolerant bandwidth reservation strategies for data transfers in high-performance networks

Many next-generation e-science applications need fast and reliable transfer of large volumes of data with guaranteed performance, which is typically enabled by the bandwidth reservation service in high-performance networks. One prominent issue in such network environments with large footprints is that node and link failures are inevitable, hence potentially degrading the quality of data transfer. We consider two generic types of bandwidth reservation requests (BRRs) concerning data transfer reliability: (i) to achieve the highest data transfer reliability under a given data transfer deadline, and (ii) to achieve the earliest data transfer completion time while satisfying a given data transfer reliability requirement. We propose two periodic bandwidth reservation algorithms with rigorous optimality proofs to optimize the scheduling of individual BRRs within BRR batches. The efficacy of the proposed algorithms is illustrated through extensive simulations in comparison with scheduling algorithms widely adopted in production networks in terms of various performance metrics.

97 MATHEMATICS AND COMPUTING↗

Radical Prostatectomy Versus Radiation and Androgen Deprivation Therapy for Clinically Localized Prostate Cancer: How Good Is the Evidence?

Purpose: The optimal treatment of clinically localized prostate cancer is controversial. Most studies focus on biochemical (PSA) failure when comparing radical prostatectomy (RP) with radiation therapy (RT), but this endpoint has not been validated as predictive of overall survival (OS) or cause-specific survival (CSS). We analyzed the available literature to determine whether reliable conclusions could be made concerning the effectiveness of RP compared with RT with or without androgen deprivation therapy (ADT), assuming current treatment standards. Methods: Articles published between February 29, 2004, and March 1, 2015, that compared OS and CSS after RP or RT with or without ADT were included. Because the GRADE (Grading of Recommendations, Assessment, Development, and Evaluation) system emphasis is on randomized controlled clinical trials, a reliability score (RS) was explored to further understand the issues associated with the study quality of observational studies, including appropriateness of treatment, source of data, clinical characteristics, and comorbidity. Lower RS values indicated lower reliability. Results: Fourteen studies were identified, and 13 were completely evaluable. Thirteen of the 14 studies (93%) were observational studies with low-quality evidence. The median RS was 12 (range, 5-18); the median difference in 10-year OS and CSS favored RP over RT: 10% and 4%, respectively. In studies with a RS ≤12 (average RS 9) the 10-year OS and CSS median differences were 17% and 6%, respectively. For studies with a RS >12 (average RS 15.5), the 10-year OS and CSS median differences were 5.5% and 1%, respectively. Thus, we observed an association between low RS and a higher percentage difference in OS and CSS. Conclusions: Reliable evidence that RP provides a superior CSS to RT with ADT is lacking. The most reliable studies suggest that the differences in 10-year CSS between RP and RT are small, possibly <1%.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

ISSUES IN NEUTRON CROSS SECTION COVARIANCES

We review neutron cross section covariances in both the resonance and fast neutron regions with the goal to identify existing issues in evaluation methods and their impact on covariances. We also outline ideas for suitable covariance quality assurance procedures.We show that the topic of covariance data remains controversial, the evaluation methodologies are not fully established and covariances produced by different approaches have unacceptable spread. The main controversy is in very low uncertainties generated by rigorous evaluation methods and much larger uncertainties based on simple estimates from experimental data. Since the evaluators tend to trust the former, while the users tend to trust the latter, this controversy has considerable practical implications. Dedicated effort is needed to arrive at covariance evaluation methods that would resolve this issue and produce results accepted internationally both by evaluators and users.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH4+) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

54 ENVIRONMENTAL SCIENCES↗

First ARM Aerosol Chemical Speciation Monitor Users’ Meeting Report

The first U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility aerosol chemical speciation monitor (ACSM) users’ meeting was held on April 11-13, 2017, at Aerodyne Research, Inc. in Billerica, Massachusetts, to discuss the Southern Great Plains (SGP) atmospheric observatory ACSM data quality and establish best practices for data collection and processing. The participants examined six years of calibration and processed data. Specific issues raised by data users were addressed and case studies from two field experiments were examined. The most recent data from the ACSM installed in the newly commissioned SGP ARM Mobile Facility 7 (AMF7) were also evaluated. The participants recommended that the SGP ACSM data be reprocessed using calibration values averaged over the history of SGP ACSM calibrations. They also recommended that the data quality be evaluated by comparing (1) observed versus predicted particulate ammonium (NH 4 + ) mass loadings, and (2) ACSM mass loadings versus mass loadings calculated from particle size and light scattering data. The contents of the datastreams from the ACSM were defined based on ARM requirements and the necessary tasks to implement these recommendations were assigned to the mentor and the instrument manufacturer. Some of the recommendations were implemented for the SGP data and are presented in this report. Data from two ARM sites located in marine environments were also analyzed. These analyses as well as instrument intercomparisons have led to further questions about data treatment. These will be addresses in the second users’ meeting scheduled for the summer of 2018.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗