Search NASA⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 1150871

Sensor Data Management, Validation, Correction, and Provenance for Building Technologies

Castello, Charles C·Sanyal, Jibonananda·Rossiter, Jeffrey S·Hensley, Zachary·New, Joshua Ryan
View original source ↗Export metadata ↓

Abstract

Oak Ridge National Laboratory (ORNL) conducts research on technologies that use a wide range of sensors to develop and characterize building energy performance. The management of high-resolution sensor data, analysis, and tracing lineage of such activities is challenging. Missing or corrupt data due to sensor failure, fouling, drifting, calibration error, or data logger failure is another issue. This paper focuses on sensor data management, validation, correction, and provenance to combat these issues, ensuring complete and accurate sensor datasets for building technologies applications and research. The design and development of two integrated software products are discussed: Sensor Data Validation and Correction (SensorDVC) and the Provenance Data Management System (ProvDMS) platform.

Explore related subjects

Data managementflexible research platformsFRPprovenancequality assurance

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Castello, Charles C, Sanyal, Jibonananda, Rossiter, Jeffrey S, Hensley, Zachary, New, Joshua Ryan. 2014-01-01. Sensor Data Management, Validation, Correction, and Provenance for Building Technologies. https://www.osti.gov/biblio/1150871

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2017

Medical Data Architecture Project Status

The Medical Data Architecture (MDA) project supports the Exploration Medical Capability (ExMC) risk to minimize or reduce the risk of adverse health outcomes and decrements in performance due to in-flight medical capabilities on human exploration missions. To mitigate this risk, the ExMC MDA project addresses the technical limitations identified in ExMC Gap Med 07: We do not have the capability to comprehensively process medically-relevant information to support medical operations during exploration missions. This gap identifies that the current International Space Station (ISS) medical data management includes a combination of data collection and distribution methods that are minimally integrated with on-board medical devices and systems. Furthermore, there are variety of data sources and methods of data collection. For an exploration mission, the seamless management of such data will enable an increasingly autonomous crew than the current ISS paradigm. The MDA will develop capabilities that support automated data collection, and the necessary functionality and challenges in executing a self-contained medical system that approaches crew health care delivery without assistance from ground support. To attain this goal, the first year of the MDA project focused on reducing technical risk, developing documentation and instituting iterative development processes that established the basis for the first version of MDA software (or Test Bed 1). Test Bed 1 is based on a nominal operations scenario authored by the ExMC Element Scientist. This narrative was decomposed into a Concept of Operations that formed the basis for Test Bed 1 requirements. These requirements were successfully vetted through the MDA Test Bed 1 System Requirements Review, which permitted the MDA project to begin software code development and component integration. This paper highlights the MDA objectives, development processes, and accomplishments, and identifies the fiscal year 2017 milestones and deliverables in the upcoming year.

Data management↗
NASA NTRSDate not supplied

Updates of MERRA-2 Data and Services at NASA GES DISC

Over40 years of NASA climate reanalysis datasets from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) are available at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). In addition to being used in traditional weather and climate research, MERRA-2 is also widely used in application studies of, e.g., wind and solar energy, air quality and health, food and drought, and heat waves. Two new MERRA-2 datasets were recently added at the GES DISC: (1) climate statistics derived fromMERRA-2 daily data to assist in the analysis of extreme temperature and precipitation events and of large-scale meteorological patterns from 1980 to the present and (2) gridded satellite and conventional observations processed in the MERRA-2 system, along with key statistics derived from the data assimilation, to help better understand how the quality of observations directly affect there analysis data. The GES DISC focuses its efforts on continually improving existing data services and to develop new data tools to satisfy various user communities. The newly added features include the following: Time series service: This is a new service for MERRA-2 data, which enables the easy and fast access of long-term hourly or daily time series at a location for popular parameters. The data is saved in a single le in Ascii format with a user- friendly structure. New analytic functions in the subsetter interface: Options for downloading daily minimum and maximum values have been added into the subsetter interface, in addition to the existing daily mean option, for all MERRA-2 and MERRA sub-daily products. Data format conversion to GeoTIFF has been implemented. New variables in Giovanni: Most monthly variables have been integrated into Giovanni, GESDISC’s online visualization and analysis tool. Due to the large data volume, hourly variables were selected based on user requests. More online information: New MERRA-2 documentation has been added: Data How-To, Data in Action, and FAQ. This presentation overviews two new MERRA-2 datasets and illustrates the new features of data services through a number of case studies. MERRA-2 data and services can be found at: https://disc.gsfc.gov/datasets?

Data management↗
NASA NTRSDate not supplied

Big-data Efficient and Automated Science Transfer (BEAST): An Open-Source Software Architecture for Arc Jet Data Management, Modeling, and Automation

Big-data Efficient and Automated Science Transfer (BEAST) was conceived to address the existing ground testing data management of the NASA Ames arc jet facilities (e.g., manually entered Excel files and USB drive data transfers). These data management practices were seen as a choke point for future thermal protection system (TPS) development as they limit statistical tracking, resolution of diagnostics, coordination between video/time series, data throughput, and data processing speed/efficiency. Consequently, BEAST was developed to provide a new data infrastructure with streamlined data collection, processing, transfer, and analysis. This new framework also seeks to implement the FAIR principles of data stewardship: Findable, Accessible, Interoperable, and Reusable. The BEAST framework is based on a combination of the Python Django web framework and the Python data stack to provide a monolithic, open-source platform for data management, automation, and machine learning. This architecture was chosen for maintainability and scalability for a small, in-house development team. This paper will describe the application framework, deployment, and discuss the benefits and future plans for the system.

Data management↗