Search NASA⌕ Search

SEARCH · Search NASA

Results for “data integrity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Comparative analysis of data base management systems

A study to determine if the Remote File Inquiry (RFI) system would handle the future requirements of the user community is discussed. RFI is a locally written and locally maintained on-line query/update package. The current and future on-line requirements of the user community were studied. Additional consideration was given to the types of data structuring the users required. The survey indicated the features of greatest benefit were: sort, subtotals, totals, record selection, storage of queries, global updating and the ability to page break. The major deficiencies were: one level of hierarchy, excessive response time, software unreliability, difficult to add, delete and modify records, complicated error messages and the lack of ability to perform interfield comparisons. Missing features users required were: formatted screens, interfield comparions, interfield arithmetic, multiple file access, security and data integrity. The survey team recommended Kennedy Space Center move forward to state-of-the-art software, a Data Base Management System which is thoroughly tested and easy to implement and use.

Smith, R.↗

The application of remote sensing to resource management and environmental quality programs in Kansas

The activities of the Kansas Applied Remote Sensing (KARS) Program during the period April 1, 1982 through Marsh 31, 1983 are described. The most important work revolved around the Kansas Interagency Task Force on Applied Remote Sensing and its efforts to establish an operational service oriented remote sensing program in Kansas state government. Concomitant with this work was the upgrading of KARS capabilities to process data for state agencies through the vehicle of a low cost digital data processing system. The KARS Program continued to take an active role in irrigation mapping. KARS is now integrating data acquired through analysis of LANDSAT into geographic information systems designed for evaluating groundwater resources. KARS also continues to work at the national level on the national inventory of state natural resources information systems.

Barr, B. G.↗

Haystack-Ruby

The open source Project Haystack initiative defines meta data and communication standards related to data from buildings and intelligent devices. The Project Haystack REST API defines standard formats and operations for exchanging Haystack tagged data over HTTP. The HaystackRuby gem wraps calls to this REST API to enable Ruby application to easily integrate data hosted on a Project Haystack compliant server. The HaystackRuby gem was developed at the National Renewable Energy Lab to support applications related to campus energy. We hope that this tool may be useful to others.

Source record↗

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository: Preprint

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗

Improving the Accessibility and Usability of Geothermal Information with Data Lakes and Data Pipelines on the Geothermal Data Repository

The Geothermal Data Repository (GDR) provides universal access to data and information resulting from research and development activities funded by the Department of Energy (DOE). The GDR has extended this universal access to big data through integration with data lakes developed by the Open Energy Data Initiative (OEDI). Previously, large datasets such as seismic waveform or distributed acoustic sensing (DAS) data could only be accessed by institutions with high performance data storage and compute capabilities, effectively limiting the accessibility of big data to national labs, larger universities, and major corporations. Moreover, the time and resources needed to transport big data and configure them can produce additional barriers to use. Many of the standard formats used for structured data models (also known as content models) are incapable of handling big data and can introduce additional usability problems, often requiring data to be reformatted prior to use. This paper will explore how recent integrations between the GDR and the OEDI data lake have improved the accessibility and usability of geothermal data in a big way, making the data available to a broader audience, and enabling collaborative analysis and innovation across the greater geothermal industry.

access↗

ESRI applications of GIS technology: Mineral resource development

The application of geographic information systems technology to large scale regional assessment related to mineral resource development, identifying candidate sites for related industry, and evaluating sites for waste disposal is discussed. Efforts to develop data bases were conducted at scales ranging from 1:3,000,000 to 1:25,000. In several instances, broad screening was conducted for large areas at a very general scale with more detailed studies subsequently undertaken in promising areas windowed out of the generalized data base. Increasingly, the systems which are developed are structured as the spatial framework for the long-term collection, storage, referencing, and retrieval of vast amounts of data about large regions. Typically, the reconnaissance data base for a large region is structured at 1:250,000 scale, data bases for smaller areas being structured at 1:25,000, 1:50,000 or 1:63,360. An integrated data base for the coterminous US was implemented at a scale of 1:3,000,000 for two separate efforts.

Derrenbacher, W.↗

Performance of multi level error correction in binary holographic memory

At the Optical Computing Lab in the Jet Propulsion Laboratory (JPL) a binary holographic data storage system was designed and tested with methods of recording and retrieving the binary information. Levels of error correction were introduced to the system including pixel averaging, thresholding, and parity checks. Errors were artificially introduced into the binary holographic data storage system and were monitored as a function of the defect area fraction, which showed a strong influence on data integrity. Average area fractions exceeding one quarter of the bit area caused unrecoverable errors. Efficient use of the available data density was discussed. .

data storage↗

Weekly Solutions of Time-Variable Gravity from 1993 to 2010

The GRACE mission has been highly successful in determining the time-variable gravity field of the Earth, producing monthly or even more frequent solutions (cf. 10-day) solutions using both spherical harmonics and mascons. However the GRACE time series only commences in 2002 - 2003 and a gap of several years may occur in the series before a GRACE follow-on satellite is launched. Satellites tracked by SLR and DORIS have also been used to study time variations in the Earth's gravitational field. These include (most recently) the solutions of Cox and Chao (2002), Cheng et al. (2004, 2007) and Lemoine et al. (2007). In this paper we discuss the development of a new time series of low degree spherical harmonic fields based on the available SLR, DORIS and GPS data. We develop simultaneous solutions for both the geocenter and the low degree harmonics up to 5x5. The solutions integrate data from SLR geodetic satellites (e.g., Lageos1, Lageos2, Starlette, Stella, Ajisai, Larets, Westpac), altimetry satellites (TOPEX/Poseidon, Envisat, Jason-1, Jason-2), and satellites tracked solely by DORIS (e.g. SPOT2-5). We discuss some pertinent aspects of the satellite-specific modeling. We include altimeter crossovers in the weekly solutions where feasible and time permits. The resulting geocenter time series is compared with geophysical model predictions and other independently-derived solutions. Over the GRACE time period the fidelity and consistency with the GRACE solutions are presented.

Lemoine, F.↗

Medical Data Architecture Prototype Development - Summary of Recent Work and Proposed Ideas for Upcoming Work

The Medical Data Architecture (MDA) project supports the Exploration Medical Capability (ExMC) risk to minimize or reduce the risk of adverse health outcomes and decrements in performance due to in-flight medical capabilities on human exploration missions. To mitigate this risk, the ExMC MDA project addresses the technical limitations identified in ExMC Gap Med 07: We do not have the capability to comprehensively process medically-relevant information to support medical operations during exploration missions, and in ExMC Gap Med 10: We do not have the capability to provide computed medical decision support during exploration missions. These gaps recognize the need for a comprehensive medical data management system and the accompanying computational support to provide autonomous medical care during long duration exploration missions. As the MDA matures—including the capability to comprehensively process and discover medically-relevant information to support medical operations during exploration missions—project focus will shift to maturing and extending the MDA platform to enable clinical decision support and real-time guidance. To date, the MDA foundational architecture has recommended exploration medical system Level of Care IV requirements through a series of test bed prototype developments and analog demonstrations. The next stage in the development will focus on more autonomous clinical decision making necessary to address challenges in executing a self-contained medical system that enables health care both with and without assistance from ground support. A thorough understanding of current state of medical decision support systems, advanced machine learning algorithms and vast and varied data sources is required. The development of a clinical decision support for exploration missions (Level of Care V) roadmap is needed: one that assesses of current state of the art of clinical decision support systems (CDSS), interoperability issues, identification of challenges in health and performance monitoring, obtaining and processing information from biosensors, knowledge and data management, data integration and fusion, and advanced algorithm development. This roadmap must also include rapid prototype development in the areas of data processing, advanced analysis and prediction of medical events, and treatment based on medically relevant information processing and evidence-based best practices. In this presentation, an overview of the relevant issues and the beginning framework of a Level of Care V CDSS development roadmap will be provided.

Krihak, M.↗

Full-Scale Soft-Sensor Implementations Enable WRRF Hybrid Digital-Twins

Digital twins (DTs) are on the rise in the wastewater treatment industry and, with ever-increasinguse of online data in more complex applications, it is bringing us towards a digital revolution withinwater resource recovery facilities (WRRFs). An integral data requirement is dynamic real-timeinfluent concentrations. However, few WRRFs have the ability to deploy sensors to generate therequired dynamic influent concentrations. This paper presents an innovative approach to generatedynamic influent profiles with a soft sensor primarily using bioreactor airflow rates and DT models.It has been implemented on three different full-scale facilities and demonstrate it is feasible toretrieve 15-minute interval diurnal influent concentrations. This study overcomes a key bottleneckin DT applications - the lack of realistic high-resolution influent profiles - fostering the developmentof DTs. The fact that the data used in this study are commonly available ensures wide applicabilityfor most WRRFs and prepares them for the advanced controls that digital twins can unlock.

Johnson, Bruce↗

An Integrated Analysis-Test Approach

This viewgraph presentation provides an overview of a project to develop a computer program which integrates data analysis and test procedures. The software application aims to propose a new perspective to traditional mechanical analysis and test procedures and to integrate pre-test and test analysis calculation methods. The program also should also be able to be used in portable devices and allows for the 'quasi-real time' analysis of data sent by electronic means. Test methods reviewed during this presentation include: shaker swept sine and random tests, shaker shock mode tests, shaker base driven model survey tests and acoustic tests.

Kaufman, Daniel↗

Towards the Interoperability of Web, Database, and Mass Storage Technologies for Petabyte Archives

At the San Diego Supercomputer Center, a massive data analysis system (MDAS) is being developed to support data-intensive applications that manipulate terabyte sized data sets. The objective is to support scientific application access to data whether it is located at a Web site, stored as an object in a database, and/or storage in an archival storage system. We are developing a suite of demonstration programs which illustrate how Web, database (DBMS), and archival storage (mass storage) technologies can be integrated. An application presentation interface is being designed that integrates data access to all of these sources. We have developed a data movement interface between the Illustra object-relational database and the NSL UniTree archival storage system running in a production mode at the San Diego Supercomputer Center. With this interface, an Illustra client can transparently access data on UniTree under the control of the Illustr DBMS server. The current implementation is based on the creation of a new DBMS storage manager class, and a set of library functions that allow the manipulation and migration of data stored as Illustra 'large objects'. We have extended this interface to allow a Web client application to control data movement between its local disk, the Web server, the DBMS Illustra server, and the UniTree mass storage environment. This paper describes some of the current approaches successfully integrating these technologies. This framework is measured against a representative sample of environmental data extracted from the San Diego Ba Environmental Data Repository. Practical lessons are drawn and critical research areas are highlighted.

Moore, Reagan↗

An open-source framework for simulation-based testing of buildings control strategies

Here this paper presents a simulation framework for evaluating building control strategies (BCSs), developed with VOLTTRON, an opensource platform that integrates data, devices, and systems for sensing and control applications, and is based on co-simulation interfaces. It realizes an integrated environment for both testing and deploying BCSs, thereby eliminating the need for having a dedicated implementation of BCS for testing. For the first time, this framework provides critical functionalities, including scalable communication management and time-drive simulation advance, i.e., advancing the simulation based on clock time. We applied this framework to evaluating two BCSs from ASHRAE Guideline 36-2008 and ASHRAE Standard 90.1-2019. The evaluation results show that those BCSs primarily benefit the heating operation by reducing gas usage but yield insignificant savings in electricity consumption. The results also emphasize the importance of tuning the parameters of the BCSs to achieve better performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Running an open experiment: transparency and reproducibility in soil and ecosystem science

Researchers in soil and ecosystem science, and almost every other field, are being pushed--by funders, journals, governments, and their peers--to increase transparency and reproducibility of their work. A key part of this effort is a move towards open data as a way to fight post-publication data loss, improve data and code quality, enable powerful meta- and cross-disciplinary analyses, and increase trust in, and the efficiency of, publicly-funded research. Many scientists however lack experience in, and may be unsure of the benefits of, making their data and fully-reproducible analyses publicly available. Here we describe a recent "open experiment", in which we documented every aspect of a soil incubation online, making all raw data, scripts, diagnostics, final analyses, and manuscripts available in real time. We found that using tools such as version control, issue tracking, and open-source statistical software improved data integrity, accelerated our team's communication and productivity, and ensured transparency. There are many avenues to improve scientific reproducibility and data availability, of which is this only one example, and it is not an approach suited for every experiment or situation. Nonetheless, we encourage the communities in our respective fields to consider its advantages, and to lead rather than follow with respect to scientific reproducibility, transparency, and data availability.

global change↗

CSISAR--Complete System Integrated SAR

The CSISAR tool is GUI based and very simple to use. The algorithms are robust, and the unique processing flows, that the user is stepped through, virtually eliminate the possibility of error in GEOINT production. An integrated data manager is a key part of the CSISAR system. This data manager keeps track of the data available to a user and informs the user of what data is available and what can be done with that data. This keeps the user from having to be trained in the nuances of the algorithms. CSISAR also has an integrated product manager, which helps the user identify, view and manage previously made products. CSISAR was originally developed in 2010-2011 as a Windows based system. It was updated in 2015 to be a Linux based system. This SAND report is intended to make the Product Description and User’s Guide for CSISAR (originally included within the software) more widely available. New is a brief addition of Linux-specific installation details.

97 MATHEMATICS AND COMPUTING↗

Dynamic CCS-EJ-SJ Database and Web Application - What's New

At the 2024 FECM/NETL Carbon Management Research Project Review Meeting, within the Carbon Transport and Storage Breakout Session 3, the presentation "Dynamic CCS-EJ-SJ Database and Web Application - What's New" highlights the critical tool designed to integrate environmental and social justice considerations into Carbon Capture and Storage (CCS) projects. Key features include an interactive dashboard for data access and visualization, which supports stakeholders in making informed decisions regarding CCS implementation, and updated data layers. The latest version enhances data integration and usability, providing a comprehensive resource for assessing the social and environmental impacts of CCS projects. There are 7 categories in the CCS EJSJ v2 database (released 03/31/2024): environmental justice, energy justice, economic justice, social justice, ecosystem assets, clean energy, and infrastructure. Most of the layers within each category have been updated in this version. As compared to the old database, there are 3 new categories in the v2 database: ecosystem assets, clean energy, and infrastructure.

Sharma, Maneesh↗

Telemetry packetization for improved mission operations

The requirements for mission-operations data management will accelerate sharply when the Space Transportation System (i.e., Space Shuttle) becomes the primary vehicle for research from space. These demands can be satisfied most effectively by providing a higher-level source encoding function within the spaceborne vehicle. An Instrument Telemetry Packet (ITP) concept is described which represents an alternative to the conventional multiplexed telemetry frame approach for acquiring spaceborne instrument data. By providing excellent data-integrity protection at the source and a variable instrument bandwidth capability, this ITP concept represents a significant improvement over present data acquisition procedures. Realignments in the ground telemetry processing functions are described which are intended to take advantage of the ITP concept and to make the data management system more responsive to the scientific investigators.

Greene, E. P.↗

The Citizens and Remote Sensing Observational Network (CARSON) Guide: Merging NASA Remote Sensing Data with Local Environmental Awareness

"Citizen science" generally refers to observatoinal research and data collection conducted by non-professionals, commonly as volunteers. In the environmental science field, citizen scientists may be involved with local nad regional issues such as bird and wildlife populations, weather, urban sprawl, natural hazards, wetlands, lakes and rivers, estuaries, and a spectrum of public health concerns. Some citizen scientists may be primarily motivated by the intellectual challenge of scientific observations. Citizen scientists may now examine and utilize remote-sensing data related to their particular topics of interest with the easy-to-use NASA Web-based tools Giovanni and NEO, which allow exploration and investigation of a wide variety of Earth remote sensing data sets. The CARSON (Citizens and Remote Sensing Observational Network) Guide will be an online resource consisting of chapters each demonstrating how to utilize Giovanni and NEO to access and analyze specific remote-sensing data. Integrated in each chapter will be descriptions of methods that citizen scientists can employ to collect, monitor, analyze, and share data related to the chapter topic which pertain to environmental and ecological conditions in their local region. A workshop held in August 2008 initiated the development of prototype chapters on water quality, air quality, and precipitation. These will be the initial chapters in the first release of the CARSON Guide, which will be used in a pilot project at the Maryland Science Center in spring 2009. The goal of the CARSON Guide is to augment and enhance citizen scientist environmental research with NASA satellite data by creating a participatory network consisting of motivated individuals, environmental groups and organizations, and science-focused institutions such as museuma and nature centers. Members of the network could potentially interact with government programs, academic research projects, and not-for-profit organizations focused on environmental issues.

Acker, James↗