Search NASA⌕ Search

SEARCH · Search NASA

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

The COLD-SAT Experiment for Cryogenic Fluid Management Technology

Future national space transportation missions will depend on the use of cryogenic fluid management technology development needs for these missions. In-space testing will be conducted in order to show low gravity cryogenic fluid management concepts and to acquire a technical data base. Liquid H2 is the preferred test fluid due to its propellant use. The design of COLD-SAT (Cryogenic On-orbit Liquid Depot Storage, Acquisition, and Transfer Satellite), an Expendable Launch Vehicle (ELV) launched orbital spacecraft that will perform subcritical liquid H2 storage and transfer experiments under low gravity conditions is studied. An Atlas launch vehicle will place COLD-SAT into a circular orbit, and the 3-axis controlled spacecraft bus will provide electric power, experiment control, and data management, attitude control, and propulsive accelerations for the experiments. Low levels of acceleration will provide data on the effects that low gravity might have on the heat and mass transfer processes used. The experiment module will contain 3 liquid H2 tanks; fluid transfer, pressurization and venting equipment; and instrumentation.

Schuster, J. R.↗
NASA NTRSDate not supplied

Supporting Global Air Quality Management Needs With A Flexible Data Fusion Tool for Estimation and Forecasting in Google Earth Engine

High spatial and temporal resolution air quality estimation and forecasting can be enhanced by combining global data sources, like chemical transport models and satellite remote sensing, with local information from regulatory and low-cost air quality monitors. Successful integration of data from these diverse sources is complicated by many factors, however, including differences in spatial and temporal resolution, data availability and latency issues, varying data quality, and large computational and data storage requirements. This presentation will provide an overview of a NASA-funded effort to develop the foundation for future operationalization of air quality forecasting for world-wide end-users and integration into their air quality management decision processes, which will be achieved in future phases of this multi-year project. We will summarize our progress in developing a data fusion system using the Google Earth Engine platform which can integrate model, satellite, and surface-level monitoring datasets to enhance estimation and forecasting of air-quality-relevant pollutants at sub-daily and sub-city scales. The tool is being developed in close cooperation with several city- and regional-level air quality managers in the USA and around the world. Our end-goal is to provide these air quality managers with the information they need to assess and anticipate the impacts of poor air quality, track changes in air quality due to ongoing mitigation efforts and land use changes, and identify ways to improve their air quality monitoring strategies. This presentation will focus on recent advances achieved through the project, including integration of multiple air quality datasets in a prototype data fusion system in Google Earth Engine, the quantification of uncertainties associated with our data fusion approach, and the development of user interfaces and visualization tools to convey air quality information in a way which best meets end-user needs.

Carl Malings↗
NASA NTRSDate not supplied

Supporting Global Air Quality Management Needs With A Flexible Data Fusion Tool for Estimation and Forecasting in Google Earth Engine

High spatial and temporal resolution air quality estimation and forecasting can be enhanced by combining global data sources, like chemical transport models and satellite remote sensing, with local information from regulatory and low-cost air quality monitors. Successful integration of data from these diverse sources is complicated by many factors, however, including differences in spatial and temporal resolution, data availability and latency issues, varying data quality, and large computational and data storage requirements. This presentation will provide an overview of a NASA-funded effort to develop the foundation for future operationalization of air quality forecasting for world-wide end-users and integration into their air quality management decision processes, which will be achieved in future phases of this multi-year project. We will summarize our progress in developing a data fusion system using the Google Earth Engine platform which can integrate model, satellite, and surface-level monitoring datasets to enhance estimation and forecasting of air-quality-relevant pollutants at sub-daily and sub-city scales. The tool is being developed in close cooperation with several city- and regional-level air quality managers in the USA and around the world. Our end-goal is to provide these air quality managers with the information they need to assess and anticipate the impacts of poor air quality, track changes in air quality due to ongoing mitigation efforts and land use changes, and identify ways to improve their air quality monitoring strategies. This presentation will focus on recent advances achieved through the project, including integration of multiple air quality datasets in a prototype data fusion system in Google Earth Engine, the quantification of uncertainties associated with our data fusion approach, and the development of user interfaces and visualization tools to convey air quality information in a way which best meets end-user needs.

Carl Malings↗
NASA NTRS1975

CARETS: A prototype regional environmental information system. Volume 3: Toward a national land use information system

It is recommended that a national land use information system be established by an agency of the Federal Government. This recommendation comes at a time of increasing demand for scientific information in support of environmentally relevant land use planning and management at all levels of government. It is also a time when new airborne and spaceborne remote sensors, tested in cooperation with the National Aeronautics and Space Administration (NASA) and the Earth Resources Observation Systems (EROS) Program of the Department of the Interior, make possible the gathering of land use information rapidly and on an unprecedented scale. Furthermore, information handling technology is developing toward a capability to receive, store, and disseminate the huge quantities of data that would be involved. The recommendation for the national land use information system is based upon careful analysis of the results of remote sensing experiments funded by NASA, EROS, and the Geography Program of the Geological Survey, with specific examples drawn from the demonstration project known as the Central Atlantic Regional Ecological Test Site (CARETS). CARETS is cast in the framework of a regional land use information system, channeling the flow bf information generated in response to users' declaration of their needs, through stages dealing with remote sensing data gathering systems, data processing and land mensuration, calibration in-terms of environmental impact, and evaluation with feedback from users. The proposed system would develop and implement a unified approach to the description and interpretation of the changing uses of the nation's land resources, building upon the base of interagency and intergovernmental cooperation already achieved in the experimental work to date. The land use data base that is being derived from high-altitude aerial color infrared photography would be the initial component of the recommended system. High-altitude photographic coverage would immediately be extended to as much of the nation as possible as technological developments and economic considerations permit. The system would later expand to include multiple-sensor, multiple-platform data sources. Six system characteristics are recommended: (1) High capacity storage of data available for quick retrieval, inexpensive processing, and update, (2) provision of accuracy appropriate to the scale of survey or to the level of detail dictated by different types of management and decision requirements; (3) permanent, publicly accessible sensor records for historical interpretation; (4) compatibility of the recording, storage, and retrieval system with all types of inputs, from ground observer to satellite; (5) products of diverse formats and scales, responsive to user feedback; (6) and standardization of formats, scales, and storage inputs to permit nationwide comparability.

Land use mapping↗
NASA NTRS1993

ICI optical data storage tape: An archival mass storage media

At the 1991 Conference on Mass Storage Systems and Technologies, ICI Imagedata presented a paper which introduced ICI Optical Data Storage Tape. This paper placed specific emphasis on the media characteristics and initial data was presented which illustrated the archival stability of the media. More exhaustive analysis that was carried out on the chemical stability of the media is covered. Equally important, it also addresses archive management issues associated with, for example, the benefits of reduced rewind requirements to accommodate tape relaxation effects that result from careful tribology control in ICI Optical Tape media. ICI Optical Tape media was designed to meet the most demanding requirements of archival mass storage. It is envisaged that the volumetric data capacity, long term stability and low maintenance characteristics demonstrated will have major benefits in increasing reliability and reducing the costs associated with archival storage of large data volumes.

Ruddick, Andrew J.↗
NASA NTRS2016

Biospecimen Culling: Temporal RNA Integrity Analysis Across Spaceflight Missions Dating from 1985 to 2011

The Ames Life Science Data Archive (ALSDA) at NASA Ames Research Center is managed by the Space Biosciences Division and has been operational since 1993. The ALSDA is responsible for archiving information and biospecimens collected from life science spaceflight experiments and matching ground control experiments. They are stored in the Ames biobank, which is located in the Biospecimen Storage Facility (BSF). The ALSDA also manages a Biospecimen Sharing Program, performs curation and long-term storage operations, and makes biospecimens available to the scientific community for research purposes via the Life Science Data Archive public website (https:lsda.jsc.nasa.gov). The BSF maintains both fixed and frozen spaceflight and ground tissues, collected from recent and past spaceflight missions. Due to the ever increasing demand for space to preserve current and future flight biospecimens, the ALSDA has initiated the development of a culling plan for biospecimens currently stored in the BSF. Culling enables the ALSDA to assess the quality of archived samples, and supports the development of standardized culling procedures that improve the operational efficiency of the BSF. The culling plan focuses on generating disposition recommendations for samples in the BSF, and currently is based on measuring ribonucleic acid (RNA) integrity number (RIN). The culling process includes (1) sorting and identification of candidate samples for RIN analysis, (2) completion of RIN analysis on select samples, and (3) development of disposition recommendations for specimens based on the RIN values. Furthermore, our approach allows for unique scientific opportunities, including development of a RIN-based methodology for culling, and temporal assessment of the quality of the tissues that have been stored in BSF since the 1980s. Results of this work will also support NASA open science initiatives.

biospecimen↗
DOE OSTI2025

DoCeph: DPU-Offloaded Messaging in Ceph for Reduced Host CPU Utilization

Ceph is a widely used distributed object store, but its messenger layer imposes substantial CPU overhead on the host. To address this limitation, we propose DoCeph, a DPU-offloaded storage architecture for Ceph that disaggregates the system by offloading the communication-intensive messaging component to the DPU while retaining the storage backend on the host. The DPU efficiently manages communication, using lightweight RPC for metadata operations and DMA for data transfer. Moreover, DoCeph introduces a pipelining technique that overlaps data transmission with buffer preparation, mitigating hardware-imposed transfer size limitations. We implemented DoCeph on a Ceph cluster with NVIDIA BlueField-3 DPUs. Evaluation results indicate that DoCeph cuts host CPU usage by up to 92% while sustaining stable throughput and providing larger performance benefits for object writes over 1 MB.

Park, Kuri [Sogang University]↗
DOE OSTI2024

Efficient Dimension Reduction of Complex Three-dimensional CO2 Saturation using Deep Learning Models

In the domain of deep learning (DL), dimension reduction is crucial for enhancing training efficiency and mitigating overfitting, particularly when managing complex data such as three-dimensional (3D) saturation data. The 3D saturation data in the context of geological carbon storage (GCS) presents unique challenges due to its inherent sparsity and the abrupt transitions at plume boundaries, known as shock fronts. To address the challenges, we proposed a novel DL framework that integrates dimension reduction with advanced 3D reconstruction techniques. Our model leveraged latent variables derived from 2D average saturation data, offering a robust and efficient solution tailored to the intricate dynamics of 3D saturation fields. The proposed framework can extract the critical features of the high-dimensional data while reducing the variable numbers, which is more tractable for DL models and enhances the model robustness and accuracy. Therefore, it provides a novel approach for modeling and analyses in complex geological scenarios, which finds great potential applications in environmental monitoring and energy storage.

Wang, Hongsheng↗
NASA NTRS1993

Electrical power technology for robotic planetary rovers

Power technologies which will enable a range of robotic rover vehicle missions by the end of the 1990s and beyond are discussed. The electrical power system is the most critical system for reliability and life, since all other on board functions (mobility, navigation, command and data, communications, and the scientific payload instruments) require electrical power. The following are discussed: power generation, energy storage, power management and distribution, and thermal management.

Bankston, C. P.↗
NASA NTRS2018

A Case for Bundle Protocol in Space

NASA, through the Advanced Exploration Systems (AES) project, is investing in the development and infusion of delay tolerant networking (DTN) protocols for use on future space flight missions. The cornerstone of the DTN suite is the Bundle Protocol which provides network layer addressing and routing of data blocks. In 2017, the Plankton, Aerosol, Cloud, and Ocean Ecosystem (PACE) mission was selected as the first in-house robotic science mission to implement the Bundle Protocol for downlink of housekeeping telemetry. One year into the design and incorporation of the Bundle Protocol on PACE, this presentation makes a case for using the Bundle Protocol for communication with future space assets. Specifically, the use of the Bundle Protocol (1) simplifies relaying data through store and forward routing and custody transfer; (2) simplifies downlink management through delivery guarantees; and (3) simplifies storage services through block level interactions with memory devices.

Swinski, J. P.↗
DOE OSTI2026

United States Nuclear Power Reactor Used Nuclear Fuel Database and Applications

The Unified Database (UDB) within STANDARDS serves as the foundational data infrastructure for managing the United States' spent nuclear fuel inventory of 315,111 discharged assemblies totaling 91,036 metric tons of heavy metal. The database organizes this complex inventory through over 200 interconnected tables structured into eight primary attribute categories, supporting integrated analyses across storage, transportation, and disposal domains. Data enters the UDB through the GC-859 Nuclear Fuel Data Survey, which transitioned to web-based collection in 2023, improving data quality through real-time validation. The UDB enables automated generation of input files for nuclear safety analyses, reducing preparation time from weeks to hours while maintaining traceability. Applications include national inventory reporting, Certificate of Compliance assessments, and facility optimization. The three-tier distribution model balances accessibility with security requirements for federal agencies, national laboratories, and research organizations. The UDB provides essential data infrastructure as spent fuel management transitions from site-specific to integrated national campaigns.

Stefanovic, Peter↗
NASA NTRS2005

Capillary Flow Experiments Began on the International Space Station

The Capillary Flow Experiments (CFEs) are a suite of fluid physics flight experiments designed to investigate capillary flows and phenomena in low gravity. Data obtained from the CFEs will be crucial to NASA s Space Exploration Initiative, particularly pertaining to fluids management systems such as fuels and cryogen storage systems, thermal control systems (e.g., water recycling), and materials processing in the liquid state. NASA s current plans for exploration missions assume the use of larger liquid propellant masses than have ever flown on interplanetary missions. Under low-gravity conditions, capillary forces can be exploited to control fluid orientation so that such large mission-critical systems perform predictably. The first of the CFE experiments has been conducted on the International Space Station, and the data are being analyzed. The experiment suite is described briefly.

J. Mark Hickman↗
NASA NTRS1996

SAM-FS: LSC's New Solaris-Based Storage Management Product

SAM-FS is a full featured hierarchical storage management (HSM) device that operates as a file system on Solaris-based machines. The SAM-FS file system provides the user with all of the standard UNIX system utilities and calls, and adds some new commands, i.e. archive, release, stage, sls, sfind, and a family of maintenance commands. The system also offers enhancements such as high performance virtual disk read and write, control of the disk through an extent array, and the ability to dynamically allocate block size. SAM-FS provides 'archive sets' which are groupings of data to be copied to secondary storage. In practice, as soon as a file is written to disk, SAM-FS will make copies onto secondary media. SAM-FS is a scalable storage management system. The system can manage millions of files per system, though this is limited today by the speed of UNIX and its utilities. In the future, a new search algorithm will be implemented that will remove logical and performance restrictions on the number of files managed.

Angell, Kent↗
NASA NTRS1979

The space science data service: A study of its efficiencies and costs

Factors affecting the overall advantages and disadvantages of a centralized facility for both the data base and processing capability for NASA's Office of Space Science programs are examined in an effort to determine the best approach to data management in the light of the increasing number of data bits collected annually. Selected issues considered relate to software and storage savings, security precautions, and the phase-in plan. Information on the current mode of processing and on the potential impact of changes resulting from a conversion to a space science data base service was obtained from five user groups and is presented as an aid in determining the dollar benefits and advantages of a centralized system.

Vette, J. I.↗
NASA NTRS1980

The RSZ BASIC programming language manual

The RSZ BASIC interactive language is described. The RSZ BASIC interpreter is resident in the Telemetry Data Processor, a system dedicated to the processing and displaying of PCM telemetry data. A series of working examples teaches the fundamentals of RSZ BASIC and shows how to construct, edit, and manage storage of programs.

Stattel, R. J.↗
NASA NTRS1993

Volume serving and media management in a networked, distributed client/server environment

The E-Systems Modular Automated Storage System (EMASS) is a family of hierarchical mass storage systems providing complete storage/'file space' management. The EMASS volume server provides the flexibility to work with different clients (file servers), different platforms, and different archives with a 'mix and match' capability. The EMASS design considers all file management programs as clients of the volume server system. System storage capacities are tailored to customer needs ranging from small data centers to large central libraries serving multiple users simultaneously. All EMASS hardware is commercial off the shelf (COTS), selected to provide the performance and reliability needed in current and future mass storage solutions. All interfaces use standard commercial protocols and networks suitable to service multiple hosts. EMASS is designed to efficiently store and retrieve in excess of 10,000 terabytes of data. Current clients include CRAY's YMP Model E based Data Migration Facility (DMF), IBM's RS/6000 based Unitree, and CONVEX based EMASS File Server software. The VolSer software provides the capability to accept client or graphical user interface (GUI) commands from the operator's console and translate them to the commands needed to control any configured archive. The VolSer system offers advanced features to enhance media handling and particularly media mounting such as: automated media migration, preferred media placement, drive load leveling, registered MediaClass groupings, and drive pooling.

Herring, Ralph H.↗
NASA NTRS2021

Scheduling and Operations of the ECOSTRESS Mission

This paper describes the development and use of an automated scheduling system for the National Aeronautics and Space Administration’s (NASA) ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) mission. Key to the success of the ECOSTRESS mission has been the use of automated scheduling in mission analysis pre-launch, and in successful operations where automated scheduling was deployed to address several operational challenges. ECOSTRESS uses an adaptation of the Compressed Large-scale Activity Scheduling and Planning (CLASP) system to automatically select science observations respecting area and point target priorities as well as visibility, illumination, onboard storage, and radiation constraints to satisfy high-level prioritized science campaigns. The ECOSTRESS scheduler was used pre-launch to predict the effectiveness of alternative formulations of science campaign definitions accounting for the impact of data volume, keepout, and orbit/illumination/visibility constraints to derive the initial operational science campaign definitions and priorities. The scheduler was then used after instrument checkout for operations. ECOSTRESS has faced multiple operational challenges relating to instrument firmware and hardware, and the scheduler has been updated several times to address these challenges. The instrument Mass Storage Units (MSUs) had operational issues, requiring the scheduler to plan for and schedule commands to handle intricacies of data management. After many months of operations, both MSUs on the instrument became non-functioning and the firmware of the instrument was updated to bypass the MSUs. A further update to the ECOSTRESS scheduler enabled the scheduler to operate in this new operations mode. The ECOSTRESS scheduler has also been updated to improve handling of along-track uncertainty inherent in International Space Station operations. The flexibility and ease of updating of the automated scheduler has been a significant contributor to successful operations of the ECOSTRESS mission.

Padams, Jordan↗
DOE OSTI2025

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗