SEARCH · Search NASA

Results for “Distributed Data Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

NASA NTRS2001

The State of NASA's Information Power Grid

This viewgraph presentation transfers the concept of the power grid to information sharing in the NASA community. An information grid of this sort would be characterized as comprising tools, middleware, and services for the facilitation of interoperability, distribution of new technologies, human collaboration, and data management. While a grid would increase the ability of information sharing, it would not necessitate it. The onus of utilizing the grid would rest with the users.

Johnston, William E.↗

NASA NTRS2016

Implementing Connected Component Labeling as a User Defined Operator for SciDB

We have implemented a flexible User Defined Operator (UDO) for labeling connected components of a binary mask expressed as an array in SciDB, a parallel distributed database management system based on the array data model. This UDO is able to process very large multidimensional arrays by exploiting SciDB's memory management mechanism that efficiently manipulates arrays whose memory requirements far exceed available physical memory. The UDO takes as primary inputs a binary mask array and a binary stencil array that specifies the connectivity of a given cell to its neighbors. The UDO returns an array of the same shape as the input mask array with each foreground cell containing the label of the component it belongs to. By default, dimensions are treated as non-periodic, but the UDO also accepts optional input parameters to specify periodicity in any of the array dimensions. The UDO requires four stages to completely label connected components. In the first stage, labels are computed for each subarray or chunk of the mask array in parallel across SciDB instances using the weighted quick union (WQU) with half-path compression algorithm. In the second stage, labels around chunk boundaries from the first stage are stored in a temporary SciDB array that is then replicated across all SciDB instances. Equivalences are resolved by again applying the WQU algorithm to these boundary labels. In the third stage, relabeling is done for each chunk using the resolved equivalences. In the fourth stage, the resolved labels, which so far are "flattened" coordinates of the original binary mask array, are renamed with sequential integers for legibility. The UDO is demonstrated on a 3-D mask of O(1011) elements, with O(108) foreground cells and O(106) connected components. The operator completes in 19 minutes using 84 SciDB instances.

UDO↗

NASA NTRS1993

NASA Langley Research Center's distributed mass storage system

There is a trend in institutions with high performance computing and data management requirements to explore mass storage systems with peripherals directly attached to a high speed network. The Distributed Mass Storage System (DMSS) Project at NASA LaRC is building such a system and expects to put it into production use by the end of 1993. This paper presents the design of the DMSS, some experiences in its development and use, and a performance analysis of its capabilities. The special features of this system are: (1) workstation class file servers running UniTree software; (2) third party I/O; (3) HIPPI network; (4) HIPPI/IPI3 disk array systems; (5) Storage Technology Corporation (STK) ACS 4400 automatic cartridge system; (6) CRAY Research Incorporated (CRI) CRAY Y-MP and CRAY-2 clients; (7) file server redundancy provision; and (8) a transition mechanism from the existent mass storage system to the DMSS.

Pao, Juliet Z.↗

NASA NTRS2007

Software Framework for Peer Data-Management Services

Object Oriented Data Technology (OODT) is a software framework for creating a Web-based system for exchange of scientific data that are stored in diverse formats on computers at different sites under the management of scientific peers. OODT software consists of a set of cooperating, distributed peer components that provide distributed peer-to-peer (P2P) services that enable one peer to search and retrieve data managed by another peer. In effect, computers running OODT software at different locations become parts of an integrated data-management system.

Hughes, John↗

NASA NTRS1993

A Spatial Analysis and Modeling System (SAMS) for environment management

This is a proposal to develop a uniform global environmental data gathering and distribution system to support the calibration and validation of remotely sensed data. SAMS is based on an enhanced version of FEMA's Integrated Emergency Management Information Systems and the Department of Defense's Air land Battlefield Environment Software Systems. This system consists of state-of-the-art graphics and visualization techniques, simulation models, database management and expert systems for conducting environmental and disaster preparedness studies. This software package will be integrated into various Landsat and UNEP-GRID stations which are planned to become direct readout stations during the EOS (Earth Observing System) timeframe. This system would be implemented as a pilot program to support the Tropical Rainfall Measuring Mission (TRMM). This will be a joint NASA-FEMA-University-Industry project.

Stetina, Fran↗

NASA NTRS1985

Space station power management and distribution

The power system architecture is presented by a series of schematics which illustrate the power management and distribution (PMAD) system at the component level, including converters, controllers, switchgear, rotary power transfer devices, power and data cables, remote power controllers, and load converters. Power distribution options, reference power management, and control strategy are also outlined. A summary of advanced development status and plans and an overview of system test plans are presented.

Teren, F.↗

NASA NTRS2006

Mapping the Rainforest of the Sea: Global Coral Reef Maps for Global Conservation

Coral reefs are the center of marine biodiversity, yet are under threat with an estimated 60% of coral reef habitats considered at risk by the World Resources Institute. The location and extent of coral reefs in the world are the basic information required for resource management and as a baseline for monitoring change. A NASA sponsored partnership between remote sensing scientists, international agencies and NGOs, has developed a new generation of global reef maps based on data collected by satellites. The effort, dubbed the Millennium Coral Reef Map aims to develop new methods for wide distribution of voluminous satellite data of use to the conservation and management communities. We discuss the tradeoffs between remote sensing data sources, mapping objectives, and the needs for conservation and resource management. SeaWiFS data were used to produce a composite global shallow bathymetry map at 1 km resolution. Landsat 7/ETM+ data acquisition plans were modified to collect global reefs and new operational methods were designed to generate the firstever global coral reef geomorphology map. We discuss the challenges encountered to build these databases and in implementing the geospatial data distribution strategies. Conservation applications include a new assessment of the distribution of the world s marine protected areas (UNEPWCMC), improved spatial resolution in the Reefs at Risk analysis for the Caribbean (WRI), and a global basemap for the Census of Marine Life's OBIS database. The Millennium Coral Reef map and digital image archive will pay significant dividends for local and regional conservation projects around the globe. Complete details of the project are available at http://eol.jsc.nasa.gov/reefs.

Robinson, Julie A.↗

NASA NTRS1992

VIEWCACHE: An incremental pointer-based access method for autonomous interoperable databases

One of biggest problems facing NASA today is to provide scientists efficient access to a large number of distributed databases. Our pointer-based incremental database access method, VIEWCACHE, provides such an interface for accessing distributed data sets and directories. VIEWCACHE allows database browsing and search performing inter-database cross-referencing with no actual data movement between database sites. This organization and processing is especially suitable for managing Astrophysics databases which are physically distributed all over the world. Once the search is complete, the set of collected pointers pointing to the desired data are cached. VIEWCACHE includes spatial access methods for accessing image data sets, which provide much easier query formulation by referring directly to the image and very efficient search for objects contained within a two-dimensional window. We will develop and optimize a VIEWCACHE External Gateway Access to database management systems to facilitate distributed database search.

Roussopoulos, N.↗

NASA NTRS2018

NASA's Earth Observing Data and Information System - Near-Term Challenges

NASA's Earth Observing System Data and Information System (EOSDIS) has been a central component of the NASA Earth observation program since the 1990's. EOSDIS manages data covering a wide range of Earth science disciplines including cryosphere, land cover change, polar processes, field campaigns, ocean surface, digital elevation, atmosphere dynamics and composition, and inter-disciplinary research, and many others. One of the key components of EOSDIS is a set of twelve discipline-based Distributed Active Archive Centers (DAACs) distributed across the United States. Managed by NASA's Earth Science Data and Information System (ESDIS) Project at Goddard Space Flight Center, these DAACs serve over 3 million users globally. The ESDIS Project provides the infrastructure support for EOSDIS, which includes other components such as the Science Investigator-led Processing systems (SIPS), common metadata and metrics management systems, specialized network systems, standards management, and centralized support for use of commercial cloud capabilities. Given the long-term requirements, and the rapid pace of information technology and changing expectations of the user community, EOSDIS has evolved continually over the past three decades. However, many challenges remain. Challenges addressed in this paper include: growing volume and variety, achieving consistency across a diverse set of data producers, managing information about a large number of datasets, migration to a cloud computing environment, optimizing data discovery and access, incorporating user feedback from a diverse community, keeping metadata updated as data collections grow and age, and ensuring that all the content needed for understanding datasets by future users is identified and preserved.

Remote Sensing↗

NASA NTRS1992

A Spatial Analysis and Modeling System (SAMS) for environment management

This is a proposal to develop a uniform global environmental data gathering and distribution system to support the calibration and validation of remotely sensed data. SAMS is based on an enhanced version of FE MA's Integrated Emergency Management Information Systems and the Department of Defense's Air Land Battlefield Environment Software Systems. This system consists of state-of-the-art graphics and visualization techniques, simulation models, database management and expert systems for conducting environmental and disaster preparedness studies. This software package will be integrated into various Landsat and UNEP-GRID stations which are planned to become direct readout stations during the EOS timeframe. This system would be implemented as a pilot program to support the Tropical Rainfall Measuring Mission (TRMM). This will be a joint NASA-FEMA-University-Industry project.

Vermillion, Charles H.↗

NASA NTRS2007

Program Management Tool

The Program Management Tool (PMT) is a comprehensive, Web-enabled business intelligence software tool for assisting program and project managers within NASA enterprises in gathering, comprehending, and disseminating information on the progress of their programs and projects. The PMT provides planning and management support for implementing NASA programmatic and project management processes and requirements. It provides an online environment for program and line management to develop, communicate, and manage their programs, projects, and tasks in a comprehensive tool suite. The information managed by use of the PMT can include monthly reports as well as data on goals, deliverables, milestones, business processes, personnel, task plans, monthly reports, and budgetary allocations. The PMT provides an intuitive and enhanced Web interface to automate the tedious process of gathering and sharing monthly progress reports, task plans, financial data, and other information on project resources based on technical, schedule, budget, and management criteria and merits. The PMT is consistent with the latest Web standards and software practices, including the use of Extensible Markup Language (XML) for exchanging data and the WebDAV (Web Distributed Authoring and Versioning) protocol for collaborative management of documents. The PMT provides graphical displays of resource allocations in the form of bar and pie charts using Microsoft Excel Visual Basic for Application (VBA) libraries. The PMT has an extensible architecture that enables integration of PMT with other strategic-information software systems, including, for example, the Erasmus reporting system, now part of the NASA Integrated Enterprise Management Program (IEMP) tool suite, at NASA Marshall Space Flight Center (MSFC). The PMT data architecture provides automated and extensive software interfaces and reports to various strategic information systems to eliminate duplicative human entries and minimize data integrity issues among various NASA systems that impact schedules and planning.

Gawadiak, Yuri↗

NASA NTRS1990

Multi-terabyte image storage and distribution for NASA's Hubble Space Telescope

The modular architecture, functionality, and key components of the Hubble Space Telescope Data Archive Distribution Service (DADS) are presented. DADS functions comprise archive management, catalog management, and user interface. The distributed modular architecture utilized is made up of four subsystems, including the archive, host, catalog, and the Science Operations ground System/DADS Interface Processor. All data generated by the HST are archived in DADS on 12-in. optical disks. DADS is a permanent archive with a data capacity of 30 terabytes that can be expanded to 68 terabytes. Supplementary information and stellar observations will be instantly accessible through DADS, which can collect and archive more than 3 gigabytes per day of image and support data over the lifetime of the HST. Electronic and physical media will be accessible through 140 network connections, with a catalogue to assist in data set selection.

Weller, H. W., Jr.↗

NASA NTRS2017

Archive Management of NASA Earth Observation Data to Support Cloud Analysis

NASA collects, processes and distributes petabytes of Earth Observation (EO) data from satellites, aircraft, in situ instruments and model output, with an order of magnitude increase expected by 2024. Cloud-based web object storage (WOS) of these data can simplify the execution of such an increase. More importantly, it can also facilitate user analysis of those volumes by making the data available to the massively parallel computing power in the cloud. However, storing EO data in cloud WOS has a ripple effect throughout the NASA archive system with unexpected challenges and opportunities. One challenge is modifying data servicing software (such as Web Coverage Service servers) to access and subset data that are no longer on a directly accessible file system, but rather in cloud WOS. Opportunities include refactoring of the archive software to a cloud-native architecture; virtualizing data products by computing on demand; and reorganizing data to be more analysis-friendly. Reviewed by Mark McInerney ESDIS Deputy Project Manager.

Lynnes, Christopher↗

NASA NTRS2004

Swift Gamma-Ray Burst Explorer: Mission Design for Rapid, Accurate Location of Gamma-ray Bursts

The Swift Gamma-ray Burst Explorer is a NASA Mid-sized Explorer (MIDEX) with the primary mission of determining the origins of Gamma-Ray Bursts (GRBs). It will be the first mission to autonomously respond to newly-discovered GRBs and provide immediate follow-up narrow field instruments capable of multi-wavelength (UV, Optical, X-ray) observations. The characteristics of GRBs that are the key mission design drivers, are their non-repeating and brief duration bursts of multi-wavelength photons. In addition, rapid notification of the location and characteristics of the GRBs to ground-and-space- based observatories drive the end-to-end data analysis and distribution requirements. The Swift mission is managed by the GSFC, and includes an international team of contributors that each bring their unique perspective that have proven invaluable to the mission. The spacecraft bus, provided by Spectrum Astro, Inc. was procured through a Rapid Spacecraft Development Office (RSDO) contract by the GSFC. There are three instruments: the Burst Alert Telescope (BAT) provided by the GSFC; the X-Ray Telescope (XRT) provided by a team led by the Pennsylvania State University (PSU); and the Ultra-Violet Optical Telescope (UVOT), again managed by PSU. The Mission Operations Center (MOC) was developed by and is located at PSU. Science archiving and data analysis centers are located at the GSFC, in the UK and in Italy.

Bundas, David J.↗

NASA NTRS1978

NASA and the U.S. climate program - A problem in data management

NASA's contribution to the total data base for the National Climate Plan will be to produce climate data sets from its experimental space observing systems and to maximize the value of these data for climate analysis and prediction. Validated data sets will be provided to NOAA for inclusion into their overall diagnostic data base. NASA data management for the Climate Plan will involve: (1) cataloging and retrieval of large integrated and distributed data sets upon user demand, and (2) the storage equivalent of 100,000 digital data tapes. It will be the largest, most complex data system ever developed by NASA

Quann, J. J.↗

NASA NTRS1991

Network interface unit design options performance analysis

An analysis is presented of three design options for the Space Station Freedom (SSF) onboard Data Management System (DMS) Network Interface Unit (NIU). The NIU provides the interface from the Fiber Distributed Data Interface (FDDI) local area network (LAN) to the DMS processing elements. The FDDI LAN provides the primary means for command and control and low and medium rate telemetry data transfers on board the SSF. The results of this analysis provide the basis for the implementation of the NIU.

Miller, Frank W.↗

NASA NTRS1988

Artificial intelligence approaches in space power systems automation at Marshall Space Flight Center

Various applications of AI to spacecraft electrical power systems are described. Particular attention is given to NICBES (nickel-cadmium battery expert system which is interfaced with the Hubble Space Telescope electrical power system test bed); the SSES; the three cooperating AI systems in the Space Station module power management and distribution system test bed; and I-DARE, the intelligent data reduction expert. It is found that the utilization of AI approaches permits comprehensive fault management and dynamic rescheduling capabilities for the electrical power system.

Weeks, David J.↗

NASA NTRS2004

Application of Bayesian Classification to Content-Based Data Management

The high volume of Earth Observing System data has proven to be challenging to manage for data centers and users alike. At the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC), about 1 TB of new data are archived each day. Distribution to users is also about 1 TB/day. A substantial portion of this distribution is MODIS calibrated radiance data, which has a wide variety of uses. However, much of the data is not useful for a particular user's needs: for example, ocean color users typically need oceanic pixels that are free of cloud and sun-glint. The GES DAAC is using a simple Bayesian classification scheme to rapidly classify each pixel in the scene in order to support several experimental content-based data services for near-real-time MODIS calibrated radiance products (from Direct Readout stations). Content-based subsetting would allow distribution of, say, only clear pixels to the user if desired. Content-based subscriptions would distribute data to users only when they fit the user's usability criteria in their area of interest within the scene. Content-based cache management would retain more useful data on disk for easy online access. The classification may even be exploited in an automated quality assessment of the geolocation product. Though initially to be demonstrated at the GES DAAC, these techniques have applicability in other resource-limited environments, such as spaceborne data systems.

Lynnes, Christopher↗