Search NASA⌕ Search

SEARCH · Search NASA

Results for “data storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Signal-Conditioning Amplifier Recorders

Signal-conditioning amplifier recorders (SCAmpRs) have been proposed as a means of simplifying and upgrading the Kennedy Space Center (KSC) Ground Measurement System (GMS), which is a versatile data-acquisition system that gathers and records a variety of measurement data before and during the launch of a space shuttle. In the present version of the GMS system, signal conditioning amplifiers digitize and transmit data to a VME chassis that multiplexes up to 416 channels. The data is transmitted via a high-speed data bus to a second VME chassis where it is available for snapshots. The data is passed from the second VME chassis to a high-speed data recorder. This process is duplicated for installations at two launch pads and the Vehicle Assembly Building (VAB). Since any failure of equipment in the data path results in loss of data, much of the system is redundant. The architecture of the existing GMS limits expansion or any modification to the system to meet changing requirements because of the cost and time required. A SCAmpR-based system is much more flexible. The basis of the simplification, flexibility, and reliability is the shifting of the recording function to the individual amplifier channels. Each SCAmpR is a self-contained single channel data acquisition system, which in its current implementation, has a data storage capacity of up to 30 minutes when operating at the fastest data sampling rates. The SCAmpR channels are self-configuring and self-calibrating. Multiple SCAmpR channels are ganged on printed circuit boards and mounted in a chassis that provides power, a network hub, and Inter-Range Instrument Group (IRIG) time signals. The SCAmpR channels share nothing except physical mounting on a circuit board. All circuitry is electrically separate for each channel. All that is necessary to complete the data acquisition system is a single master computer tied to the SCAmpR channels by standard network equipment. The size of the data acquisition system dictates the requirements for the specific network equipment.

Medelius, Pedro J.↗
NASA NTRS1996

Cassini Solid State Recorder: A High Capacity, Radiation Tolerant High-Performance Unit

Onboard the Cassini spacecraft, and the subject of this paper, are two Solid State Recorders designed and built by TRW, Inc., of Redondo Beach, California, for NASA's Jet Propulsion Laboratory. These recorders, which were the first ones designed and selected by NASA for a space program, represent the new frontier and a new beginning for spaceborne data storage.

Cassini↗
NASA NTRS2018

Ka-band High-Rate Downlink System for the NISAR Mission

This paper provides a description and analyses of the high-rate Ka-band telecom system for the upcoming NISAR (NASA-ISRO Synthetic Aperture Radar) mission. NISAR is a collaborative Earth-Science mission between National Aeronautics and Space Administration (NASA) and Indian Space Research Organization (ISRO), which features an L-band SAR instrument and an S-band SAR instrument. The simultaneous dual-frequency radar system at peak rates will produce data at gigabit-per-second speeds, which drives the data-volume requirements. The key driving requirement for the payload communication subsystem is to provide a minimum of 26 Terabits per day of radar science data to the ground. The high-rate transmitter on the flight system is a software-defined radio developed at the Jet Propulsion Laboratory (JPL), based on the Universal Space Transponder platform, providing an offset quadrature phase shift key modulated waveform with Low-Density Parity-Check encoding of the data transfer frames. Two transmitters used in a dual-polarization configuration with each transmitter providing two giga-symbols per second (Gsps) of coded data provides an aggregate rate of four Gsps. In this system, only one watt of signal power is necessary on each polarization to overcome propagation losses and achieve a successful RF link. Several Near Earth Network (NEN) ground station sites (Alaska in the United States, Svalbard in Norway, and Punta Arenas in Chile) are baselined for the space-to-Earth communications link. Each ground station will also feature multiple upgrades to support NISAR’s transmission starting with new Ka-band antennas, wideband downconverters and high-rate receivers. In addition, a baseband data processor called Data Acquisition Processor and Handling Network Environment (DAPHNE), newly developed by the NEN, provides data storage and connectivity to backhaul networks. With NISAR’s large quantities of data (over 3.5 Petabytes over the mission), the processing of science data will be primarily performed on a cloud system to reduce the overall cost to the mission. The system described herein will be the first operational use of Gsps-class downlink rates on an Earth-Science mission.

Dissanayake, Asoka↗
NASA NTRS2021

Montana Water Resources II: Enhancing a Moisture Index for Drought and Flood Monitoring in the Missouri River Basin

The Missouri River Basin is a major global breadbasket, containing large amounts of agricultural land. Recent devastating weather events have motivated regional organizations to dedicate efforts to drought and flood monitoring and early warning systems. The DEVELOP team partnered with the following organizations: Montana Climate Office, NOAA National Weather Service (NWS) Missouri Basin River Forecast Center, NOAA Regional Climate Services of the Central Region, NOAA Physical Sciences Laboratory, and the US Army Corps of Engineers' Missouri River Basin Water Management Division. The team collaborated with the partners in their efforts to monitor flood and drought by enhancing a composite moisture index (CMI) for the Missouri River Basin. The CMI leverages NASA Earth observations to derive snow cover data from the Terra Moderate Resolution Imaging Spectroradiometer (MODIS) mission and snow water equivalent and snowdepth datasets from the NOAA NWS National Operational Hydrologic Remote Sensing Center’s Snow Data Assimilation System (SNODAS). Building upon this framework, the team added groundwater storage data from the Gravity Recovery and Climate Experiment (GRACE) and GRACE Follow-On missions, soil moisture data from Soil Moisture Active Passive (SMAP), and United States Geological Survey in situ streamflow data to the CMI. To test the tool’s validity, the team compared the CMI results to historically extreme dry and extreme wet years, March 2017 and March 2019, respectively. The CMI accurately reflects both 2017 and 2019 climate conditions in the Missouri River Basin. The refined CMI enhances the understanding of antecedent soil moisture conditions and improves flood and drought forecasting in the Missouri River Basin before the growing season.

Chloe Schneider↗
NASA NTRS2022

Europa Clipper Payload Verification and Validation: Avionics-Instrument Interface Test Campaign

NASA's Europa Clipper mission will investigate Jupiter's icy moon Europa using a payload suite consisting of nine instruments to address a range of scientific objectives concerning Europa's habitability. As the project proceeds past its Critical Design Review, confidence is being built in the system's ability to achieve mission objectives through the implementation of a rigorous payload verification and validation (V&V) program. As part of this payload V&V program, instrument box-level testing was performed by the payload team to verify select instrument-avionics interface requirements. This testing was performed at JPL using the avionics testbed's Bulk Data Storage Emulator (BDSEM) with visiting instrument Test Models. This paper summarizes the Data Link test campaign involving roughly four days of functional testing per instrument, including planning, testing methods, types of issues found, and the requirement closure process. Detail is also provided on the development, deployment, and validation of a standardized analysis tool used in data reviews. This testing verified requirements related to commanding rates, loss of link, packet format, clock counters, loopback test capability, and SpaceWire jitter and skew margins. Additional risk reduction testing of basic commanding, counter behavior, science data collection and transfer, and interface swapping was also performed. Because the BDSEM venue was not originally designed to be a run for record venue, the process of characterizing venue fidelity and establishing suitability for requirement closure using data collected in this venue will also be addressed.In order to close requirements, an extensible tool was developed to post-process instrument command and telemetry data from their original binary to a human-readable format and give visibility to errors detected within the data, such as packets with Cyclic Redundancy Check errors. This tool, called payload-packet-parser, is a Python 3.9 command line tool built using a variety of open-source Python libraries. Payload-packet-parser was designed to support parsing command and telemetry packets for all Europa Clipper instruments and additional analysis tools were developed for verification of specific information interface requirements. This test campaign, including post-processing using a single parsing and verification toolset, allowed for early interface testing, alleviating testing burdens on instrument teams and buying down risk on the instrument-avionics interface by finding hardware and software issues and idiosyncrasies prior to integration with system test venues. Over twenty issues were discovered across the payload, resulting in software updates and instrument rework well in advance of any system impacts. This paper concludes with an assessment of benefits and costs of this type of testing and lessons learned.

Montanez, Leticia↗
NASA NTRS1987

System architecture of a gallium arsenide one-gigahertz digital IC tester

The design for a 1-GHz digital integrated circuit tester for the evaluation of custom GaAs chips and subsystems is discussed. Technology-related problems affecting the design of a GaAs computer are discussed, with emphasis on the problems introduced by long printed-circuit-board interconnect. High-speed interface modules provide a link between the low-speed microprocessor and the chip under test. Memory-multiplexer and memory-shift register architectures for the storage of test vectors are described in addition to an architecture for local data storage consisting of a long chain of GaAs shift registers. The tester is constructed around a VME system card cage and backplane, and very little high-speed interconnect exists between boards. The tester has a three part self-test consisting of a CPU board confidence test, a main memory confidence test, and a high-speed interface module functional test.

Fouts, Douglas J.↗
NASA NTRSDate not supplied

LAADS DAAC Migrates to the Cloud: Lessons Learned from Communicating About Earth Science Data on the Cloud

The Level-1 and Atmosphere Archive Distribution System (LAADS) Distributed Active Archive Center (DAAC) is migrating data to the cloud. As one of twelve DAACS supported by NASA’s Earth Science Data and Information System (ESDIS), LAADS is using moving away from on premise data storage facilities to migrating to Amazon Web Services, where the massive archive of data from the Moderate Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS) will be available for download and post-processing transformations online. The migration is happening in three phases and LAADS is concluding its beta testing period. This poster shows the lessons learned from communicating with a select group of users about how to effectively educate data users on using data in the cloud.

Tassia Owen↗
NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗
NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗
NASA NTRS1998

An emerging network storage management standard: Media error monitoring and reporting information (MEMRI) - to determine optical tape data integrity

Sophisticated network storage management applications are rapidly evolving to satisfy a market demand for highly reliable data storage systems with large data storage capacities and performance requirements. To preserve a high degree of data integrity, these applications must rely on intelligent data storage devices that can provide reliable indicators of data degradation. Error correction activity generally occurs within storage devices without notification to the host. Early indicators of degradation and media error monitoring 333 and reporting (MEMR) techniques implemented in data storage devices allow network storage management applications to notify system administrators of these events and to take appropriate corrective actions before catastrophic errors occur. Although MEMR techniques have been implemented in data storage devices for many years, until 1996 no MEMR standards existed. In 1996 the American National Standards Institute (ANSI) approved the only known (world-wide) industry standard specifying MEMR techniques to verify stored data on optical disks. This industry standard was developed under the auspices of the Association for Information and Image Management (AIIM). A recently formed AIIM Optical Tape Subcommittee initiated the development of another data integrity standard specifying a set of media error monitoring tools and media error monitoring information (MEMRI) to verify stored data on optical tape media. This paper discusses the need for intelligent storage devices that can provide data integrity metadata, the content of the existing data integrity standard for optical disks, and the content of the MEMRI standard being developed by the AIIM Optical Tape Subcommittee.

Podio, Fernando↗
NASA NTRS2005

New Directions in Space Operations Services in Support of Interplanetary Exploration

To gain access to the necessary operational processes and data in support of NASA's Lunar/Mars Exploration Initiative, new services, adequate levels of computing cycles and access to myriad forms of data must be provided to onboard spacecraft and ground based personnel/systems (earth, lunar and Martian) to enable interplanetary exploration by humans. These systems, cycles and access to vast amounts of development, test and operational data will be required to provide a new level of services not currently available to existing spacecraft, on board crews and other operational personnel. Although current voice, video and data systems in support of current space based operations has been adequate, new highly reliable and autonomous processes and services will be necessary for future space exploration activities. These services will range from the more mundane voice in LEO to voice in interplanetary travel which because of the high latencies will require new voice processes and standards. New services, like component failure predictions based on data mining of significant quantities of data, located at disparate locations, will be required. 3D or holographic representation of onboard components, systems or family members will greatly improve maintenance, operations and service restoration not to mention crew morale. Current operational systems and standards, like the Internet Protocol, will not able to provide the level of service required end to end from an end point on the Martian surface like a scientific instrument to a researcher at a university. Ground operations whether earth, lunar or Martian and in flight operations to the moon and especially to Mars will require significant autonomy that will require access to highly reliable processing capabilities, data storage based on network storage technologies. Significant processing cycles will be needed onboard but could be borrowed from other locations either ground based or onboard other spacecraft. Reliability will be a key factor with onboard and distributed backup processing an absolutely necessary requirement. Current cluster processing/Grid technologies may provide the basis for providing these services. An overview of existing services, future services that will be required and the technologies and standards required to be developed will be presented. The purpose of this paper will be to initiate a technological roadmap, albeit at a high level, of current voice, video, data and network technologies and standards (which show promise for adaptation or evolution) to what technologies and standards need to be redefined, adjusted or areas where new ones require development. The roadmap should begin the differentiation between non manned and manned processes/services where applicable. The paper will be based in part on the activities of the CCSDS Monitor and Control working group which is beginning the process of standardization of the these processes. Another element of the paper will be based on an analysis of current technologies supporting space flight processes and services at JSC, MSFC, GSFC and to a lesser extent at KSC. Work being accomplished in areas such as Grid computing, data mining and network storage at ARC, IBM and the University of Alabama at Huntsville will be researched and analyzed.

Bradford, Robert N.↗
NASA NTRS1972

Advanced dosimetry systems for the space transport and space station

Advanced dosimetry system concepts are described that will provide automated and instantaneous measurement of dose and particle spectra. Systems are proposed for measuring dose rate from cosmic radiation background to greater than 3600 rads/hr. Charged particle spectrometers, both internal and external to the spacecraft, are described for determining mixed field energy spectra and particle fluxes for both real time onboard and ground-based computer evaluation of the radiation hazard. Automated passive dosimetry systems consisting of thermoluminescent dosimeters and activation techniques are proposed for recording the dose levels for twelve or more crew members. This system will allow automatic onboard readout and data storage of the accumulated dose and can be transmitted to ground after readout or data records recovered with each crew rotation.

Wailly, L. F.↗
NASA NTRS1992

An interactive environment for the analysis of large Earth observation and model data sets

We propose to develop an interactive environment for the analysis of large Earth science observation and model data sets. We will use a standard scientific data storage format and a large capacity (greater than 20 GB) optical disk system for data management; develop libraries for coordinate transformation and regridding of data sets; modify the NCSA X Image and X Data Slice software for typical Earth observation data sets by including map transformations and missing data handling; develop analysis tools for common mathematical and statistical operations; integrate the components described above into a system for the analysis and comparison of observations and model results; and distribute software and documentation to the scientific community.

Bowman, Kenneth P.↗
NASA NTRS1993

An interactive environment for the analysis of large Earth observation and model data sets

We propose to develop an interactive environment for the analysis of large Earth science observation and model data sets. We will use a standard scientific data storage format and a large capacity (greater than 20 GB) optical disk system for data management; develop libraries for coordinate transformation and regridding of data sets; modify the NCSA X Image and X DataSlice software for typical Earth observation data sets by including map transformations and missing data handling; develop analysis tools for common mathematical and statistical operations; integrate the components described above into a system for the analysis and comparison of observations and model results; and distribute software and documentation to the scientific community.

Bowman, Kenneth P.↗
NASA NTRS1995

Geophysical data analysis and visualization using the Grid Analysis and Display System

Several problems posed by the rapidly growing volume of geophysical data are described, and a selected set of existing solutions to these problems is outlined. A recently developed desktop software tool called the Grid Analysis and Display System (GrADS) is presented. The GrADS' user interface is a natural extension of the standard procedures scientists apply to their geophysical data analysis problems. The basic GrADS operations have defaults that naturally map to data analysis actions, and there is a programmable interface for customizing data access and manipulation. The fundamental concept of the GrADS' dimension environment, which defines both the space in which the geophysical data reside and the 'slice' of data which is being analyzed at a given time, is expressed The GrADS' data storage and access model is described. An argument is made in favor of describable data formats rather than standard data formats. The manner in which GrADS users may perform operations on their data and display the results is also described. It is argued that two-dimensional graphics provides a powerful quantitative data analysis tool whose value is underestimated in the current development environment which emphasizes three dimensional structure modeling.

Doty, Brian E.↗
NASA NTRS2018

Evolving Storage and Cyber Infrastructure at the NASA Center for Climate Simulation

This talk will describe recent developments at the NASA Center for Climate Simulation, which is funded by NASAs Science Mission Directorate, and supports the specialized data storage and computational needs of weather, ocean, and climate researchers, as well as astrophysicists, heliophysicists, and planetary scientists. To meet requirements for higher-resolution, higher-fidelity simulations, the NCCS augments its High Performance Computing (HPC) and storage retrieval environment. As the petabytes of model and observational data grow, the NCCS is broadening data services offerings and deploying and expanding virtualization resources for high performance analytics.

Cyberinfrastructure↗
DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗