Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Concepts for on board satellite image registration. Volume 4: Impact of data set selection on satellite on board signal processing

The NASA NEEDS program goals present a requirement for on-board signal processing to achieve user-compatible, information-adaptive data acquisition. This volume addresses the impact of data set selection on data formatting required for efficient telemetering of the acquired satellite sensor data. More specifically, the FILE algorithm developed by Martin-Marietta provides a means for the determination of those pixels from the data stream effects an improvement in the achievable system throughput. It will be seen that based on the lack of statistical stationarity in cloud cover, spatial distribution periods exist where data acquisition rates exceed the throughput capability. The study therefore addresses various approaches to data compression and truncation as applicable to this sensor mission.

Ruedger, W. H.↗

A Study of Cloud Radiative Forcing and Feedback

The main objective of the grant proposal was to participate in the CERES (Cloud and Earth's Radiant Energy System) Satellite experiment and perform interdisciplinary investigation of NASA's Earth Observing System (EOS). During the grant period, massive amounts of scientific data from diverse platforms have been accessed, processed and archived for continuing use; several software packages have been developed for integration of different data streams for performing scientific evaluation; extensive validation studies planned have been completed culminating in the development of important algorithms that are being used presently in the operational production of data from the CERES. Contributions to the inter-disciplinary science investigations have been significantly more than originally envisioned. The results of these studies have appeared in several refereed journals and conference proceedings. They are listed at the end of this report.

Ramanathan, Veerabhadran↗

DNET: A communications facility for distributed heterogeneous computing

This document describes DNET, a heterogeneous data communications networking facility. DNET allows programs operating on hosts on dissimilar networks to communicate with one another without concern for computer hardware, network protocol, or operating system differences. The overall DNET network is defined as the collection of host machines/networks on which the DNET software is operating. Each underlying network is considered a DNET 'domain'. Data communications service is provided between any two processes on any two hosts on any of the networks (domains) that may be reached via DNET. DNET provides protocol transparent, reliable, streaming data transmission between hosts (restricted, initially to DECnet and TCP/IP networks). DNET also provides variable length datagram service with optional return receipts.

Tole, John↗

High-Rate Communications Outage Recorder Operations for Optimal Payload and Science Telemetry Management Onboard the International Space Station

All International Space Station (ISS) Ku-band telemetry transmits through the High-Rate Communications Outage Recorder (HCOR). The HCOR provides the recording and playback capability for all payload, science, and International Partner data streams transmitting through NASA's Ku-band antenna system. The HCOR is a solid-state memory recorder that provides recording capability to record all eight ISS high-rate data during ISS Loss-of-Signal periods. NASA payloads in the Destiny module are prime users of the HCOR; however, NASDA and ESA will also utilize the HCOR for data capture and playback of their high data rate links from the Kibo and Columbus modules. Marshall Space Flight Center's Payload Operations Integration Center manages the HCOR for nominal functions, including system configurations and playback operations. The purpose of this paper is to present the nominal operations plan for the HCOR and the plans for handling contingency operations affecting payload operations. In addition, the paper will address HCOR operation limitations and the expected effects on payload operations. The HCOR is manifested for ISS delivery on flight 9A with the HCOR backup manifested on flight 11A. The HCOR replaces the Medium-Rate Communications Outage Recorder (MCOR), which has supported payloads since flight 5A.1.

Shell, Michael T.↗

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence↗

Tracking and data relay satellite system (TDRSS) - A worldwide view from space

The development, performance levels, and operational use of the TDRSS satellite system are outlined. The TDRSS spacecraft were conceived in the mid-1960s by NASA as a means of using GEO-positioned satellites to eliminate existing ground stations. The main ground terminal becomes Goddard Space Flight Center, through which users other than the Shuttle can also gain access. The TDRSS functions as a relay vehicle, with very little on-board processing except for status reports inserted into the data stream. Use of the TDRSS system by nonNASA agencies currently costs $110/min for forwards, return, and tracking, $24/min for forward service alone, and $8/min for return service only. The spacecraft can store data on board and dump it to the ground station during the limited hours of operation.

Macoughtry, W. O.↗

Future SAR Imaging Systems: Goals, Plans, Challenges and Opportunities

Synthetic Aperture Radar (SAR) Earth observation data are becoming increasingly ubiquitous as new spaceborne systems become operational and their data are made available to scientists and applications users. The characteristic of active sensors like SAR to be able to observe Earth independent of weather or solar illumination, coupled with regular data acquisition, fosters reliability and encourages the investment in algorithm and product development toward a beneficial result. As SAR systems typically contain proprietary or nationally important technologies, civilian SAR systems are typically developed with a national focus, or in the case of the European Union, with the Union’s focus. As a result, when viewed from a global perspective, SAR programs can be generally viewed as independent developments, each with their own requirements, schedules, development approaches, and data policies. At the same time, these systems can be expensive, and particularly in an era of increasingly open data policies, coordination of programs could reduce redundancy in observations, increase sampling density and measurement diversity, and improve dependability of data streams in the long term. Since 2018, agency representatives from NASA, ESA, DLR, JAXA, ISRO, ASI, and CONAE have been evaluating the possibilities for programmatic and technical coordination of future SAR systems, data sharing, and scientific exploitation. In this paper, we describe the work in discovering trends and possibilities associated with flight systems, by evaluating current and future plans for SAR systems around the world, and identifying opportunities for coordination.

Zink, Manfred↗

Leveraging VIPER Geotechnical and Mobility Insights for Endurance Rover and Traverse Development

A new generation of lunar surface rover exploration is rapidly approaching. This is evidenced by the rise of commercially developed rovers from private companies (e.g., Lunar Outpost’s MAPP) and government agencies, like NASA’s Volatiles Investigating Polar Exploration Rover (VIPER), the Lunar Terrain Vehicle (LTV), and the Endurance/Intrepid rover concepts, and the INSPIRE mission concept. The drive distance requirements for off-world vehicles are also rapidly increasing. For example, LTV driving requirements dictate a 20 km range on a single battery charge, with an overall lifetime requirement of 13,000 km over a minimum 10-year service life. Similarly, NASA's Endurance-A mission concept requires a 2000 km vehicle traverse distance, which is nearly 50 times further than the USSR's Lunokhod 2, the longest lunar rover mission to date. Previous planetary surface missions on the Moon and Mars have revealed harsh mobility conditions: aggressive rocky terrains on Mars severely damaged the Curiosity rover’s wheels, soft lunar regolith caused the Lunokhod 2 rover to sink and NASA’s Apollo 15 LRV (Lunar Roving Vehicle) spun out due to poor traction, which required manual correction. This demonstrates that mobility challenges like wheel degradation and soft soil driving performance must be accounted for in a mission’s design phase to meet increasingly aggressive mission durations and mobility goals. The success of these long duration missions requires highly reliable and durable mobility platforms in conjunction with a more developed understanding of the geotechnical properties of the lunar surface. The VIPER mission is uniquely posed to inform future missions about mobility performance, wheel durability, and lunar surface soil mechanics of sunlit and shadowed regions through use of data streams that already exist for other mission purposes. VIPER’s mission to the lunar south pole will provide a new perspective into off-world mobility challenges including traversal into permanently shadowed regions. Mobility data from VIPER’s mission will represent a first glimpse into the surface mobility challenges of the lunar South Pole. Utilization of VIPER’s existing capabilities including cameras, inertial measurement unit (IMU) data, motor currents/torque, drill data, and the rover’s suspension state and kinematics provide the opportunity to determine potentially useful information for future rover and traverse designs, as well as on-Earth testing practices. Data products collected during VIPER’s mission could inform design considerations for the Endurance rover much earlier than NASA’s standard “lessons learned” approach as VIPER has a highly tactical mission operations structure. This work outlines the specific links between possible data products from the VIPER mission and their potential impact on the Endurance/Intrepid mission concepts in their early design phases. From VIPER, we will also gain insights for future development of onboard mobility software as VIPER is a way-point driven rover which requires more constant human operation on Earth than some other rover missions (non-lunar surface). Primary VIPER data products and insights of interest include wheel sinkage, wheel slip, wheel degradation, surface soil shear strength, and terrain slope estimation. VIPER data products will be made available via the Planetary Data System’s Geosciences and Cartography and Imaging Sciences nodes, conforming to the PDS4 standard.

mobility↗

Program for Automated Real-Time Monitoring

Process-control decisions made by applying rules to process data streams. Expert System Executive computer program demonstrates feasibility of automated real-time monitoring. Using Executives knowledge of system formally coded as set of rules specifying actions taken under various conditions. Program makes inferences about observed data based on rules. Written in C language.

Goodrum, Glenn R.↗

Impact of remote sensing upon the planning, management, and development of water resources

Principal water resources users were surveyed to determine the impact of remote data streams on hydrologic computer models. Analysis of responses demonstrated that: most water resources effort suitable to remote sensing inputs is conducted through federal agencies or through federally stimulated research; and, most hydrologic models suitable to remote sensing data are federally developed. Computer usage by major water resources users was analyzed to determine the trends of usage and costs for the principal hydrologic users/models. The laws and empirical relationships governing the growth of the data processing loads were described and applied to project the future data loads. Data loads for ERTS CCT image processing were computed and projected through the 1985 era.

Castruccio, P. A.↗

A simple low-cost array on the lunar near-side for the early lunar expeditions

A concept of a simple, low-cost array on the lunar near-side is discussed. The concept includes 19 stations laid in a T, with three arms each 36 km long, and separated by 6 km. Each station consists of two 10-m-long orthogonal dipoles, each feeding a receiver of a commercial pocket digital shortwave radio type, and a 3-m spring-loaded mast with a small UHF array at the top for receiving the timing signals and tuning commmands and for sending out the digitized data streams. Each station has 0.25 square meters of solar arrays and 20 kg of lithium batteries. At the array center there is either a digital correlator for processing the signals from each antenna pair to compact the data into a 32-kb/sec channel or a 10-cm telescope for sending back raw data to earth.

Kuiper, T. B. H.↗

Revised Radiometric Calibration Technique for LANDSAT-4 Thematic Mapper Data by the Canada Centre for Remote Sensing

A technique for the radiometric correction of LANDSAT-4 Thematic Mapper data was proposed by the Canada Center for Remote Sensing. Subsequent detailed observations of raw image data, raw radiometric calibration data and background measurements extracted from the raw data stream on High Density Tape highlighted major shortcomings in the proposed method which if left uncorrected, can cause severe radiometric striping in the output product. Results are presented which correlate measurements of the DC background with variations in both image data background and calibration samples. The effect on both raw data and on data corrected using the earlier proposed technique is explained, and the correction required for these factors as a function of individual scan line number for each detector is described. It is shown how the revised technique can be incorporated into an operational environment.

Murphy, J.↗

Level 1 Processing of MODIS Direct Broadcast Data at the GSFC DAAC

The GSFC DAAC is working to test and package the MODIS Level 1 Processing software for Aqua Direct Broadcast data. This entails the same code base, but different lookup tables for Aqua and Terra. However, the most significant change is the use of ancillary attitude and ephemeris files instead of orbit/attitude information within the science data stream (as with Terra). In addition, we are working on Linux: ports of the algorithms, which could eventually enable processing on PC clusters. Finally, the GSFC DAAC is also working with the GSFC Direct Readout laboratory to ingest Level 0 data from the GSFC DB antenna into the main DAAC, enabling level 1 production in near real time in support of applications users, such as the Synergy project. The mechanism developed for this could conceivably be extended to other participating stations.

Lynnes, Christopher↗

Evaluation of the Ozone Fields in NASA's MERRA-2 Reanalysis

The assimilated ozone product from the Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2), produced at NASAs Global Modeling and Assimilation Office (GMAO) is summarized. The reanalysis begins in 1980 with the use of retrieved partial-column ozone concentrations from a series of Solar Backscatter Ultraviolet Radiometer (SBUV) instruments on NASA and NOAA spacecraft. Beginning in October 2004, retrieved ozone profiles from the Microwave Limb Sounder (MLS) and total column ozone from the Ozone Monitoring Instrument (OMI) on NASAs EOS Aura satellite are assimilated. While this change in data streams does lead to a discontinuity in the assimilated ozone fields in MERRA-2, making it not useful for studies in decadal (secular) trends in ozone, this choice was made to prioritize demonstrating the value NASAs high-quality research data in the reanalysis context. The MERRA-2 ozone is compared with independent satellite and ozonesonde data, focusing on the representation of the spatial and temporal variability of stratospheric and upper-tropospheric ozone. The comparisons show agreement within 10 (standard deviation of the difference) between MERRA-2 profiles and independent satellite data in most of the stratosphere. The agreement improves after 2004, when EOS Aura data are assimilated. The standard deviation of the differences between the lower-stratospheric and upper-tropospheric MERRA-2 ozone and ozonesondes is 11.2 and 24.5, respectively, with correlations of 0.8 and above. This is indicative of a realistic representation of the UTLS ozone variability in MERRA-2. After 2004, the upper tropospheric ozone in MERRA-2 shows a low bias compared to the sondes, but the covariance with independent observations is improved compared to earlier years. Case studies demonstrate the integrity of MERRA-2 analyses in representing important features such as tropopause folds.

Ozone↗

Interchangeable Use of GNSS and Seismic Data for Rapid Earthquake Characterization: 2021 Chignik Earthquake, Alaska

Earthquake magnitude estimation using peak ground velocities (PGV) derived from 13 Global Navigation Satellite Systems (GNSS) data has shown promise for rapid 14 characterization of damaging earthquakes. Here we examine the feasibility of using 15 GNSS-derived velocity waveforms as interchangeable data for ground motion estimation 16 and other products that typically rely on strong-motion seismic records. Our study 17 compares PGVs derived from high-rate GNSS to those computed from high-rate seismic 18 records (strong-motion and velocity), at co- and closely-located stations. The recent 2021 Manuscript Click here to access/download;Manuscript;Manuscript_Final.docx 2 19 Mw 8.2 Chignik earthquake in Alaska that was recorded on co-located GNSS and strong20 motion sensors provides the perfect opportunity to compare the two data streams and 21 their application in rapid response. The Chignik velocity records appear almost identical 22 at co-located GNSS and strong-motion stations when observed at frequencies < 0.25 Hz. 23 GNSS and strong-motion derived velocity data are further employed to generate rapid 24 estimates of PGV-derived moment magnitudes for the earthquake. The moment 25 magnitude estimates from GNSS and joint GNSS/seismic data are within ~ ±0.4 26 magnitude units (Fang et al., 2020) of the final magnitude (Mw 8.2). ShakeMaps 27 generated for the 2021 Chignik earthquake using GNSS and seismic PGVs show notable 28 agreement between them, and show negligible shifts in PGV contours when co-/closely 29 located GNSS and seismic stations are substituted for one another. Therefore, we posit 30 that GNSS is a powerful alternative or addition to seismic data and vice versa.

Earthquake rapid response↗

Data processing in infrared astronomy

Infrared astronomy is often carried out with rocket probes or orbiting satellite telescopes in order to escape the effects of atmospheric absorption. The data returned from such missions is a highly abstracted digital representation of measurements made by analog detectors. The ability to extract infrared-emission information from these data streams depends on a thorough understanding of the information flow from the telescope aperture to the computer center. This paper reviews the primary elements of this end-to-end concept and the impact of each of these elements on the data processing algorithms, including the division between onboard and ground processing for scientific measurements.

Pelzmann, R. F., Jr.↗

Datascope to Enable Earth Independent Medical Operations (EIMO)

BACKGROUND: NASA has amassed sixty years of knowledge and experience relevant to maintenance of crew health and performance in low earth orbit. The Apollo Program introduced the importance of ensuring progressively autonomous operational capability. Earth Independent Medical Operations (EIMO) will require a gradual shift in the balance of medical responsibility, management, and authority from terrestrial to space-based assets. Terrestrial assets will continue to be essential for pre-mission screening and planning in addition to maintenance of crew health and performance. However, new capabilities are needed to enable EIMO and the amount of data required to support these systems, and mitigate the impacts of data transmission delays and reduced bandwidth coupled with lack of cloud-like resources and on-board computing capacity that is currently unclear or operationally insufficient. OVERVIEW: The overall goal of EIMO is to develop artificial intelligence (AI)-based solutions to analyze crew health and performance data utilizing a clinical decision support system (CDSS) to provide crew medical officers (CMO) with the equivalent of real-time, on-board medical consults. The EIMO ecosystem is envisioned as a “system of systems” where embedded reference databases and real-time data streams from multiple input vectors continuously and seamlessly assess crew health and performance. EIMO will be designed to make recommendations to the CMO using multi-modal AI-based natural language processing and machine learning methods with interoperability to push/pull data within and between multiple vehicle and habitat architectures. DISCUSSION: Data flows and storage/retrieval capacity are severely constrained during space missions and the challenges will become even greater during exploration missions. Just as each past program from Mercury to the International Space Station (ISS) required rethinking the interaction between ground-based controllers and space-based crew, so too will future missions to the Moon and Mars. While the NASA High-Performance Spaceflight Computing Processor project aims to increase computational capacity by 100 times over current spaceflight computers, the projected deliverable still lags considerably behind what will be needed to enable an AI-driven CDSS. Restrictions in processing speed and data storage capacity, coupled with transmission bottlenecks and delays, necessitate definition and optimization of an integrated data architecture to enable a progressively autonomous medical capability.

Medical operations↗

Prototype architecture for a VLSI level zero processing system

The prototype architecture and implementation of a high-speed level zero processing (LZP) system are discussed. Due to the new processing algorithm and VLSI technology, the prototype LZP system features compact size, low cost, high processing throughput, and easy maintainability and increased reliability. Though extensive control functions have been done by hardware, the programmability of processing tasks makes it possible to adapt the system to different data formats and processing requirements. It is noted that the LZP system can handle up to 8 virtual channels and 24 sources with combined data volume of 15 Gbytes per orbit. For greater demands, multiple LZP systems can be configured in parallel, each called a processing channel and assigned a subset of virtual channels. The telemetry data stream will be steered into different processing channels in accordance with their virtual channel IDs. This super system can cope with a virtually unlimited number of virtual channels and sources. In the near future, it is expected that new disk farms with data rate exceeding 150 Mbps will be available from commercial vendors due to the advance in disk drive technology.

Shi, Jianfei↗