Search NASA⌕ Search

SEARCH · Search NASA

Results for “data usage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Usage-Based Discovery of Earth Observations

Most providers of Earth Observation data enable search via dataset characteristics, (e.g., quantity being measured, instrument, location, and time). However, the Earth Science Information Partners Federation (ESIP) is attempting to improve dataset discovery by capturing information on how datasets are used. At a usage-based discovery hackfest at the July 2020 ESIP Summer Meeting, participants pooled their collective skills to implement a prototype based on the connections between datasets and data usage, which can reveal unanticipated patterns in dataset connectivity that are not apparent through traditional approaches. A survey of natural hazards websites, focusing on hydrology-related hazards such as floods and hydrology datasets such as rainfall, illustrated the difficulty of gleaning which dataset was actually used and how it was accessed. This difficulty highlights the need for greater transparency on dataset usage in website design. An application wireframe for a usage-based discovery database was conceptualized as a tool to help applications data specialists rapidly assemble a fit-for-purpose website as part of a disaster response, where customer feedback was integral to the manner in which the website would be developed and delivered. Capturing connections among datasets and instances of usage, either for research or applications, could help users identify datasets with a proven track record of utility or those that have been supplanted by more accurate and(or) precise representations. It may also help Earth Observation providers maximize returns on investments in data services. Social discovery, i.e, following discovery paths laid down by previous users of the data, could be a critical tool for improving the timeliness and applicability of dataset delivery at times and in circumstances where practitioners don’t have the capacity to evaluate the deluge of datasets that are returned by today’s search tools.

search↗

Requirements and Usage of NVM in Advanced Onboard Data Processing Systems

This viewgraph presentation gives an overview of the requirements and uses of non-volatile memory (NVM) in advanced onboard data processing systems. Supercomputing in space presents the only viable approach to the bandwidth problem (can't get data down to Earth), controlling constellations of cooperating satellites, reducing mission operating costs, and real-time intelligent decision making and science data gathering. Details are given on the REE vision and impact on NASA and Department of Defense missions, objectives of REE, baseline architecture, and issues. NVM uses and requirements are listed.

Some, R.↗

NASA EOSDIS: Enabling Science by Improving User Knowledge

Lessons learned and impacts of applying these newer methods are explained and include several examples from our current efforts such as the interactive, on-line webinars focusing on data discovery and access including tool usage, informal and informative data chats with data experts across our EOSDIS community, data user profile interviews with scientists actively using EOSDIS data in their research, and improved conference and meeting interactions via EOSDIS data interactively used during hyper-wall talks and Worldview application. The suite of internet-based, interactive capabilities and technologies has allowed our project to expand our user community by making the data and applications from numerous Earth science missions more engaging, approachable and meaningful.

EOSDIS↗

MERRA-2 Data and Analytic Services at NASA GES DISC for Climate Extremes Study

NASA's climate reanalysis datasets from the Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) contains numerous long-term atmosphere, land, and ocean data products from 1980-present. MERRA-2 datasets, such as precipitation, soil moisture, and temperature, have been used widely to study extreme events. The native archived MERRA-2 data files are day-file (hourly time interval) and month-file, containing up to 125 parameters in one file. Due to the large number of data files and volumes, it is challenging for users, especially the applications research community, to handle the original hourly data files for long time periods to analyze extreme events. In this presentation, we review MERRA-2 data for studies of extreme conditions, and demonstrate analytic services at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). One of the current operational services, 'subsetter', allows users to download only specific data of interest, i.e. data selected by parameter, region, and time period. New services are under development that will provide more 'on-the-fly' statistical calculations when downloading data; improve efficiency when accessing long time-series data. We will provide additional "How-to" resources that include step-by-step instructions on data access and usage. We have tested restructuring of day-files in an optimized data cube, which has significantly improved system performance for accessing long time-series. Overall performance is associated with cube size and structure, data compression method, and how the data are accessed. The optimized data cube structure will enable better online analytic services for statistical analysis and extreme events mining. To demonstrate the service, we use an extreme drought associated with the anomalous 2016 monsoon over southern Asia. This prototype time-series service may be augmented in the cloud infrastructure in the future.

data access↗

Status and Progress of Observation Usages in the GMAO GEOS Atmospheric Data Assimilation System

The Global Modeling and Assimilation Office (GMAO) continuously works to enhance the use of observations in the Goddard Earth Observing System – Forward Processing (GEOS-FP) model and analysis system. Updates to GEOS-FP in March 2022 and February 2023 focused on the analysis component, adding new capabilities to ingest radiances and other new observing systems, such as SPIRE GNSS-RO data. Concurrent activities enhance aspects of the radiance assimilation, such as the use of hyperspectral radiances in the stratosphere and lower troposphere, the introduction of microwave radiances over land, and a revised treatment of GMI observations. Furthermore, GMAO has been contributing to the Joint Effort for Data assimilation Integration (JEDI), including development and testing of various components of the observing system and GEOS-specific background error covariances that will allow migration of GEOS-FP from a GSI- to a JEDI-based analysis system. A number of examples are shown.

Y Zhu↗

New Data on the Topside Electron Density Distribution

The existing uncertainties about the electron density profiles in the topside ionosphere, i.e., in the height region from hmF2 to approx. 2000 km, require the search for new data sources. The ISIS and Alouette topside sounder satellites from the sixties to the eighties recorded millions of ionograms and most were not analyzed in terms of electron density profiles. In recent years an effort started to digitize the analog recordings to prepare the ionograms for computerized analysis. As of November 2001 about 350,000 ionograms have been digitized from the original 7-track analog tapes. These data are available in binary and CDF format from the anonymous ftp site of the National Space Science Data Center. A search site and browse capabilities on CDAWeb assist the scientific usage of these data. All information and access links can be found at http://nssdc.gsfc.nasa.gov/space/isis/isis-status.html. This paper describes the ISIS data restoration effort and shows how the digital ionograms are automatically processed into electron density profiles from satellite orbit altitude (1400 km for ISIS-2) down to the F peak. Because of the large volume of data an automated processing algorithm is imperative. The automatic topside ionogram scaler with true height algorithm TOPIST software developed for this task is successfully scaling approx.70 % of the ionograms. An 'editing process' is available to manually scale the more difficult ionograms. The automated processing of the digitized ISIS ionograms is now underway, producing a much-needed database of topside electron density profiles for ionospheric modeling covering more than one solar cycle. The ISIS data restoration efforts are supported through NASA's Applied Systems and Information Research Program.

Huang, Xue-Qin↗

Electron Density Profiles of the Topside Ionosphere

The existing uncertainties about the electron density profiles in the topside ionosphere, i.e., in the height region from h,F2 to - 2000 km, require the search for new data sources. The ISIS and Alouette topside sounder satellites from the sixties to the eighties recorded millions of ionograms but most were not analyzed in terms of electron density profiles. In recent years an effort started to digitize the analog recordings to prepare the ionograms for computerized analysis. As of November 2001 about 350000 ionograms have been digitized from the original 7-track analog tapes. These data are available in binary and CDF format from the anonymous ftp site of the National Space Science Data Center. A search site and browse capabilities on CDAWeb assist the scientific usage of these data. All information and access links can be found at http://nssdc.gsfc.nasa.gov/space/isis/isis- status.htm1. This paper describes the ISIS data restoration effort and shows how the digital ionograms are automatically processed into electron density profiles from satellite orbit altitude (1400 km for ISIS-2) down to the F peak. Because of the large volume of data an automated processing algorithm is imperative. The TOPside Ionogram Scaler with True height algorithm TOPIST software developed for this task is successfully scaling - 70% of the ionograms. An < > is available to manually scale the more difficult ionograms. The automated processing of the digitized ISIS ionograms is now underway, producing a much-needed database of topside electron density profiles for ionospheric modeling covering more than one solar cycle.

Huang, Xue-Qin↗

External Contamination Control of Attached Payloads on the International Space Station

The International Space Station (ISS) is an on-orbit platform for science utilization in low Earth orbit with multiple sites for external payloads with exposure to the natural and induced environments. Contamination is one of the induced environments that can impact performance, mission success and science utilization on the vehicle. This paper describes the external contamination control requirements and integration process for externally mounted payloads on the ISS. The external contamination control requirements are summarized and a description of the integration and verification process is detailed to guide payload developers in the certification process of attached payloads on the vehicle. A description of the required data certification deliverables covers the characterization of contamination sources. Such characterization includes identification, usage and operational data for each class of contamination source. Classes of external contamination sources covered are vacuum exposed materials, sources of leakage, vacuum venting and thrusters. ISS system level analyses are conducted by the ISS Space Environments Team to certify compliance with external contamination control requirements. This paper also addresses the ISS induced contamination environment at attached payload sites, both at the requirements level as well as measurements made on ISS.

Soares, Carlos E.↗

Lessons Learned From Developing A Streaming Data Framework for Scientific Analysis

We describe the development and usage of a streaming data analysis software framework. The framework is used for three different applications: Earth science hyper-spectral imaging analysis, Electromyograph pattern detection, and Electroencephalogram state determination. In each application the framework was used to answer a series of science questions which evolved with each subsequent answer. This evolution is summarized in the form of lessons learned.

Wheeler. Kevin R.↗

Systems aspects of COBE science data compression

A general approach to compression of diverse data from large scientific projects has been developed and this paper addresses the appropriate system and scientific constraints together with the algorithm development and test strategy. This framework has been implemented for the COsmic Background Explorer spacecraft (COBE) by retrofitting the existing VAS-based data management system with high-performance compression software permitting random access to the data. Algorithms which incorporate scientific knowledge and consume relatively few system resources are preferred over ad hoc methods. COBE exceeded its planned storage by a large and growing factor and the retrieval of data significantly affects the processing, delaying the availability of data for scientific usage and software test. Embedded compression software is planned to make the project tractable by reducing the data storage volume to an acceptable level during normal processing.

Freedman, I.↗

Image processing using Gallium Arsenide (GaAs) technology

The need to increase the information return from space-borne imaging systems has increased in the past decade. The use of multi-spectral data has resulted in the need for finer spatial resolution and greater spectral coverage. Onboard signal processing will be necessary in order to utilize the available Tracking and Data Relay Satellite System (TDRSS) communication channel at high efficiency. A generally recognized approach to the increased efficiency of channel usage is through data compression techniques. The compression technique implemented is a differential pulse code modulation (DPCM) scheme with a non-uniform quantizer. The need to advance the state-of-the-art of onboard processing was recognized and a GaAs integrated circuit technology was chosen. An Adaptive Programmable Processor (APP) chip set was developed which is based on an 8-bit slice general processor. The reason for choosing the compression technique for the Multi-spectral Linear Array (MLA) instrument is described. Also a description is given of the GaAs integrated circuit chip set which will demonstrate that data compression can be performed onboard in real time at data rate in the order of 500 Mb/s.

Miller, Warner H.↗

RAID 7 disk array

Each RAID level reflects a different design architecture. Associated with each is a backdrop of imposed limitations, as well as possibilities which may be exploited within the architectural constraints of that level. There are three unique features that differentiate RAID 7 from all other levels. RAID 7 is asynchronous with respect to usage of I/O data paths. Each I/O drive (includes all data and one parity drives) as well as each host interface (there may be multiple host interfaces) has independent control and data paths. This means that each can be accessed completely, independently, of the other. This is facilitated by a separate device cache for each device/interface as well. RAID 7 is asynchronous with respect to device hierarchy and data bus utilization. Each drive and each interface is connected to a high speed data bus controlled by the embedded operating system to make independent transfers to and from central cache. RAID 7 is asynchronous with respect to the operation of an embedded real time process oriented operating system. This means that exclusive and independent of the host, or multiple host paths, the embedded OS manages all I/O transfers asynchronously across the data and parity drives. A key factor to consider is that of the RAID 7's ability to anticipate and match host I/O usage patterns. This yields the following benefits over RAID's built around micro-code based architectures. RAID 7 appears to the host as a normally connected Big Fast Disk (BFD). RAID 7 appears, from the perspective of the individual disk devices, to minimize the total number of accesses and optimize read/write transfer requests. RAID 7 smoothly integrates the random demands of independent users with the principles of spatial and temporal locality. This optimizes small, large, and time sequenced I/O requests which results in users having an I/O performance which approaches performance to that of main memory.

Stout, Lloyd↗

The Arya Crop Yield Forecasting Algorithm: Application to the Main Wheat Exporting Countries

Wheat is the most important commodity traded in the international food market. Thus, accurate and timely information on wheat production can help mitigate food price fluctuations. Within the existing operational regional and global scale agricultural monitoring systems that provide information on global crop yield and area forecasts, there are still fundamental gaps: #1. Lack of quantitative Earth Observation (EO) derived crop information, #2. Lack of global but detailed (national or subnational level) and timely crop production forecasts and #3. Lack of information on forecast uncertainties. In this study we present the Agriculture Remotely-sensed Yield Algorithm (ARYA) an EO-based method, advancing the state of EO data application and usage (addressing gap #1) to forecast wheat yield. The algorithm is based on the evolution of the Difference Vegetation Index (DVI) using MODIS data at 1km resolution and the Growing Degree Days (GDD) from reanalysis data. Additionally, we explore how Land Surface Temperature (LST) can be included into the model and whether this parameter adds any value to the model performance when combined with the optical information. ARYA is implemented at the national and subnational level to forecast winter wheat yield in the main wheat exporting countries of US, Russia, Ukraine, France, Germany, Australia and Argentina from 2001 to 2019 (covering over 70% of wheat exports globally) in a timely manner by providing daily forecasts (addressing gap #2). The results show that ARYA provides yield estimations with RMSE’s within 0.3 ± 0.1 t/ha at national level and 0.6 ± 0,1 t/ha at subnational level after Day Of the Year (DOY) 140 (mid May) in the Northern Hemisphere and DOY 280 (beginning of October) in the Southern Hemisphere. This means that ARYA can provide crop yield estimates of wheat yield with 5-15 % error at national and 7-20 % error at subnational level starting from 2 to 2.5 months prior to harvest.

Agriculture↗

Enabling High Performance Reconfigurable Ground Data Processing Systems

The deployment of high data rate instruments onboard satellites with direct broadcast capability demands the implementation of powerful ground data processing systems. Conversely, to enable the widespread usage of direct broadcast data and the generation of subsequent data products, low cost data processing systems must be available. Reconfigurable computers based on Field Programmable Gate Arrays (FPGA) enable the implementation of ground data processing systems that lead to higher performance and lower cost while keeping a high degree of programmability and maintainability. This paper presents the conceptualization of the MODIS Adaptive Level One Accelerator (ALOA), a prototype under construction at NASA's Goddard Space Flight Center. The ALOA is a computer workstation augmented by a reconfigurable computer. The system will calibrate and geographically locate data from the EOS-AM1 MODerate resolution Imaging Spectroradiometer (MODIS) instrument at near real-time data rates.

Hines, Tonjua M.↗

Dose Tracker Application for Monitoring Crew Medication Usage, Symptoms, and Adverse Effects During Missions

Medication usage records can be used as a relatively nonintrusive means of monitoring health. This has been attempted previously through crew medical records, but these records are incomplete from the perspective of a research pharmacologist. During the shuttle era, NASA operations did not include routine questioning of crewmembers about their medication use until after missions were complete. The (long!) questionnaire was on paper. Asking crewmembers to recall medication use from weeks before questioning made getting complete and accurate information virtually impossible. This study will document medication usage of crewmembers before and during their missions. It will capture previously unrecorded data regarding medication use during spaceflight, including side effect qualities, frequencies and severities. The research-oriented data will be collected for research purposes, separate from medical records. Dose Tracker employs an iOS application (app) for fast & easy collection of medication usage data from crewmember participants during their missions.

Wotring, Virginia↗

The gravitational wave detection experiment: Description and anticipated requirements

The experiment to detect gravitational waves in ultraprecise two-way Doppler data is described, as are the anticipated requirements for the Deep Space Network, the spacecraft, and the data processing system. The special feature which allows the usage of ultraprecise Doppler data for the possible detection of gravitational waves is a unique three-pulse signature which is a function of the spacecraft, earth, and gravitational wave propagation direction geometry. The pulses (fractional frequency shifts) result from effects which are conveniently described as follows: Clock speed-up (earth only effect) and buffeting (equal earth and spacecraft effect).

Berman, A. L.↗

Using Big Data Technologies with Earth Science Data in HDF5: HDF5 Scalable Solutions

HDF5 (Hierarchical Data Format 5) is open-source, high-performance software that consists of an abstract data model, library, and fileformat used for storing and managing extremely large and/or complex data collections. NASA Earth Observing System (EOS) Data and Information Systems use HDF5 as an archival format to store remote sensing data from EOS satellites. HDF5 is also used to store other types of Geoscience and Strophysical data, e.g., seismic data and data from Low-Frequency Array (LOFAR) radio telescopes. Data stored in HDF5 has reached tens of petabytes and is growing at an accelerated rate.With the growing amout of HDF5 Earth Science data to analyze and process, scientists need to adopt big data technologies including new storage paradigms such as cloud and object storage. To run models and perform data analysis they also need to utilizied efficient and diverse ways to access data, from high-performance computing's (HPC) Message Passing Interface (MPI) I/O and deep memory hierarchies (DMH) to non-HPC frameworks such as Apache Hadoop, Spark, and Drill. The HDF Group continually works to enable usage of big data technologies in HDF software.

Knox, Larry↗

Landsat Data Continuity Mission (LDCM) - Optimizing X-Band Usage

The NASA version of the low-density parity check (LDPC) 7/8-rate code, shortened to the dimensions of (8160, 7136), has been implemented as the forward error correction (FEC) schema for the Landsat Data Continuity Mission (LDCM). This is the first flight application of this code. In order to place a 440 Msps link within the 375 MHz wide X band we found it necessary to heavily bandpass filter the satellite transmitter output . Despite the significant amplitude and phase distortions that accompanied the spectral truncation, the mission required BER is maintained at < 10(exp -12) with less than 2 dB of implementation loss. We utilized a band-pass filter designed ostensibly to replicate the link distortions to demonstrate link design viability. The same filter was then used to optimize the adaptive equalizer in the receiver employed at the terminus of the downlink. The excellent results we obtained could be directly attributed to the implementation of the LDPC code and the amplitude and phase compensation provided in the receiver. Similar results were obtained with receivers from several vendors.

Garon, H. M.↗