Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing and archiving”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

NASA biological and physical sciences databases: who’s the FAIRest of them all?

Conceptual models are a key part of the foundation of scientific study. Scientific data discovery and retrieval are often inaccurate and incomplete because these models are not sufficiently well-incorporated into data retrieval systems. Systems often don’t provide the necessary tools to those producing scientific data to fully and unambiguously annotate them and the result is consumers of the data cannot find them efficiently. The capability of data archives to provide these tools to link data to underlying conceptual models is one of dimensions of the recently developed “FAIR” principles (https://www.go-fair.org/fair-principles/ ), and is key to many automated processes being able to operate on these data, particularly analytics involving artificial intelligence. We used an open-source web service to measure the FAIR compliance of the three data archives operated by NASA for the biological and physical sciences: the Life Sciences Data Archive, the Physical Sciences Informatics database, and GeneLab. The service ingests references to data sets in these archives, and then executes domain-non-specific examinations of these data and metadata that test compliance to the FAIR principles. Of the 22 metrics tested, GeneLab passed 11 (50%), and PSI and LSDA each passed 7 (32%). These data were gathered using only one representative data set from each archive and we anticipate variability in results as we continue to apply these metrics to other data. A preliminary study of the failure traces for each metric suggests there is a wide range of effort and complexity in the enhancements required for each system to elevate FAIR compliance, and this is the subject of continued investigation. This information has been and will likely continue to be important information in planning these enhancements, with the goal of increased readiness of the data for automated processes.

database↗
NASA NTRSDate not supplied

Enabling Space Biological Knowledge Discovery Through Image and Video Data Sharing

Increased biomedical risks associated with deep space crewed missions (cis-Lunar, Mars transit/surface) require development of health countermeasures, novel ecosystem support, risk modeling, and fundamental space biological knowledge discovery. Molecular-omics, physiological-phenotypic-behavioral, and environmental-radiation telemetry data from space biological and health studies are needed for reuse by scientists to address these tasks. The data as well as space-relevant biospecimens are being made more findable, accessible, interoperable, and reusable through NASA’s Open Science Data Repository (OSDR). This new OSDR umbrella grouping includes NASA GeneLab, the NASA Ames Life Sciences Data Archive (ALSDA), and the NASA Biological Institutional Scientific Collection. The OSDR system design appropriately handles metadata and processed-tabular results from ALSDA studies collected from space experiments. But raw and processed ALSDA bioimage and video datasets require an expansion of OSDR’s data architecture to handle ingestion, curation, and egress. The academic-industry bioimaging field saw a scientific renaissance in the past several years through leveraging open-source software, international collaborations, machine learning, and other open science/programming approaches. As crewed missions and more biological experiments are on the deep space horizon, OSDR is embracing data stewardship through listening to feedback from subject matter experts and designing an expanded architecture which is appropriate for NASA’s goals to enable analysis and reuse of bioimaging and video data for the public science community.Discovery Through Image and Video Data Sharing

space biology↗
NASA NTRS1995

(abstract) Global Gravity and Topography

This paper will discuss global gravity and topography, pole orientation, rotation, and a geodetic control network. The gravity reductions produced two products for geophysical modeling. They are line-of-sight acceleration profiles and spherical harmonic coefficients. The acceleration profiles were generated from the raw Doppler residual on a single orbit of Magellan (MGN) radio tracking data. There are over 2500 profiles from excellent X-band Doppler tracking, producing over three million individual observations. The topography data acquired by the radar altimeter on MGN were reduced and archived as three different products. The Venus spin pole orientation, rotation rate and geodetic control network were obtained by processing the SAR imaging data independently and also by incorporating Doppler radio tracking and radar altimetry. Some data from Pioneer Venus Orbiter and Venera were used also.

Venus Magellan Venera Pioneer Venus Orbiter gravit↗
NASA NTRSDate not supplied

GeoNEX-ML: A Machine Learning System for Geostationary Satellite Imagery

Improved capabilities of earth monitoring satellites are enabling a wide range of studies on the environmental effects of climate change, often leveraging the recent advancements in machine learning. At the same time, the new capabilities, including higher spatial resolution and temporal frequency, are expanding the amount of data generated at exponential rates. Further, a large majority of archived datasets generated by scientific processing is never used. This motivates the development of an efficient machine learning system for end-to-end processing of multi-level satellite datasets, from level 1 top of atmosphere observations to user friendly environmental variables of interest. Using current generation geostationary satellites GOES-16/17 (NOAA/NASA), Himawari-8/9 (JAXA), and GK-2A (Korea), we present an interchangeable set of machine models to perform spectral adjustment, physical model emulation, LEO-GEO emulation, and optical flow in a high performance computing environment. We use these tools to generate consistent virtual observations across sensors, perform atmospheric correction and cloud detection, and estimate land surface temperature and atmospheric winds. This approach aims to improve the robustness of remotely sensed data processing by learning from diverse sets of observations while enabling near real-time and on-demand capabilities.

Geostationary satellites↗
NASA NTRS2017

A Comparison of the SOCIT and DebriSat Experiments

This paper explores the differences between, and shares the lessons learned from, two hypervelocity impact experiments critical to the update of orbital debris environment models. The procedures and processes of the fourth Satellite Orbital Debris Characterization Impact Test (SOCIT) were analyzed and related to the ongoing DebriSat experiment. SOCIT was the first hypervelocity impact test designed specifically for satellites in Low Earth Orbit (LEO). It targeted a 1960's U.S. Navy satellite, from which data was obtained to update pre-existing NASA and DOD breakup models. DebriSat is a comprehensive update to these satellite breakup models- necessary since the material composition and design of satellites have evolved from the time of SOCIT. Specifically, DebriSat utilized carbon fiber, a composite not commonly used in satellites during the construction of the US Navy Transit satellite used in SOCIT. Although DebriSat is an ongoing activity, multiple points of difference are drawn between the two projects. Significantly, the hypervelocity tests were conducted with two distinct satellite models and test configurations, including projectile and chamber layout. While both hypervelocity tests utilized soft catch systems to minimize fragment damage to its post-impact shape, SOCIT only covered 65% of the projected area surrounding the satellite, whereas, DebriSat was completely surrounded cross-range and downrange by the foam panels to more completely collect fragments. Furthermore, utilizing lessons learned from SOCIT, DebriSat's post-impact processing varies in methodology (i.e., fragment collection, measurement, and characterization). For example, fragment sizes were manually determined during the SOCIT experiment, while DebriSat utilizes automated imaging systems for measuring fragments, maximizing repeatability while minimizing the potential for human error. In addition to exploring these variations in methodologies and processes, this paper also presents the challenges DebriSat has encountered thus far and how they were addressed. Accomplishing DebriSat's goal of collecting 90% of the debris, which constitutes well over 100,000 fragments, required addressing many challenges stemming from the very large number of fragments. One of these challenges arose in identifying the foam-embedded fragments. DebriSat addressed this by X-raying all of the panels once the loose debris were removed, and applying a detection algorithm developed in-house to automate the embedded fragment identification process. It is easy to see how the amount of data being compiled would be outstanding. Creating an efficient way to catalog each fragment, as well as archiving the data for reproducibility also posed a great challenge for DebriSat. Barcodes to label each fragment were introduced with the foresight that once the characterization process began, the datasheet for each fragment would have to be accessed again quickly and efficiently. The DebriSat experiment has benefited significantly by leveraging lessons learned from the SOCIT experiment along with the technological advancements that have occurred during the time between the experiments. The two experiments represent two ages of satellite technology and, together, demonstrate the continuous efforts to improve the experimental techniques for fragmentation debris characterization.

Ausay, Erick↗
NASA NTRS2007

AIRSAR Web-Based Data Processing

The AIRSAR automated, Web-based data processing and distribution system is an integrated, end-to-end synthetic aperture radar (SAR) processing system. Designed to function under limited resources and rigorous demands, AIRSAR eliminates operational errors and provides for paperless archiving. Also, it provides a yearly tune-up of the processor on flight missions, as well as quality assurance with new radar modes and anomalous data compensation. The software fully integrates a Web-based SAR data-user request subsystem, a data processing system to automatically generate co-registered multi-frequency images from both polarimetric and interferometric data collection modes in 80/40/20 MHz bandwidth, an automated verification quality assurance subsystem, and an automatic data distribution system for use in the remote-sensor community. Features include Survey Automation Processing in which the software can automatically generate a quick-look image from an entire 90-GB SAR raw data 32-MB/s tape overnight without operator intervention. Also, the software allows product ordering and distribution via a Web-based user request system. To make AIRSAR more user friendly, it has been designed to let users search by entering the desired mission flight line (Missions Searching), or to search for any mission flight line by entering the desired latitude and longitude (Map Searching). For precision image automation processing, the software generates the products according to each data processing request stored in the database via a Queue management system. Users are able to have automatic generation of coregistered multi-frequency images as the software generates polarimetric and/or interferometric SAR data processing in ground and/or slant projection according to user processing requests for one of the 12 radar modes.

Chu, Anhua↗
NASA NTRS1979

Lunar laser ranging data identification and management

Activity under the subject grant during the first half of fiscal year 1979 at the University of Texas at Austin is reported. Raw lunar laser ranging data submitted by McDonald Observatory, Fort Davis, Texas and by the Australian Division of National Mapping at Orroral Valley, Australia were processed. This processing includes the filtering of signal events from noise photons, normal point formation, data archive management, and data distribution. System-wide program maintenance and up-grade carried out wherever and whenever necessary. Lunar laser ranging data is being transmitted from Austin to Paris for the extraction of earth rotation information during the EROLD campaign.

Source record↗
NASA NTRS1984

A summary of results from the first Nimbus 7 SMMR observations

Selected data obtained during the first year of operation of the scanning multichannel microwave radiometer (SMMR) on board the Nimbus 7 satellite (launched in late October 1978) have been used to calculate, on a global basis, various geophysical parameters over open oceans, polar regions, and terrain. Over open oceans these calculations have provided values for sea surface temperatures, near-surface winds, atmospheric water vapor in a column, and rainfall rates. In polar regions, sea ice concentration, multiyear ice fraction, and radiating temperatures have been obtained. Finally, the extent and water equivalence of snow cover over terrain have been calculated. These parameters have been compared with in situ measurements of the same geophysical parameters, where available, and the results of these comparisons are described. The self-consistency of the global displays of all the parameters is discussed along with the plans for archiving them for subsequent research purposes. A description of the SMMR calibration and data processing scheme is also given.

Gloersen, P.↗
NASA NTRS2001

An Approach to Data Center-Based KDD of Remote Sensing Datasets

The data explosion in remote sensing is straining the ability of data centers to deliver the data to the user community, yet many large-volume users actually seek a relatively small information component within the data, which they extract at their sites using Knowledge Discovery in Databases (KDD) techniques. To improve the efficiency of this process, the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) has implemented a KDD subsystem that supports execution of the user's KDD algorithm at the data center, dramatically reducing the volume that is sent to the user. The data are extracted from the archive in a planned, organized "campaign"; the algorithms are executed, and the output products sent to the users over the network. The first campaign, now complete, has resulted in overall reductions in shipped volume from 3.3 TB to 0.4 TB.

Lynnes, Christopher↗
NASA NTRS2016

Advancing User Supports with a Structured How-To Knowledge Base for Earth Science Data

It is a challenge to access and process fast growing Earth science data from satellites and numerical models, which may be archived in very different data format and structures. NASA data centers, managed by the Earth Observing System Data and Information System (EOSDIS), have developed a rich and diverse set of data services and tools with features intended to simplify finding, downloading, and working with these data. Although most data services and tools have user guides, many users still experience difficulties with accessing or reading data due to varying levels of familiarity with data services, tools, and/or formats. A type of structured online document, data recipe, were created in beginning 2013 by Goddard Earth Science Data and Information Services Center (GES DISC). A data recipe is the How-To document created by using the fixed template, containing step-by-step instructions with screenshots and examples of accessing and working with real data. The recipes has been found to be very helpful, especially to first-time-users of particular data services, tools, or data products. Online traffic to the data recipe pages is significant to some recipes. In 2014, the NASA Earth Science Data System Working Group (ESDSWG) for data recipes was established, aimed to initiate an EOSDIS-wide campaign for leveraging the distributed knowledge within EOSDIS and its user communities regarding their respective services and tools. The ESDSWG data recipe group started with inventory and analysis of existing EOSDIS-wide online help documents, and provided recommendations and guidelines and for writing and grouping data recipes. This presentation will overview activities of creating How-To documents at GES DISC and ESDSWG. We encourage feedback and contribution from users for improving the data How-To knowledge base.

how-to↗
NASA NTRSDate not supplied

Digital Twin Technology for Aviation

As technology progresses, so have the tools for data visualization. This project presents a digital twin model of the San Francisco airport displaying a 10-minute window of historical flight data, visualizing the trajectory data of airplanes and vehicles in three dimensions. Multiple different cameras where implemented to fully utilize the 3D visualization. This is a 100:1 feet scale model created in Autodesk Maya, using the airport center as the origin and recalculating all coordinates accordingly featuring the airport, some surrounding buildings, and the bay. For this project, six different models of airplanes were modeled at a 50:1 feet scale with texturing to mimic real-world aircraft models along with certain airlines. The animation is driven through archived data captured from NASA’s Sherlock Open-Data Portal, cleaned of noisy data points, processed into useable data formats, and implemented into a Maya ASCII file of animation paths with the corresponding previously-stated airplane models attached all using Java based conversion program.

Aleksander Schade↗
NASA NTRS1992

An open, parallel I/O computer as the platform for high-performance, high-capacity mass storage systems

APTEC Computer Systems is a Portland, Oregon based manufacturer of I/O computers. APTEC's work in the context of high density storage media is on programs requiring real-time data capture with low latency processing and storage requirements. An example of APTEC's work in this area is the Loral/Space Telescope-Data Archival and Distribution System. This is an existing Loral AeroSys designed system, which utilizes an APTEC I/O computer. The key attributes of a system architecture that is suitable for this environment are as follows: (1) data acquisition alternatives; (2) a wide range of supported mass storage devices; (3) data processing options; (4) data availability through standard network connections; and (5) an overall system architecture (hardware and software designed for high bandwidth and low latency). APTEC's approach is outlined in this document.

Abineri, Adrian↗
NASA NTRS2019

GeneLab: A Systems Biology Platform for Omics Analysis

NASA GeneLab is an open-access repository for omics datasets generated by biological experiments conducted in space or experiments relevant to spaceflight (e.g. simulated cosmic radiation, simulated microgravity, bed rest studies). The GeneLab Data Systems (GLDS) version 4.0 will be available on October 1st 2019, and will provide the latest in terms of professional state-of-the-art bioinformatics platform for the space biology and radiation community to upload their data into an omics data commons, to process their data with vetted standard workflows and to compare to existing analyses. Started in 2015 as a repository designed to archive omics data from space experiments, GeneLab has expanded its scope to all ionizing radiation omics experiments conducted on the ground and has put considerable effort in providing carefully characterized radiation metadata on all dataset. GeneLab is also providing processed data derived from the raw data covering a large spectrum of omics (genome, epigenome, transcriptome, epitranscriptome, proteome, metabolome) to help users explore important questions: 1) Which genes or proteins are expressed differently in space for various living organisms? 2) What specific DNA mutations or epigenetic changes happen in space or after exposure to ionizing radiation? and 3) How does genetics affect these responses? Processed data available on GeneLab are derived by standard data analysis workflows vetted by hundreds of scientists who volunteered to join one of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). In this presentation, we will discuss how to bridge the gap between irradiation studies performed on earth and biological experiments conducted in space since the early 1990's. We will discuss how radiation dosimetry was estimated for datasets derived from samples collected during the Space Shuttle era or on the International Space Station. Finally, we will address future strategies regarding dose monitoring in future missions into space, inter-agency efforts to unify data under one umbrella, and knowledge dissemination across the radiation research community and the space biology community.

open-science↗
NASA NTRS2019

NASA GeneLab Space Omics Database: Expanding from Space to Ionizing Radiation Data on the Ground

NASA GeneLab is an open-access repository for omics datasets generated by biological experiments conducted in space or ground experiments relevant to spaceflight (e.g. simulated cosmic radiation, simulated microgravity, bed rest studies). The GeneLab Data Systems (GLDS) version 4.0 will be available on October 1st 2019, and will provide a state-of-the-art bioinformatics platform for the space biology and radiation communities to upload their data into an omics data commons, to process their data with vetted standard workflows and to compare with existing analyses. Started in 2015 as a repository designed to archive omics data from space experiments, GeneLab has expanded its scope to all ionizing radiation omics experiments conducted on the ground and has put considerable effort in providing carefully characterized radiation metadata on all datasets. GeneLab is also providing processed data derived from the raw data covering a large spectrum of omics (genome, epigenome, transcriptome, epitranscriptome, proteome, metabolome) to help users explore important questions: 1) Which genes or proteins are expressed differently in space for various living organisms? 2) What specific DNA mutations or epigenetic changes happen in space or after exposure to ionizing radiation? and 3) How does genetics affect these responses? Processed data available on GeneLab are derived by standard data analysis workflows vetted by hundreds of scientists who volunteered to join one of the four GeneLab Analysis Working Groups (Animal AWG, Plant AWG, Microbe AWG, Multi-Omics AWG). In this presentation, we will discuss how to bridge the gap between irradiation studies performed on earth and biological experiments conducted in space since the early 1990's. We will discuss how radiation dosimetry was estimated for datasets derived from samples collected during the Space Shuttle era on the International Space Station and on other orbiting platforms. Finally, we will address future strategies regarding dose monitoring in future missions into space, inter-agency efforts to unify data under one umbrella, and knowledge dissemination across the radiation research community and the space biology community.

open-science↗
NASA NTRS2004

Value-added Data Services at the Goddard Earth Sciences Data and Information Services Center

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in addition to serving the Earth Science community as one of the major Distributed Active Archives Centers (DAACs), provides much more than just data. Among the value-added services available to general users are subsetting data spatially and/or by parameter, online analysis (to avoid downloading unnecessarily all the data), and assistance in obtaining data from other centers. Services available to data producers and high-volume users include consulting on building new products with standard formats and metadata and construction of data management systems. A particularly useful service is data processing at the DISC (i.e., close to the input data) with the users algorithm. This can take a number of different forms: as a configuration-managed algorithm within the main processing stream; as a stand-alone program next to the on-line data storage; as build-it-yourself code within the Near-Archive Data Mining (NADM) system; or as an on-the-fly analysis with simple algorithms embedded into the web-based tools. Partnerships between the GES DISC and scientists, both producers and users, allow the scientists to concentrate on science, while the GES DISC handles the data management, e.g., formats, integration, and data processing. The existing data management infrastructure at the GES DISC supports a wide spectrum of options: from simple data support to sophisticated on-line analysis tools, producing economies of scale and rapid time-to-deploy. At the same time, such partnerships allow the GES DISC to serve the user community more efficiently and to better prioritize on-line holdings. Several examples of successful partnerships are described in the presentation.

Leptoukh, Gregory G.↗
NASA NTRS1997

Encounter Geometry and Science Data Gathering Simulation

Each space mission follows the process cycle of design, development, intergration and test, launch and operation, science analysis and archive. The desire for more frequent and cost effective missions has motivated various new research and development efforts to reduce the design to launch period and the operarion/analysis costs.

Cost↗
NASA NTRS2012

Direct Detection and Orbit Analysis of the Exoplanets HR 8799 bcd from Archival 2005 Keck/NIRC2 Data

We present previously unpublished July 2005 H-band coronagraphic data of the young, planet-hosting star HR 8799 from the newly-released Keck/NIRC2 archive. Despite poor observing conditions, we detect three of the planets (HR 8799 bcd), two of them (HR 8799 bc) without advanced image processing. Comparing these data with previously published 1998-2011 astrometry and that from re-reduced October 2010 Keck data constrains the orbits of the planets. Analyzing the planets' astrometry separately, HR 8799 d's orbit is likely inclined at least 25 deg from face-on and the others may be on in inclined orbits. For semimajor axis ratios consistent with a 4:2:1 mean-motion resonance our analysis yields precise values for HR 8799 bcd's orbital parameters and strictly constrains the planets' eccentricities to be less than 0.18-0.3. However, we find no acceptable orbital solutions with this resonance that place the planets in face-on orbits; HR 8799 d shows the largest deviation from such orbits. Moreover, few orbits make HR 8799 d coplanar with b and c, whereas dynamical stability analyses used to constrain the planets' masses typically assume coplanar and/or fare.on orbits. This paper illustrates the significant science gain enabled with the release of the NIRC2 archive.

Currie, Thayne↗