Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data archive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Developing a Machine-Learning-Based Processing Framework for Twitter and Other Crowdsourced Data

Crowdsourced data streams such as Twitter and other social media are important sources of real-time and historical global information for Earth science applications. At the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), we have been exploring the Twitter data stream for its potential in augmenting the validation program of NASA's Global Precipitation Measurement (GPM) mission. To realize this potential, we need to increase the information density and enhance the quality of filtered precipitation tweets. We have implemented various components of a machine learning (ML)-based processing infrastructure for crowdsourced data that outputs, in this instance, useful and usable information derived from precipitation tweets. We have test enriched the Twitter stream with higher quality active tweets from those knowingly contributing to our effort and from existing crowdsourced programs (e.g., mPING, CoCoRaHS). We have experimented with various algorithms for processing tweets, including Naà ve Bayes, Convolutional Neural Network (CNN), Hierarchical Attention Network (HAN), and semi-supervised learning (with tri-training). Our current work focuses on (1) automated review of Earth science-related publications to determine relationships between discipline research needs and ML algorithms; (2) investigating Sequential Generative Adversarial Network (SeqGAN) for processing precipitation tweets for anomaly detection; and (3) managing crowdsourced data in a way that is compatible with existing NASA satellite data archives and using the data for ML applications. Key results include (1) network visualization of NLP-processed publications in various Earth science disciplines; (2) difference between GPM-linked, generated tweets and collected actual tweets that is small for GPM-determined light to moderate rain cases and high for GPM-determined heavy rain cases; and (3) identification of MongoDB for storing raw tweets and Zarr format for gridded tweets (compatible with GPM data). Our results have taken us a step closer to an operational ML-based tweet processing infrastructure and have already demonstrated that tweet-derived precipitation information is potentially useful for validation of Earth science satellite data.

Teng, William↗
NASA NTRS1974

Skylab Medical Data Center and Archives

The founding of the Skylab medical data center and archives as a central area to house medical data from space flights is described. Skylab program strip charts, various daily reports and summaries, experiment reports and logs, status report on Skylab data quality, raw data digital tapes, processed data microfilm, and other Skylab documents are housed in the data center. In addition, this memorandum describes how the data center acted as a central point for the coordination of preflight and postflight baseline data and how it served as coordinator for all data processing through computation and analysis. Also described is a catalog identifying Skylab medical experiments and all related data currently archived in the data center.

Spross, F. R.↗
NASA NTRS1990

A synopsis of Langley Research Center's lidar effort for the 1986 FIRE IFO

The lidar data obtained by the Langley Aircraft Lidar in October 1986 in Wisconsin is being reduced in a transparent, simple fashion and will be published in its reduced form in a NASA Reference Publication (RP). This reduced data will also be submitted to the FIRE data archives. Some of this reduced data will be presented at the FIRE FSET Workshop to acquaint the science team with the data format to be used in the archive and the upcoming catalog contained in the RP. A new method was utilized in Wisconsin for obtain the depolarization ratio of aerosols. This method involves using a half-wave plate to calibrate the lidar under field conditions. The theory behind this technique will be presented at this workshop as well as some of the lidar calibration results. The lidar calibration will be utilized in interpreting some of the dual polarization lidar data obtained during the IFO in Wisconsin. Some of these data are also discussed. A continuous wave laser lab-type lidar simulator was constructed during the previous year. One of the primary reasons for the construction of the simulator was to attempt dual-polarization lidar-like calibrations under laboratory, rather than field conditions. The data collected by this system was used to experimentally check and thus, inspire confidence in the algorithms being used to interpret the lidar data obtained in the field. A computer program which simulates noisy lidar data was used as a part of this effort in order to obtain some feel for the noise in the inversion parameters as a function of noise in the actual measurements. The lidar simulation will be described in addition to presenting some of the lab-generated calibration data.

Alvarez, Jose M.↗
NASA NTRS1992

EOSDIS/DADS requirements

A brief summary of the Earth Observing System Data and Information System (EOSDIS) Core System (ECS) Data Archive and Distribution System (DADS) requirements is given. Among the requirements are the following: the ECS relationship to EOSDIS Version-O; phased implementation of ECS; and data ingest, archive, and distribution daily data volumes anticipated at each of the 7 Distributed Active Archive Centers (DAAC's).

Berbert, John↗
NASA NTRS1995

The Planetary Data System Web Catalog Interface--Another Use of the Planetary Data System Data Model

The Planetary Data System Data Model consists of a set of standardized descriptions of entities within the Planetary Science Community. These can be real entities in the space exploration domain such as spacecraft, instruments, and targets; conceptual entities such as data sets, archive volumes, and data dictionaries; or the archive data products such as individual images, spectrum, series, and qubes.

interface science metadata↗
NASA NTRS1985

An optical disk archive for a data base management system

An overview is given of a data base management system that can catalog and archive data at rates up to 50M bits/sec. Emphasis is on the laser disk system that is used for the archive. All key components in the system (3 Vax 11/780s, a SEL 32/2750, a high speed communication interface, and the optical disk) are interfaced to a 100M bits/sec 16-port fiber optic bus to achieve the high data rates. The basic data unit is an autonomous data packet. Each packet contains a primary and secondary header and can be up to a million bits in length. The data packets are recorded on the optical disk at the same time the packet headers are being used by the relational data base management software ORACLE to create a directory independent of the packet recording process. The user then interfaces to the VAX that contains the directory for a quick-look scan or retrieval of the packet(s). The total system functions are distributed between the VAX and the SEL. The optical disk unit records the data with an argon laser at 100M bits/sec from its buffer, which is interfaced to the fiber optic bus. The same laser is used in the read cycle by reducing the laser power. Additional information is given in the form of outlines, charts, and diagrams.

Thomas, Douglas T.↗
NASA NTRS1990

Multi-terabyte image storage and distribution for NASA's Hubble Space Telescope

The modular architecture, functionality, and key components of the Hubble Space Telescope Data Archive Distribution Service (DADS) are presented. DADS functions comprise archive management, catalog management, and user interface. The distributed modular architecture utilized is made up of four subsystems, including the archive, host, catalog, and the Science Operations ground System/DADS Interface Processor. All data generated by the HST are archived in DADS on 12-in. optical disks. DADS is a permanent archive with a data capacity of 30 terabytes that can be expanded to 68 terabytes. Supplementary information and stellar observations will be instantly accessible through DADS, which can collect and archive more than 3 gigabytes per day of image and support data over the lifetime of the HST. Electronic and physical media will be accessible through 140 network connections, with a catalogue to assist in data set selection.

Weller, H. W., Jr.↗
NASA NTRS2015

Rapid, High-Resolution Detection of Environmental Change over Continental Scales from Satellite Data - the Earth Observation Data Cube

The effort and cost required to convert satellite Earth Observation (EO) data into meaningful geophysical variables has prevented the systematic analysis of all available observations. To overcome these problems, we utilise an integrated High Performance Computing and Data environment to rapidly process, restructure and analyse the Australian Landsat data archive. In this approach, the EO data are assigned to a common grid framework that spans the full geospatial and temporal extent of the observations - the EO Data Cube. This approach is pixel-based and incorporates geometric and spectral calibration and quality assurance of each Earth surface reflectance measurement. We demonstrate the utility of the approach with rapid time-series mapping of surface water across the entire Australian continent using 27 years of continuous, 25 m resolution observations. Our preliminary analysis of the Landsat archive shows how the EO Data Cube can effectively liberate high-resolution EO data from their complex sensor-specific data structures and revolutionise our ability to measure environmental change.

Lewis, Adam↗
NASA NTRS1995

Documentation and archiving of the Space Shuttle wind tunnel test data base. Volume 2: User's Guide to the Archived Data Base

Development of the Space Shuttle necessitated an extensive wind tunnel test program, with the cooperation of all the major wind tunnels in the United States. The result was approximately 100,000 hours of Space Shuttle wind tunnel testing conducted for aerodynamics, heat transfer, and structural dynamics. The test results were converted into Chrysler DATAMAN computer program format to facilitate use by analysts, a very cost effective method of collecting the wind tunnel test results from many test facilities into one centralized location. This report provides final documentation of the Space Shuttle wind tunnel program. The two-volume set covers the evolution of Space Shuttle aerodynamic configurations and gives wind tunnel test data, titles of wind tunnel data reports, sample data sets, and instructions for accessing the digital data base.

Romere, Paul O.↗
NASA NTRS2012

An Update on the CDDIS

The Crustal Dynamics Data Inforn1ation System (CoorS) supports data archiving and distribution activities for the space geodesy and geodynamics community. The main objectives of the system are to store space geodesy and geodynamics related data products in a central data bank, to maintain infom1ation about the archival of these data, and to disseminate these data and information in a timely mam1er to a global scientific research community. The archive consists of GNSS, laser ranging, VLBI, and OORIS data sets and products derived from these data. The coors is one of NASA's Earth Observing System Oata and Infom1ation System (EOSorS) distributed data centers; EOSOIS data centers serve a diverse user community and are tasked to provide facilities to search and access science data and products. The coors data system and its archive have become increasingly important to many national and international science communities, in pal1icular several of the operational services within the International Association of Geodesy (lAG) and its project the Global Geodetic Observing System (GGOS), including the International OORIS Service (IDS), the International GNSS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), and the International Earth Rotation Service (IERS). The coors has recently expanded its archive to supp011 the IGS Multi-GNSS Experiment (MGEX). The archive now contains daily and hourly 3D-second and subhourly I-second data from an additional 35+ stations in RINEX V3 fOm1at. The coors will soon install an Ntrip broadcast relay to support the activities of the IGS Real-Time Pilot Project (RTPP) and the future Real-Time IGS Service. The coors has also developed a new web-based application to aid users in data discovery, both within the current community and beyond. To enable this data discovery application, the CDDIS is currently implementing modifications to the metadata extracted from incoming data and product files pushed to its archive. This poster will include background information about the system and its user communities, archive contents and updates, enhancements for data discovery, new system architecture, and future plans.

Noll, Carey↗
NASA NTRS2016

Availability of Previously Unprocessed ALSEP Raw Instrument Data, Derivative Data, and Metadata Products

In year 2010, 440 original data archival tapes for the Apollo Lunar Science Experiment Package (ALSEP) experiments were found at the Washington National Records Center. These tapes hold raw instrument data received from the Moon for all the ALSEP instruments for the period of April through June 1975. We have recently completed extraction of binary files from these tapes, and we have delivered them to the NASA Space Science Data Cordinated Archive (NSSDCA). We are currently processing the raw data into higher order data products in file formats more readily usable by contemporary researchers. These data products will fill a number of gaps in the current ALSEP data collection at NSSDCA. In addition, we have estabilished a digital, searcheable archive of ALSEP document and metadata as part of the web portal of the Lunar and Planetary Institute. It currently holds approx. 700 documents totaling approx. 40,000 pages

ALSEP↗
NASA NTRS2011

Improvements in Space Geodesy Data Discovery at the CDDIS

The Crustal Dynamics Data Information System (CDDIS) supports data archiving and distribution activities for the space geodesy and geodynamics community. The main objectives of the system are to store space geodesy and geodynamics related data products in a central data bank. to maintain information about the archival of these data, and to disseminate these data and information in a timely manner to a global scientific research community. The archive consists of GNSS, laser ranging, VLBI, and DORIS data sets and products derived from these data. The CDDIS is one of NASA's Earth Observing System Data and Information System (EOSDIS) distributed data centers; EOSDIS data centers serve a diverse user community and arc tasked to provide facilities to search and access science data and products. Several activities are currently under development at the CDDIS to aid users in data discovery, both within the current community and beyond. The CDDIS is cooperating in the development of Geodetic Seamless Archive Centers (GSAC) with colleagues at UNAVCO and SIO. TIle activity will provide web services to facilitate data discovery within and across participating archives. In addition, the CDDIS is currently implementing modifications to the metadata extracted from incoming data and product files pushed to its archive. These enhancements will permit information about COOlS archive holdings to be made available through other data portals such as Earth Observing System (EOS) Clearinghouse (ECHO) and integration into the Global Geodetic Observing System (GGOS) portal.

Noll, C.↗
NASA NTRS2003

HEASARC Software Archive

(1) Chandra Archive: SAO has maintained the interfaces through which HEASARC gains access to the Chandra Data Archive. At HEASARC's request, we have implemented an anonymous ftp copy of a major part of the public archive and we keep that archive up-to- date. SAO has participated in the ADEC interoperability working group, establishing guidelines or interoperability standards and prototyping such interfaces. We have provided an NVO-based prototype interface, intending to serve the HEASARC-led NVO demo project. HEASARC's Astrobrowse interface was maintained and updated. In addition, we have participated in design discussions surrounding HEASARC's Caldb project. We have attended the HEASARC Users Group meeting and presented CDA status and developments. (2) Chandra CALDB: SA0 has maintained and expanded the Chandra CALDB by including four new data file types, defining the corresponding CALDB keyword/identification structures. We have provided CALDB upgrades for the public (CIAO) and for Standard Data Processing. Approximately 40 new files have been added to the CALDB in these version releases. There have been in the past year ten of these CALDB upgrades, each with unique index configurations. In addition, with the inputs from software, archive, and calibration scientists, as well as CIAO/SDP software developers, we have defined a generalized expansion of the existing CALDB interface and indexing structure. The purpose of this is to make the CALDB more generally applicable and useful in new and future missions that will be supported archivally by HEASARC. The generalized interface will identify additional configurational keywords and permit more extensive calibration parameter and boundary condition specifications for unique file selection. HEASARC scientists and developers from SAO and GSFC have become involved in this work, which is expected to produce a new interface for general use within the current year. (3) DS9: One of the decisions that came from last year's HEADCC meeting was to make the ds9 image display program the primary vehicle for displaying line graphics (as well as images). The first step required to make this possible was to enhance the line graphics capabilities of ds9. SAO therefore spent considerable effort upgrading ds9 to use Tcl 8.4 so that the BLT line graphics package could be built and imported into ds9 from source code, rather than from a pre-built (and generally outdated) shared library. This task, which is nearly complete, allows us to extend BLT as needed for the HEAD community. Following HEADCC discussion concerning archiving and the display of archived data, we extended ds9 to support full access to many astronomical Web-based archives sites, including HEASARC, MAST, CHANDRA, SKYVIEW, ADS, NED, SIMBAD, IRAS, NVRO, SAO TDC, and FIRST. Using ds9's new internal Web access capabilities, these archives can be accessed via their Web page. FITS images, plots, spectra, and journal abstracts can be referenced, down-loaded, and displayed directly and easily in ds9. For more information, see: http://hea-www.harvard.edu/saord/ds9. Also after the HEADCC discussion concerning region filtering, we extended the Funtools sample implementation of region filtering as described in: http://hea-www.harvard.edu/saord/funtools/regions.html. In particular, we added several new composite regions for event and image filtering, including elliptical and box annuli. We also extended the panda (Pie AND Annulus) region support to include box pandas and elliptical pandas. These new composite regions are especially useful in programs that need to count photons in each separate region using only a single pass through the data. Support for these new regions was added to ds9. In the same vein, we developed new region support for filtering images using simple FITS image masks, i.e. 8-bit or 16-bit FITS images where the value of a pixel is the region id number for that pixel. Other important enhancements to DS9 this year, include supporor multiple world coordinate systems, three dimensional event file binning, image smoothing, region groups and tags, the ability to save images in a number of image formats (such as JPEG, TIFF, PNG, FITS), improvements in support for integrating external analysis tools, and support for the virtual observatory. In particular, a full-featured web browser has been implemented within D S 9 . This provides support for full access to HEASARC archive sites such as SKYVIEW and W3BROWSE, in addition to other astronomical archives sites such as MAST, CHANDRA, ADS, NED, SIMBAD, IRAS, NVRO, SA0 TDC, and FIRST. From within DS9, the archives can be searched, and FITS images, plots, spectra, and journal abstracts can be referenced, downloaded and displayed The web browser provides the basis for the built-in help facility. All DS9 documentation, including the reference manual, FAQ, Know Features, and contact information is now available to the user without the need for external display applications. New versions of DS9 maybe downloaded and installed using this facility. Two important features used in the analysis of high energy astronomical data have been implemented in the past year. The first is support for binning photon event data in three dimensions. By binning the third dimension in time or energy, users are easily able to detect variable x-ray sources and identify other physical properties of their data. Second, a number of fast smoothing algorithms have been implemented in DS9, which allow users to smooth their data in real time. Algorithms for boxcar, tophat, and gaussian smoothing are supported.

White, Nicholas↗
NASA NTRS1992

Space Station Freedom Environmental Health Care Program

The paper discusses the environmental planning and monitoring aspects of the Space Station Freedom (SSF) Environmental Health Care Program, which encompasses all phases of the SSF assembly and operation from the first element entry at MB-6 through the Permanent Manned Capability and beyond. Environmental planning involves the definition of acceptability limits and monitoring requirements for the radiation dose barothermal parameters and potential contaminants in the SSF air and water and on internal surfaces. Inflight monitoring will be implemented through the Environmental Health System, which consists of five subsystems: Microbiology, Toxicology, Water Quality, Radiation, and Barothermal Physiology. In addition to the environmental data interpretation and analysis conducted after each mission, the new data will be compared to archived data for statistical and long-term trend analysis and determination of risk exposures. Results of these analyses will be used to modify the acceptability limits and monitoring requirements for the future.

Richard, Elizabeth E.↗
NASA NTRS1994

Compendium of NASA data base for the Global Tropospheric Experiment's Arctic Boundary Layer Experiments ABLE-3A and ABLE-3B

The report provides a compendium of NASA aircraft data that are available from NASA's Global Tropospheric Experiment's (GTE) Arctic Boundary Layer Experiments (ABLE) conducted in July and August of 1988 (ABLE-3A) and 1990 (ABLE-3B). ABLE-3A flight experiments were based at Barrow and Bethel, Alaska, and included survey/transit flights to Thule, Greenland. ABLE-3B flight experiments were based at North Bay (Ontario) and Goose Bay, Canada, and included flights northward to Frobisher Bay, Canada. The primary purposes of the experiments were (1) the measurement of the flux of various trace gases from high-arctic ecosystems, (2) the elucidation of factors important to the production and destruction of ozone, and (3) the documentation of source and chemical signature of air common to and transported into the regions. The report provides a representation, in the form of selected data plots, of aircraft data that are available in archived format via NASA Langley's Distributed Active Archive Center. The archived data bases include data for other species measured on the aircraft as well as numerous supporting data, including meteorological observations/products, results from surface studies, satellite observations, and sondes releases.

Gregory, Gerald L.↗
NASA NTRS1994

Data assimilation and model evaluation experiment datasets

The Institute for Naval Oceanography, in cooperation with Naval Research Laboratories and universities, executed the Data Assimilation and Model Evaluation Experiment (DAMEE) for the Gulf Stream region during fiscal years 1991-1993. Enormous effort has gone into the preparation of several high-quality and consistent datasets for model initialization and verification. This paper describes the preparation process, the temporal and spatial scopes, the contents, the structure, etc., of these datasets. The goal of DAMEE and the need of data for the four phases of experiment are briefly stated. The preparation of DAMEE datasets consisted of a series of processes: (1) collection of observational data; (2) analysis and interpretation; (3) interpolation using the Optimum Thermal Interpolation System package; (4) quality control and re-analysis; and (5) data archiving and software documentation. The data products from these processes included a time series of 3D fields of temperature and salinity, 2D fields of surface dynamic height and mixed-layer depth, analysis of the Gulf Stream and rings system, and bathythermograph profiles. To date, these are the most detailed and high-quality data for mesoscale ocean modeling, data assimilation, and forecasting research. Feedback from ocean modeling groups who tested this data was incorporated into its refinement. Suggestions for DAMEE data usages include (1) ocean modeling and data assimilation studies, (2) diagnosis and theoretical studies, and (3) comparisons with locally detailed observations.

Lai, Chung-Cheng A.↗
NASA NTRS2004

Rapid Measurements of Aerosol Ionic Composition and 3-10 nm Particle Size Distributions On The NASA P3 To Better Quantify Processes Affecting Aerosols Advected From East Asia

The Particle Into Liquid Sample (PILS) was deployed on the NASA P3 for airborne measurements of fine particle ionic chemical composition. The data have been quality assured and reside in the NASA data archive. We have analyzed our data to characterize the sources and atmospheric processing of fine aerosol particles advected from the region during the experiments. Fine particle water-soluble potassium was found to serve as a useful aerosol tracer for biomass smoke. Ratios of PILS potassium to sulfate are used as a means of estimating the percent contribution of biomass burning to fine particle mass in mixed plumes advecting from Asia. The high correlations between K+ and NO3(sup -) and NH4(sup +)' indicated that biomass burning was a significant source of these aerosol compounds in the region. It is noteworthy that the air mass containing the highest concentrations of fine particles recorded in all of ACE-Asia and TRACE-P appeared to be advecting from the Bejing/Tientsin urban region and also had the highest K(+), NO3(sup -) and NH4(sup +) concentrations of both studies. Based on K+/SO4(sup 2-) ratio's, we estimated that the plume was composed of approx. 60% biomass burning emissions, possibly from the use of bio-fuels in the urban regions.

Weber, Rodney J.↗