Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

ICARTT File Format Enhancements: Supporting FAIRness and Data Discovery of Suborbital Campaign Data

Suborbital campaigns aim to accomplish a wide variety of goals and can include a variety of platforms, instruments, and parameters measured. In 2004, the ICARTT (International Consortium for Atmospheric Research on Transport and Transformation) standards were developed to fulfill data management needs for the ICARTT campaign. The ICARTT file format is text-based and composed of a header with important data description information and the data section. Built on the NASA Ames and GTE data formats, the ICARTT format was created to facilitate data exchange and promote collaborations among the science teams for achieving the ICARTT campaign goals. Due to its success and adaptation for use in many other field campaigns, the ICARTT file format became a NASA standard in 2010 and was amended in January 2017. These changes provided many enhancements, including the requirement for variable standard names. Primarily designed for airborne field studies, ICARTT has been further utilized for ground-based studies. NASA has made a commitment to build an inclusive open science community over the next decade. Open-source science strives to make publicly funded scientific research transparent, inclusive, accessible, and reproducible. The ICARTT format can host metadata that is critical for proper use of the data, particularly for in-situ measurements, and can enhance data discovery and accessibility. However, the required fields are often free text, meaning that the information is human readable, but not machine interpretable. Furthermore, the amount and type of information provided can vary significantly between principal investigators and campaigns. To support FAIR principles and interoperability, enhancements to the ICARTT standards are recommended. Possible recommendations include potential use of controlled and consistent vocabulary for variable standard name and certain common metadata elements; standardizing timestamps for easier data comparisons and analysis; and providing guidance on variable measurement units and how they are reported. Enhancing ICARTT metadata can further streamline the process to make suborbital data more readily available to the data user and improve variable-level metadata. Providing more variable-level metadata can enhance data searching and discovery, supporting NASA’s Open-Source Science Initiative (OSSI).

Megan Buzanowicz↗
NASA NTRS2017

Use of Schema on Read in Earth Science Data Archives

Traditionally, NASA Earth Science data archives have file-based storage using proprietary data file formats, such as HDF and HDF-EOS, which are optimized to support fast and efficient storage of spaceborne and model data as they are generated. The use of file-based storage essentially imposes an indexing strategy based on data dimensions. In most cases, NASA Earth Science data uses time as the primary index, leading to poor performance in accessing data in spatial dimensions. For example, producing a time series for a single spatial grid cell involves accessing a large number of data files. With exponential growth in data volume due to the ever-increasing spatial and temporal resolution of the data, using file-based archives poses significant performance and cost barriers to data discovery and access. Storing and disseminating data in proprietary data formats imposes an additional access barrier for users outside the mainstream research community. At the NASA Goddard Earth Sciences Data Information Services Center (GES DISC), we have evaluated applying the schema-on-read principle to data access and distribution. We used Apache Parquet to store geospatial data, and have exposed data through Amazon Web Services (AWS) Athena, AWS Simple Storage Service (S3), and Apache Spark. Using the schema-on-read approach allows customization of indexing spatially or temporally to suit the data access pattern. The storage of data in open formats such as Apache Parquet has widespread support in popular programming languages. A wide range of solutions for handling big data lowers the access barrier for all users. This presentation will discuss formats used for data storage, frameworks with This presentation will discuss formats used for data storage, frameworks with support for schema-on-read used for data access, and common use cases covering data usage patterns seen in a geospatial data archive.

cloud applications↗
NASA NTRS2003

New Model for Agglutinitic Glass Formation from LSCC Data

Since the return of the first lunar samples it has been well known that glass-welded aggregates (agglutinates) accumulate in lunar soil as the result of multiple processes, many of which are driven by micrometeorite impacts. The proportion of agglutinates increases with increasing exposure to the space environment, and for an individual soil the proportion of agglutinates also increases with decreasing particle size. Detailed chemical and petrographic analyses of a suite of mare soils and their agglutinate constituents prepared by the Lunar Soil Characterization Consortium appeared to confirm the "Fusion of the Finest Fraction" model for agglutinate formation (or F3) proposed by Papike et al. However, recent LSCC data for highland soils are not consistent with the F3 model and alternate models for agglutinate formation must be revisited. Instead, we suggest differential melting of soil species may be more consistent with the full range of soil data to date.

Pieters, C. M.↗
NASA NTRSDate not supplied

Simplifying Analysis of Hierarchical HDF5 and NetCDF4 Files with Xarray-Datatree

NASA’s Earth Observing System Data and Information System (EOSDIS) contains thousands of Earth science datasets from satellites, models, and field campaigns. EOSDIS data are stored in formats that are well supported by the Earth Science community. These formats include the Hierarchical Data Format (HDF), with derivative flavors such as HDF-5 and the Network Common Data Format (NetCDF-4). The HDF specification allows for a directory-like hierarchy within a single file, known as "groups". Observational data and associated metadata within a single file can be distributed amongst multiple internal groups, which can also be nested to multiple levels. Working with datasets that have a group hierarchical structure can be difficult because of the nested structure of groups. Widely used packages, such as xarray, have data models that do not accommodate the hierarchical structure within HDF files, requiring users to traverse the file and open different HDF groups as separate, unrelated objects. Xarray-datatree is a Python package developed to solve the difficulty of traversing HDFs with a hierarchical group structure by creating a tree-like hierarchical data structure in xarray. The tree-like structure allows each group to be accessed once a DataTree object is instantiated. The migration of xarray-datatree into the xarray core library will reduce barriers to accessing Earth science data by eliminating the need to understand and traverse the specific hierarchy of a grouped HDF file.

Eni Awowale↗
NASA NTRS2005

Northern Hemisphere Gullies on Mars: Analysis of Spacecraft Data and Implications for Formation Mechanisms

The origin of geologically recent gullies on Mars has remained controversial since the discovery of these features by Malin and Edgett in 2000. Numerous models have been proposed which invoke various physical processes as well as various agents of erosion to explain the origin of the Martian gullies. Hypotheses to explain the formation of the gullies invoke shallow liquid water aquifers, deep liquid water aquifers, melting ground ice, snowmelt, dry landslides, and carbon dioxide aquifers. We test the validity of such gully formation mechanisms by analyzing data from the Mars Global Surveyor and Mars Odyssey spacecrafts to uncover trends in the dimensional and physical properties of the gullies and their surrounding terrain. A similar study has previously been completed for gullies located in the southern hemisphere of Mars. The work presented here focuses exclusively on gullies in the northern hemisphere based on the identification of 136 Mars Orbiter Camera (MOC) images containing clear evidence of gully landforms, distributed in the northern mid and high latitudes. These sites have been analyzed in combination with Mars Orbiter Laser Altimeter (MOLA), Thermal Emission Spectrometer (TES), and Gamma Ray Spectrometer (GRS) data to provide quantitative measurements of numerous gully characteristics. Parameters measured include apparent source depth and distribution, vertical and horizontal dimensions, slopes, compass orientations, near-surface ice content, and factors controlling present-day climatic conditions.

Heldmann, J. L.↗
NASA NTRS1979

UHF coplanar-slot antenna for aircraft-to-satellite data communications

The initiative for starting the Aircraft-to-Satellite Data Relay (ASDAR) Program came from a recognition that much of the world's weather originates in the data sparse area of the tropics which are primarily ocean. The ASDAR system consists of (1) a data acquisition and control unit to acquire, store and format these data; (2) a clock to time the data sampling and transmission periods; and (3) a transmitter and low-profile upper hemisphere coverage antenna to relay the formatted data via satellite to the National Weather Service ground stations, as shown schematically. The low-profile antenna is a conformal antenna based on the coplanar-slot approach. The antenna is circular polarized and has an on-axis gain of nearly 2.5 dB and a HPBW greater than 90 deg. The discussion covers antenna design, radiation characteristics, flight testing, and system performance.

Myhre, R. W.↗
NASA NTRS1995

Alternate physical formats for storing data in HDF

Since its inception HDF has evolved to meet new demands by the scientific community to support new kinds of data and data structures, larger data sets, and larger numbers of data sets. The first generation of HDF supported simple objects and simple storage schemes. These objects were used to build more complex objects such as raster images and scientific data sets. The second generation of HDF provided alternate methods of storing data elements, making it possible to do such things as store extendible objects with in HDF, to store data externally from HDF files, and support data compression effectively. As we look to the next generation of HDF, we are considering fundamental changes to HDF, including a redefinition of the basic HDF object from a simple object to a more general, higher-level scientific data object that has certain characteristics, such as dimensionality, a more general atomic number type, and attributes. These changes suggest corresponding changes to the HDF file format itself.

Folk, Mike↗
NASA NTRS1988

New data on the formation conditions and age of the Kamensk and Gusev astroblemes

Discussed is new information recently published on the higher contents of siderophilic in the block breccia, fragments of coesite rocks in the Glubokinskiy series within the Kamenskiy astrobleme. New geological data which have refined the concept regarding the structure and age of the Kamenskiy astrobleme are presented.

Movshovich, Ye. V.↗
NASA NTRS1983

LOX/hydrocarbon fuel carbon formation and mixing data analysis

By applying the Priem-Heidmann Generalized-Length vaporization correlation, the computer model developed by the present study predicts the spatial variation of propellant vaporization rate using the injector cold flow results to define the streamtubes. The calculations show that the overall and local propellant vaporization rate and mixture ratio change drastically as the injection element type or the injector operating condition is changed. These results are compared with the regions of carbon formation observed in the photographic combustion testing. The correlation shows that the fuel vaporization rate and the local mixture ratio produced by the injector element have first order effects on the degree of carbon formation.

Fang, J.↗
NASA NTRS1985

A suggested standardized format for cosmic ray ground-level event data

A standardized format is suggested for the archival storage and exchange of neutron monitor data obtained during solar flare initiated ground level cosmic ray events. Using the data for the 7 May 1978 ground level event, a format has been developed that incorporates hourly data preceding and following the event and small time interval data immediately before and during the event. Provision has been made for the inclusion of uncorrected and corrected data as well as the atmospheric pressure. The cosmic ray intensity data are then reduced to a standard counting rate of counts per second facilitating the graphing and comparison of these data for various analyses.

Shea, M. A.↗
NASA NTRS2018

Serving NASA GES DISC Multi-Spatiotemporal Earth Science Data to the GIS community

NASA Earth Science (ES) data is essential to a wide range of GIS research and applications. However, for many GIS users, searching, accessing, using and analyzing NASA ES data can be of a great challenge- ranging from the sheer data volumes, types of science parameters, and to the complexity of data encoding formats. As one of the twelve NASA Science Mission Directorate (SMD) Data Centers, Goddard Earth Sciences (GES) Data and Information Services Center (DISC) archives and distributes petabytes of ES parameters covering atmosphere, land, and ocean fields. Most data are multidimensional and multi-spatiotemporal in nature and are encoded in different science data formats (e.g, HDF, HDF-EOS, netCDF, GRIB, binary), which usually contain multiple variables and different metadata information. By far, GES DISC has been developing a number of services and online tools to help GIS users to easily explore our data products. In this presentation, we will describe our ArcGIS-based data accessing and visualization services and portals, which allow users directly exploring the multi-spatiotemporal ES data in ArcGIS clients without having to pre-download/import the data. The ArcGIS services are also compliant with the Open Geospatial Consortium (OGC) Web Coverage Service (WCS) and Web Map Service (WMS) protocols and can be accessed by any other WCS/WMS clients to get customized GES DISC EO data on-the-fly from such services.

Wei, Jennifer↗
NASA NTRS1989

A coherent digital demodulator for multiple signal formats and widely varying data rates

The Tracking and Data Relay Satellite System (TDRSS) uses four ground station demodulators for K-band signals with data rates from 1 kb/s to 300 Mb/s. The author discusses the feasibility of replacing these demodulators with a single digital demodulator that may be reconfigured by altering stored parameters to accommodate all signal formats and data rates. This implementation will reduce total ground station cost and facilitate automation of ground station operation. Analysis of system performance concentrates on the carrier tracking loop. Analytic and simulation results relate system performance to parameter values and signal format as data rate and power vary independently on the In-phase and quadrature channels. It is demonstrated that a single digital demodulator can support TDRSS-compatible signals at data rates conservatively extending from 1K symbols/s to 10M symbols/s, using off-the-shelf hardware with 6 or more bits of accuracy.

Mcguffin, Bruce F.↗
NASA NTRS1994

Table-driven configuration and formatting of telemetry data in the Deep Space Network

With a restructured software architecture for telemetry system control and data processing, the NASA/Deep Space Network (DSN) has substantially improved its ability to accommodate a wide variety of spacecraft in an era of 'better, faster, cheaper'. In the new architecture, the permanent software implements all capabilities needed by any system user, and text tables specify how these capabilities are to be used for each spacecraft. Most changes can now be made rapidly, outside of the traditional software development cycle. The system can be updated to support a new spacecraft through table changes rather than software changes, reducing the implementation, test, and delivery cycle for such a change from three months to three weeks. The mechanical separation of the text table files from the program software, with tables only loaded into memory when that mission is being supported, dramatically reduces the level of regression testing required. The format of each table is a different compromise between ease of human interpretation, efficiency of computer interpretation, and flexibility.

Manning, Evan↗
NASA NTRS1981

Standardization of computer compatible tape formats for remote sensing data

Standards and guidelines being developed for future CCT formats for use in Landsat receiving stations are presented, in order to solve the data compatability problem, and to consider user community requirements. Data exchange at the local, regional, national, or international level is an important user requirement, and data integration from various sources should be possible. The tape super structure allows various formats to be implemented. A volume directory identifies the volume, and a file descriptor confirms it. The data is then filed, and it is determined whether the data files are appropriate to already defined file classes. If not, a new class is established. Applications of this format are in three areas: satellite imagery, geocoded polygon data, and airborne remote sensing data.

Thomas, V. L.↗
NASA NTRS1981

A design approach to real-time formatting of high speed multispectral image data

A design approach to formatting multispectral image data in real time at very high data rates is presented for future onboard processing applications. The approach employs a microprocessor-based alternating buffer memory configuration whose formatting function is completely programmable. Data are read from an output buffer in the desired format by applying the proper sequence of addresses to the buffer via a lookup table memory. Sensor data can be processed using this approach at rates limited by the buffer memory access time and the buffer switching process delay time. This design offers flexible high speed data processing and benefits from continuing increases in the performance of digital memories.

Meredith, B. D.↗