SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

NASA NTRS2022

NASA's Next Generation of Atmospheric Data Science

The Multi-Angle Imager for Aerosols (MAIA) and the Tropospheric Emission: Monitoring of Pollution(TEMPO) are NASA’s next-generation satellite missions for air quality monitoring. These missions will produce high-quality, high-resolution air quality data to support cross-displinary research. The MAIA mission is collaborating with health science researchers and epidemiologists to study the impacts of air quality on health outcomes. TEMPO aims to improve our understanding of tropospheric air pollution chemistry and our ability to make predictions about air quality and climate forcing. TEMPO will offer hourly measurements of tropospheric ozone, aerosols, and clouds focused on North America at high-spatial resolution, while MAIA will produce high-resolution measurements of speciated particulate matter targeting densely populated cities around the globe. Data from these missions will help improve our understanding of the sources, types, and interactions among the aerosols and trace gases that are polluting Earth’s atmosphere, as well as our understanding of the impact of air pollution on pollution on a wide range of important areas including human health, agriculture, weather, and climate change. The challenges of cross-disciplinary research, computationally expensive multi-variate analyses, and high-resolution data at both local and global scales are driving substantial changes across all of NASA’s Distributed Active Archive Centers (DAACs). High resolution data at scales such these requires a new approach to data ingest, archive, and publication. Like other NASA DAACs, the Atmospheric Science Data Center (ASDC), the DAAC that will be responsible for publishing MAIA and TEMPO data products has historically archived and distributed data on premise. DAACs of the future will archive and distribute data in the cloud, enabling them to remake themselves as research-focused data centers that will support on-demand, data-intensive computations for highly accurate retrospective analyses and predictions. Under the new paradigm, data formats and metadata must support on-demand spatial and temporal sub-setting, as well as other data transformation services such as re-gridding and re-sampling. This presentation will discuss work being done to address data formatting and metadata requirements in this dynamic new environment. In addition to the changes in data stewardship practices at the ASDC, the increased focus on supporting scientific research is driving changes in the relationship between DAACs and researchers. While the ASDC will continue to provide first rate data management and stewardship, it is increasingly focused on serving as a partner not only to the science teams that gather and produce the data it publishes, but to the researchers that use that data.

Beth Huffer↗

NASA NTRS1993

MIRAGE: The data acquisition, analysis, and display system

Developed for the NASA Johnson Space Center and Life Sciences Directorate by GE Government Services, the Microcomputer Integrated Real-time Acquisition Ground Equipment (MIRAGE) system is a portable ground support system for Spacelab life sciences experiments. The MIRAGE system can acquire digital or analog data. Digital data may be NRZ-formatted telemetry packets of packets from a network interface. Analog signal are digitized and stored in experimental packet format. Data packets from any acquisition source are archived to a disk as they are received. Meta-parameters are generated from the data packet parameters by applying mathematical and logical operators. Parameters are displayed in text and graphical form or output to analog devices. Experiment data packets may be retransmitted through the network interface. Data stream definition, experiment parameter format, parameter displays, and other variables are configured using spreadsheet database. A database can be developed to support virtually any data packet format. The user interface provides menu- and icon-driven program control. The MIRAGE system can be integrated with other workstations to perform a variety of functions. The generic capabilities, adaptability and ease of use make the MIRAGE a cost-effective solution to many experimental data processing requirements.

Rosser, Robert S.↗

NASA NTRS1986

Methods of downloading to user institutions

The Pilot Climate Data System (PCDS) not only supports the ability to output data in a uniform structure via the Common Data Format (CDF, but also supports the ability to provide data in native format for any data set supported by the PCDS. Methods are discussed for acquiring data in either format from the PCDS for further work at remote sites. Four levels of remote utilization are defined, based on the extent of offloading the National Space Science Data Center (NSSDC) computer and local PCDS processing. Characteristics of each level are thoroughly explained, including details of information and data transfers, downloading, uploading, and offloading of the NSSDC computer. Only the levels themselves are specified here. The first level defined is that of a network-based distributed PCDS. A subset of the PCDS software is ported to another VAX and made available on a network (i.e., SPAN) node. There is no subset of the PCDS at the second level, but it is also network based. Non-network utilization of the PCDS, requiring dial-up log on, is denoted as a third level. Finally, at the fourth level, personal computer utilization of the PCDS through dial-up log on with proper terminal emulation is defined.

Treinish, L.↗

NASA NTRS2000

Total Ozone Mapping Spectrometer (TOMS) Level-3 Data Products User's Guide

Data from the TOMS series of instruments span the time period from November 1978, through the present with about a one and a-half year gap from January 1994 through July 1996. A set of four parameters derived from the TOMS measurements have been archived in the form of daily global maps or Level-3 data products. These products are total column ozone, effective surface reflectivity, aerosol index, and erythermal ultraviolet estimated at the Earth surface. A common fixed grid of I degree latitude by 1.25 degree longitude cells over the entire globe is provided daily for each parameter. These data are archived at the Goddard Space Flight Center Distributed Active Archive Center (DAAQ in Hierarchical Data Format (HDF). They are also available in a character format through the TOMS web site at http://toms.gsfc.nasa.gov. The derivations of the parameters, the mapping algorithm, and the data formats are described. The trend uncertainty for individual TOMS instruments is about 1% decade, but additional uncertainty exists in the combined data record due to uncertainty in the relative calibrations of the various TOMS.

McPeters, Richard D.↗

NASA NTRS2010

IVS Working Group 4: VLBI Data Structures

In 2007 the IVS Directing Board established IVS Working Group 4 on VLBI Data Structures. This note discusses the current VLBI data format, goals for a new format, the history and formation of the Working Group, and a timeline for the development of a new VLBI data format.

Gipson, John↗

NASA NTRS2006

New SPDF Directions and Evolving Services Supporting Heliophysics Research

The next advances in Heliophysics science and its paradigm of a Great Observatory require an increasingly integrated and transparent data environment, where data can be easily accessed and used across the boundaries of both missions and traditional disciplines. The Space Physics Data Facility (SPDF) project includes uniquely important multi-mission data services with current data from most operating space physics missions. This paper reviews the capabilities of key services now available and the directions in which they are expected to evolve to enable future multi-mission correlative research. The Coordinated Data Analysis Web (CDAWeb) and Satellite Situation Center Web (SSCWeb), critically supported by the Common Data Format (CDF) effort and supplemented by more focused science services such as OMNIWeb and technical services such as data format translations are important operational capabilities serving the international community today (and cited last year by 20% of the papers published in JGR Space Physics). These services continue to add data from most current missions as SPDF works with new missions such as THEMIS to help enable their unique science goals and the meaningful sharing of their data in a multi-mission correlative context. Recent enhancements to CDF, our 3D Java interactive orbit viewer (TIPSOD), the CDAWeb Plus system, increasing automation of data service population, the new folding of the VSPO effort into SPDF and our continuing thrust towards fully-functional web services APIs to allow ready invocation from distributed external middleware and clients will be shown.

McGuire, Robert E.↗

DOE OSTI2020

Ka-Band ARM Zenith Radar Corrections (KAZRCOR, KAZRCFRCOR) Value-Added Products

The Ka-Band Atmospheric Radiation Measurement (ARM) Zenith Radar Corrections (KAZRCOR) and KA-Band ARM Zenith Radar CF-Radial, Corrected (KAZRCFRCOR) value-added products (VAPs) perform several corrections to the ingested KAZR moments and also create a significant detection mask for each radar mode. The VAPs compute gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient meteorological observations, and correct observed reflectivities for that effect. Mean Doppler velocities are dealiased to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. Input KAZR data fields are passed through to the KAZRCOR or KAZRCFRCOR output files, in their native time and range coordinates. Complementary corrected reflectivity and velocity fields are provided, along with a mask of significant detections and a number of data quality flags. This report covers the KAZRCOR VAP as applied to the original KAZR radars and the upgraded KAZR2 radars. Originally, prior to late 2019, there were two separate code bases for the different radar versions. Following the harmonization of KAZR and KAZR2 data formats in 2019, only a single code base is required. The new combined KAZR and KAZR2 code base is called the KAZRCFRCOR VAP. The ‘cfr portion of the VAP name refers to the Radial Climate and Forecasting data format standards that are used in these data sets. Throughout this report, references to ‘KAZRCOR’ should be taken to apply to the ‘KAZRCFRCOR’ VAP as well unless there is an explicit statement to the contrary.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Historic Source Inspection Metadata

Although this data dictionary describes the raw data format, it is relevant only for data entered in 2017 and later. Entries in this date range represent formatted, standardized data that have been verified against original, raw data files by the database manager. She took ownership of the database in September 2022 and was able to standardize entries by comparing against raw data files back to 2017. Furthermore, for comparison of historic pre-source inspection data to new pre-source data supplied by the vendor and intended for action limit analysis purposes, this time period is of sufficient length.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Raw tensiometer soil matric potential data, from Oct 2017-Jun 2020 in Manaus, Brazil

This data package contains raw output from two Campbell Scientific CR1000 data loggers each connected to three UMS T4e tensiometer sensors in Manaus, Brazil. Tensiometers at each data logger location were installed to depths of 10 cm, 20 cm and 50 cm below the ground surface for the purpose of measuring soil matric potential at each depth. “Station 3” tensiometers were installed at approximately 2°36'31.68"S, 60°12'34.70"W. “Station 4” tensiometers were installed at approximately 2°36'32.46"S, 60°12'34.92"W. The files “tensio3.edit.202109.csv” and “tensio4.edit.202109.csv” contain raw data (with invalid data removed). A text editor will be required to view the raw files in .csv (comma-separated values) format. Data processing was limited to: 1) Editing column headers for clarity; 2) Applying a correction that converts voltage read by the data loggers to pressure units (kPa); 3) removing all data greater than 50 kPa and less than -115 kPa; 4) Adding columns entitled “Caution.10cm”, “Caution.20cm” and “Caution.50cm” that contains values of either “NA” or “Caution”, the latter of which is applied when data exceeds the manufacturer reported data validity range of less than -85 kPa to suggest use of these data with caution; 5) Adding columns entitled “Invalid.10cm”, “Invalid.20cm”, and “Invalid.50cm” that contains values of either “NA” or “Invalid”, the latter of which is applied when data accuracy is deemed compromised due to the introduction of air bubbles into the instrument. Data marked “Invalid” may still indicate general trends of wet/high matric potential and dry/low matric potential, but values are inaccurate and dry/low matric potential values are likely not low enough. Wet/high matric potential values are likely to be more accurate than dry/low matric potential values; 6) Data format changed from .dat to .csv. This research was performed as a part of the NGEE Tropics project, which aims to advance model predictions of tropical forest carbon cycle responses to a changing climate over the 21st Century.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1985

SPAR improved structural-fluid dynamic analysis capability

The results of a study whose objective was to improve the operation of the SPAR computer code by improving efficiency, user features, and documentation is presented. Additional capability was added to the SPAR arithmetic utility system, including trigonometric functions, numerical integration, interpolation, and matrix combinations. Improvements were made in the EIG processor. A processor was created to compute and store principal stresses in table-format data sets. An additional capability was developed and incorporated into the plot processor which permits plotting directly from table-format data sets. Documentation of all these features is provided in the form of updates to the SPAR users manual.

Pearson, M. L.↗

NASA NTRS1985

Signal Processor for Multirate PSK Signals

Any of six different data formats at any of five different data rates from phase-shift-key (PSK) modulated input signal extracted by digital radio receiver. Subcarrier Demodulator is Costas loop with hard limiter in inphase arm. There are six low-pass filters, each selectable for rate and format of data to be processed.

Helgesen, R. J.↗

NASA NTRS1974

Operators manual for the magnetograph program (section 2)

This manual for use of the magnetograph program describes: (1) black box use of the programs; (2) the magtape data formats used; (3) the adjustable control parameters in the program; and (4) the algorithms. With no adjustments on the control parameters this program may be used purely as a black box. For optimal use, however, the control parameters may be varied. The magtape data formats are of use in adopting other programs to look at raw data or final magnetograph data.

November, L.↗

NASA NTRS1993

AXAF FITS standard for ray trace interchange

A standard data format for the archival and transport of x-ray events generated by ray trace models is described. Upon review and acceptance by the Advanced X-ray Astrophysics Facility (AXAF) Software Systems Working Group (SSWG), this standard shall become the official AXAF data format for ray trace events. The Flexible Image Transport System (FITS) is well suited for the purposes of the standard and was selected to be the basis of the standard. FITS is both flexible and efficient and is also widely used within the astronomical community for storage and transfer of data. In addition, software to read and write FITS format files are widely available. In selecting quantities to be included within the ray trace standard, the AXAF Mission Support team, Science Instruments team, and the other contractor teams were surveyed. From the results of this survey, the following requirements were established: (1) for the scientific needs, each photon should have associated with it: position, direction, energy, and statistical weight; the standard must also accommodate path length (relative phase), and polarization. (2) a unique photon identifier is necessary for bookkeeping purposes; (3) a log of individuals, organizations, and software packages that have modified the data must be maintained in order to create an audit trail; (4) a mechanism for extensions to the basic kernel should be provided; and (5) the ray trace standard should integrate with future AXAF data product standards.

Hsieh, Paul F.↗

NASA NTRS1992

Recommendations for a service framework to access astronomical archives

There are a large number of astronomical archives and catalogs on-line for network access, with many different user interfaces and features. Some systems are moving towards distributed access, supplying users with client software for their home sites which connects to servers at the archive site. Many of the issues involved in defining a standard framework of services that archive/catalog suppliers can use to achieve a basic level of interoperability are described. Such a framework would simplify the development of client and server programs to access the wide variety of astronomical archive systems. The primary services that are supplied by current systems include: catalog browsing, dataset retrieval, name resolution, and data analysis. The following issues (and probably more) need to be considered in establishing a standard set of client/server interfaces and protocols: Archive Access - dataset retrieval, delivery, file formats, data browsing, analysis, etc.; Catalog Access - database management systems, query languages, data formats, synchronous/asynchronous mode of operation, etc.; Interoperability - transaction/message protocols, distributed processing mechanisms (DCE, ONC/SunRPC, etc), networking protocols, etc.; Security - user registration, authorization/authentication mechanisms, etc.; Service Directory - service registration, lookup, port/task mapping, parameters, etc.; Software - public vs proprietary, client/server software, standard interfaces to client/server functions, software distribution, operating system portability, data portability, etc. Several archive/catalog groups, notably the Astrophysics Data System (ADS), are already working in many of these areas. In the process of developing StarView, which is the user interface to the Space Telescope Data Archive and Distribution Service (ST-DADS), these issues and the work of others were analyzed. A framework of standard interfaces for accessing services on any archive system which would benefit archive user and supplier alike is proposed.

Travisano, J. J.↗

DOE OSTI2020

Evolution of the ROOT Tree I/O

The ROOT TTree data format encodes hundreds of petabytes of High Energy and Nuclear Physics events. Its columnar layout drives rapid analyses, as only those parts (“branches”) that are really used in a given analysis need to be read from storage. Its unique feature is the seamless C++ integration, which allows users to directly store their event classes without explicitly defining data schemas. In this contribution, we present the status and plans of the future ROOT 7 event I/O. Along with the ROOT 7 interface modernization, we aim for robust, where possible compile-time safe C++ interfaces to read and write event data. On the performance side, we show first benchmarks using ROOT’s new experimental I/O subsystem that combines the best of TTrees with recent advances in columnar data formats. A core ingredient is a strong separation of the high-level logical data layout (C++ classes) from the low-level physical data layout (storage backed nested vectors of simple types). We show how the new, optimized physical data layout speeds up serialization and deserialization and facilitates parallel, vectorized and bulk operations. This lets ROOT I/O run optimally on the upcoming ultra-fast NVRAM storage devices, as well as file-less storage systems such as object stores.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1997

Restoration and Archiving of Data from the Plasma Composition Experiment on the International Sun-Earth Explorer One (ISEE 1)

The objective of this project has been to complete the archiving of energetic (10 eV/epsilon - 18 keV/epsilon) ion composition data from the Lockheed Plasma Composition Experiment on the International Sun-Earth Explorer One (ISEE 1) satellite, using a particular data format that had previously been approved by NASA and the NSSDC. That same format, a combination of ion velocity moments and differential flux spectra, had been used in 1991 to archive, at the NSSDC, the first 28 months (the "Prime" period of ISEE investigations) of data from the Lockheed instrument under NASA Contract NAS5-33047. With the completion of this project, the almost 4 1/2-year time span of these unique data is now covered by a very compact set, approximately 1 gigabyte in total, of electronic files with physical quantities, all in ASCII. The files are organized by data type and time of data acquisition, in Universal Time, and named according to year and day of year. Each calendar day has five separate files (five types of data), the lengths of which vary from day to day, depending on the instrument mode of operation. The data format and file structure are described in detail in appendices 1 and 2. The physical medium consists of high-density (6250 cpi) 9-track magnetic tapes, complemented by a set of hardcopy line plots of certain plasma parameters. In this case there are five tapes, to be added to the six previous ones from 1991, and 25 booklets of plots, one per month, to be added to the previous 28. The tapes, including an extra standard-density (1600 cpi) tape with electronic versions of the Data User's Guide and self-guiding VAX/VMS command files, and the hardcopy plots are being boxed for shipment to the NSSDC.

Lennartsson, O. W.↗

NASA NTRS2009

The Transition of High-Resolution NASA MODIS Sea Surface Temperatures into the WRF Environmental Modeling System

The NASA Short-term Prediction Research and Transition (SPoRT) Center has developed a Moderate Resolution Imaging Spectroradiometer (MODIS) sea surface temperature (SST) composite at 2-km resolution that has been implemented in version 3 of the National Weather Service (NWS) Weather Research and Forecasting (WRF) Environmental Modeling System (EMS). The WRF EMS is a complete, full physics numerical weather prediction package that incorporates dynamical cores from both the Advanced Research WRF (ARW) and the Non-hydrostatic Mesoscale Model (NMM). The installation, configuration, and execution of either the ARW or NMM models is greatly simplified by the WRF EMS to encourage its use by NWS Weather Forecast Offices (WFOs) and the university community. The WRF EMS is easy to run on most Linux workstations and clusters without the need for compilers. Version 3 of the WRF EMS contains the most recent public release of the WRF-NMM and ARW modeling system (version 3 of the ARW is described in Skamarock et al. 2008), the WRF Pre-processing System (WPS) utilities, and the WRF Post-Processing program. The system is developed and maintained by the NWS National Science Operations Officer Science and Training Resource Coordinator. To initialize the WRF EMS with high-resolution MODIS SSTs, SPoRT developed the composite product consisting of MODIS SSTs over oceans and large lakes with the NCEP Real-Time Global (RTG) filling data over land points. Filling the land points is required due to minor inconsistencies between the WRF land-sea mask and that used to generate the MODIS SST composites. This methodology ensures a continuous field that adequately initializes all appropriate arrays in WRF. MODIS composites covering the Gulf of Mexico, western Atlantic Ocean and the Caribbean are generated daily at 0400, 0700, 1600, and 1900 UTC corresponding to overpass times of the NASA Aqua and Terra polar orbiting satellites. The MODIS SST product is output in gridded binary-1 (GRIB-1) data format for a seamless incorporation into WRF via the WPS utilities. The full-resolution, 1-km MODIS product is sub-sampled to 2-km grid spacing due to limitations in handling very large dimensions in the GRIB-1 data format. The GRIB-1 files are posted online at ftp://ftp.nsstc.org/sstcomp/WRF/, which is directly accessed by the WRF EMS scripts. The MODIS SST composites are also downloaded to the EMS data server, which is accessible by the WRF EMS users and NWS WFOs. The SPoRT MODIS SST composite provides the model with superior detail of the ocean gradients around Florida and surrounding waters, whereas the operational RTG SST typically depicts a relatively smooth field and is not able to capture sharp horizontal gradients in SST. Differences of 2-3 C are common over small horizontal distances, leading to enhanced SST gradients on either side of the Gulf Stream and along the edges of the cooler shelf waters. These sharper gradients can in turn produce atmospheric responses in simulated temperature and wind fields as depicted in LaCasse et al. Differences in atmospheric verification statistics over a several month study were generally small in the vicinity of south Florida; however, the validation of SSTs at specific buoy locations revealed important improvements in the biases and RMS errors, especially in the vicinity of the cooler shelf waters off the east-central Florida coast. A current weakness in the MODIS SST product is the occurrence of occasional discontinuities caused by high latency in SST coverage due to persistent cloud cover. An enhanced method developed by Jedlovec et al. (2009, GHRSST User Symposium) reduces the occurrence of these problems by adding Advanced Microwave Scanning Radiometer -- EOS (AMSR-E) SST data to the compositing process. Enhanced SST composites are produced over the ocean regions surrounding the Continental U.S. at four times each day corresponding to Terra and Aqua equator crossing times. For a given day and overpass time, both MODInd AMSR-E data from the previous seven days form a collection used in the compositing. At each MODIS pixel, cloud-free SST values from the collection are used to form a weighted average based on their latency (number of days from the current day). In this way, recent SST data are given more weight than older data. One of the primary issues involved in incorporating the AMSR-E microwave data in the composites is the tradeoff between the decreased spatial resolution of the AMSR-E data (25 km) and the increased coverage due to its near all-weather capability. Currently, the AMSR-E is given a weight of 20% compared to MODIS data, thereby preserving the spatial structure observed in the MODIS data. Day-time (night-time) AMSR-E SST data from Aqua are used with both Terra and Aqua MODIS day-time (night-time) SST data sets.

Case, Jonathan L.↗

NASA NTRS1972

Lunar targeting study: Lunar and planetary Ephemeris tapes

The Univac 1108 computer tape data formats are documented for the ephermeris tape generated by the Jet Propulsion Laboratory and the ephemeris tape used by the Quick Response Targeting Program (QRTP). Ephermeris tapes are used as the data source for the position and velocity components of those celestial bodies being considered in an integrated trajectory simulation program. The QRTP ephemeris tape has data only for lunar mission simulations. The JPL ephemeris tape has data for the moon and the nine planets. The ephemeris tapes, the data formats, the coordinate systems, and units are defined. The transformation from the mean-of-1950 coordinate system to the nearest mean Besselian year is given.

Green, W. G.↗