Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

User's guide to image processing applications of the NOAA satellite HRPT/AVHRR data. Part 1: Introduction to the satellite system and its applications. Part 2: Processing and analysis of AVHRR imagery

The use of NOAA Advanced Very High Resolution Radar/High Resolution Picture Transmission (AVHRR/HRPT) imagery for earth resource applications is provided for the applications scientist for use within the various Earth science, resource, and agricultural disciplines. A guide to processing NOAA AVHRR data using the hardware and software systems integrated for this NASA project is provided. The processing steps from raw data on computer compatible tapes (1B data format) through usable qualitative and quantitative products for applications are given. The manual is divided into two parts. The first section describes the NOAA satellite system, its sensors, and the theoretical basis for using these data for environmental applications. Part 2 is a hands-on description of how to use a specific image processing system, the International Imaging Systems, Inc. (I2S) Model 75 Array Processor and S575 software, to process these data.

Huh, Oscar Karl↗

AMPR CAMP2Ex Calibrated and Quality-Controlled Dataset Level 2B, Revision B

Data were acquired by the Advanced Microwave Precipitation Radiometer (AMPR) during the Cloud, Aerosol and Monsoon Processes Philippines Experiment (CAMP2Ex) field campaign in August-October of 2019. These files include the Level 2B calibrated, corrected, and geo-referenced brightness temperature for the four AMPR-observed frequencies (10, 19, 37, 85 GHz). These data are archived in a self-describing, Climate and Forecasting (CF) 1.6-compliant Version 4 Network Common Data Format (netCDF4) format.Python software has been developed for reading, plotting, and providing some additional analysis capabilities. This software is available from: https://github.com/nasa/pyampr.The AMPR instrument is explained in more detail here: https://weather.msfc.nasa.gov/ampr/.These data have been determined to be viable for publishable scientific research, and alsoshould be useful for generating quicklooks or understanding what happened during a flight. Note: AMPRis not expected to provide useful data during significant aircraft maneuvers

Timothy Lang↗

pvlib iotools—Open-source Python functions for seamless access to solar irradiance data

Access to accurate solar resource data is critical for numerous applications, including estimating the yield of solar energy systems, developing radiation models, and validating irradiance datasets. However, lack of standardization in data formats and access interfaces across providers constitutes a major barrier to entry for new users. pvlib python’s iotools subpackage aims to solve this issue by providing standardized Python functions for reading local files and retrieving data from external providers. All functions follow a uniform pattern and return convenient data outputs, allowing users to seamlessly switch between data providers and explore alternative datasets. The pvlib package is community-developed on GitHub: https://github.com/pvlib/pvlib-python. As of pvlib python version 0.9.5, the iotools subpackage supports 12 different datasets, including ground measurement, reanalysis, and satellite-derived irradiance data. The supported ground measurement networks include the Baseline Surface Radiation Network (BSRN), NREL MIDC, SRML, SOLRAD, SURFRAD, and the US Climate Reference Network (CRN). Additionally, satellite-derived and reanalysis irradiance data from the following sources are supported: PVGIS (SARAH & ERA5), NSRDB PSM3, and CAMS Radiation Service (including McClear clear-sky irradiance).

14 SOLAR ENERGY↗

The Use of Subcarriers in Future DSN Missions

The performance of deep space telemetry signals that employ a residual carrier modulation technique is compared in the presence and absence of a subcarrier. When the subcarrier is present, the performance for the resulting pulse-coded modulation/phase-shift keyed/phase-modulated (PCM/PSK/PM) scheme is evaluated for both sine wave and square wave subcarriers and non-return-to zero (NRZ) data. When the subcarrier is absent, the performance for the resulting PCM/PM technique is evaluated for both the NRZ and the bi-phase data format. The comparison is based on telemetry performance as well as bandwidth efficiency. The first criterion is characterized in terms of the symbol error rate (SER) as a function of symbol SNR, loop bandwidth-to-data rate ratio, and modulation index. The bandwidth efficiency is characterized by the occupancy factor. The results of both the analysis and measurements show that when the interference-to-carrier ratio (ICR) is less than -15 dB, the performance degradation in the absence of a subcarrier is negligible. Various combinations of loop bandwidth-to-data rate ratios and modulation indices that achieve this performance are derived and listed. Bandwidth occupancy comparison indicates that PCM/PM/NRZ is the most efficient in this regard. Therefore, by eliminating the subcarrier and using the PCM/PM/NRZ scheme, many advantages can be realized without any sacrifice in performance.

Shihabi, M. M.↗

A Comparison of Telemetry Signals in the Presence and Absence of a Subcarrier

The performance of deep-space telemetry signals that employ a residual carrier modulation technique is compared in the presence and absence of a subcarrier. When the subcarrier is present, the performance for the resulting pulse-coded modulation/phase-shift keyed/phase-modulated (PCM/PSK/PM) scheme is evaluated for both sine-wave and square-wave subcarriers and Non-Return-to Zero (NRZ) data. When the subcarrier is absent, the performance for the resulting PCM/PM technique is evaluated for both the NRZ and the bi-phase data format. The comparison is based on telemetry performance as well as bandwidth efficiency. The first criterion is characterized in terms of the Symbol Error Rate (SER) as a function of symbol SNR, loop bandwidth-to-data rate ratio, and modulation index. The bandwidth efficiency is characterized by the occupancy factor. The results of both the analysis and measurements show that when the Interference-to-Carrier Ratio (ICR) is less than -20 dB, the performance degradation in the absence of a subcarrier is negligible. Various combinations of loop bandwidth-to-data rate ratios and modulation indices that achieve this performance are derived and listed. Bandwidth occupancy comparison indicates that PCM/PM/NRZ is the most efficient in this regard. Therefore, by eliminating the subcarrier and using the PCM/PM/NRZ scheme, many advantages can be realized without any sacrifice in performance.

Shihabi, Mazen M.↗

ATD-2 TTP Flight Delay Messages

This document is the third of five documents that describe the TFDM Terminal Publication (TTP) implementation within ATD-2 including data message formats and data schemas.

message format specification↗

ATD-2 TTP Airport Information Messages

This document is the first of five documents that describe the TFDM Terminal Publication (TTP) implementation within ATD-2 including data message formats and data schemas.

message format specification↗

ATD-2 TTP Flight Data Messages

This document is the second of five documents that describe the TFDM Terminal Publication (TTP) implementation within ATD-2 including data message formats and data schemas.

message format specification↗

Software Archive Related Issues

With the archive opening of the major X-ray and Gamma ray missions, the school is intended to provide information on the resource available in the data archive and the public software. This talk reviews the archive content, the data format for the major active missions Chandra, XMM-Newton, Swift, RXTE, Integral and Suzaku and the available software for each of these missions. It will explain the FITS format in general and the specific layout for the most popular mission, explaining the role of keywords and how they fit in the multimission standard approach embrace by the High Energy Community. Specifically, it reviews : the difference data levels and the difference software applicable; the popular/standard method of analysis for high level products such as spectra, timing and images; the role of calibration in the multi mission approach; how to navigate the archive query databases. It will present also how the school is organized and how the information provided will be relevant to each of the afternoon science projects that will be proposed to the students and led by a project leader

Angelini, Lorella↗

Services, Perspective and Directions of the Space Physics Data Facility

The multi-mission data and orbit services of NASA's Space Physics Data Facility (SPDF) project offer unique capabilities supporting science of the Heliophysics Great Observatory and that are highly complementary to other services now evolving in the international heliophysics data environment. The VSPO (Virtual Space Physics Observatory) service is an active portal to a wide rage of distributed data sources. CDAWeb (Coordinated Data Analysis Web) offers plots, listings and file downloads for current data from many missions across the boundaries of missions and instrument types. CDAWeb now includes extensive new data from STEREO and THEMIS, plus new ROCSAT IPEI data, the latest data from all four TIMED instruments and high-resolution data from all DE-2 experiments. SSCWeb, Helioweb and out 3D Animated Orbit Viewer (TIPSOD) provide position data and identification of spacecraft and ground conjunctions. OMNI Web, with its new extension to 1- and 5-minute resolution, provides interplanetary parameters at the Earth's bow shock. SPDF maintains NASA's CDF (Common Data Format) standard and a range of associated tools including format translation services. These capabilities are all now available through web services based APIs, one element in SPDF's ongoing work to enable heliophysics community development of Virtual discipline Observatories (e.g. VITMO). We will demonstrate out latest data and capabilities, review the lessons we continue to learn in what science users need and value in this class of services, and discuss out current thinking to the future role and appropriate focus of the SPDF effort in the evolving and increasingly distributed heliophysics data environment.

McGuire, Robert E.↗

Challenges in Transitioning Research Data to Operations: The SPoRT Paradigm

Established in 2002 to demonstrate the weather and forecasting application of real-time EOS measurements, the NASA Short-term Prediction Research and Transition (SPoRT) program has grown to be an end-to-end research to operations activity focused on the use of advanced NASA modeling and data assimilation approaches, nowcasting techniques, and unique high-resolution multispectral data from EOS satellites to improve short-term weather forecasts on a regional and local scale. With the ever-broadening application of real-time high resolution satellite data from current EOS and planned NPP, JPSS, and GOES-R sensors to weather forecast problems, significant challenges arise in the acquisition, delivery, and integration of the new capabilities into the decision making process of the operational weather community. For polar orbiting sensors such as MODIS, AIRS, VIIRS, and CRiS, the use of direct broadcast ground stations is key to the real-time delivery of the data and derived products in a timely fashion. With the ABI on the geostationary GOES-R satellite, the data volume will likely increase by a factor of 5- 10 from current data streams. However, the high data volume and limited bandwidth of end user facilities presents a formidable obstacle to timely access to the data. This challenge can be addressed through the use of subsetting techniques, innovative web services, and the judicious selection of data formats. Many of these approaches have been implemented by SPoRT for the delivery of real-time products to NWS forecast offices and other weather entities. Once available in decision support systems like AWIPS II, these new data and products must be integrated into existing and new displays that allow for the integration of the data with existing operational products in these systems. SPoRT is leading the way in demonstrating this enhanced capability. This paper will highlight the ways SPoRT is overcoming many of the challenges presented by the enormous data volumes of current and future satellite systems to get unique high quality research data into the operational weather environment.

Jedloved, Gary J.↗

SPoRT: Transitioning NASA and NOAA Experimental Data to the Operational Weather Community

Established in 2002 to demonstrate the weather and forecasting application of real-time EOS measurements, the NASA Short-term Prediction Research and Transition (SPoRT) program has grown to be an end-to-end research to operations activity focused on the use of advanced NASA modeling and data assimilation approaches, nowcasting techniques, and unique high-resolution multispectral data from EOS satellites to improve short-term weather forecasts on a regional and local scale. With the ever-broadening application of real-time high resolution satellite data from current EOS, Suomi NPP, and planned JPSS and GOES-R sensors to weather forecast problems, significant challenges arise in the acquisition, delivery, and integration of the new capabilities into the decision making process of the operational weather community. For polar orbiting sensors such as MODIS, AIRS, VIIRS, and CRiS, the use of direct broadcast ground stations is key to the real-time delivery of the data and derived products in a timely fashion. With the ABI on the geostationary GOES-R satellite, the data volumes will likely increase by a factor of 5-10 from current data streams. However, the high data volume and limited bandwidth of end user facilities presents a formidable obstacle to timely access to the data. This challenge can be addressed through the use of subsetting techniques, innovative web services, and the judicious selection of data formats. Many of these approaches have been implemented by SPoRT for the delivery of real-time products to NWS forecast offices and other weather entities. Once available in decision support systems like AWIPS II, these new data and products must be integrated into existing and new displays that allow for the integration of the data with existing operational products in these systems. SPoRT is leading the way in demonstrating this enhanced capability. This paper will highlight the ways SPoRT is overcoming many of the challenges presented by the enormous data volumes of current and future satellite systems to get unique high quality research data into the operational weather environment.

Jedlovec, Gary J.↗

21 cm Power Spectrum Analysis of North Celestial Pole Observations with the Tianlai Dish Pathfinder Array

The Tianlai Dish Pathfinder Array (TDPA) is a radio interferometer designed to test techniques for 21 cm intensity mapping in the post-reionization Universe as a means of measuring large-scale cosmic structure. Using nine nights of observations targeting the North Celestial Pole field, totaling approximately 107 hr of integration time, we analyze data in the frequency range 700–800 MHz (corresponding to redshift z ∼ 0.9). We do the data format conversion, radio frequency interference flagging, calibration, imaging and point source subtraction, and foreground removal via Singular Value Decomposition. The spherically averaged power spectrum Δ 2 (k) is obtained. Furthermore, this work successfully establishes and validates a comprehensive data analysis framework for the TDPA. We identify key improvements including sky model refinement, increased integration time, and pipeline optimization that will enable future detection of the 21 cm signal through auto-correlation and cross-correlation with optical galaxy surveys.

cosmology: large-scale structure of universe↗

The User Community and a Multi-Mission Data Project: Services, Experiences and Directions of the Space Physics Data Facility

From a user's perspective, the multi-mission data and orbit services of NASA's Space Physics Data Facility (SPDF) project offer a unique range of important data and services highly complementary to other services presently available or now evolving in the international heliophysics data environment. The VSP (Virtual Space Physics Observatory) service is an active portal to a wide range of distributed data sources. CDAWeb (Coordinate Data Analysis Web) enables plots, listings and file downloads for current data cross the boundaries of missions and instrument types (and now including data from THEMIS and STEREO). SSCWeb, Helioweb and our 3D Animated Orbit Viewer (TIPSOD) provide position data and query logic for most missions currently important to heliophysics science. OMNIWeb with its new extension to 1- and 5-minute resolution provides interplanetary parameters at the Earth's bow shock as a unique value-added data product. SPDF also maintains NASA's CDF (common Data Format) standard and a range of associated tools including translation services. These capabilities are all now available through webservices-based APIs as well as through our direct user interfaces. In this paper, we will demonstrate the latest data and capabilities now supported in these multi-mission services, review the lessons we continue to learn in what science users need and value in this class of services, and discuss out current thinking to the future role and appropriate focus of the SPDF effort in the evolving and increasingly distributed heliophysics data environment.

Fung, Shing F.↗

NXREFINE

NXRefine implements a complete workflow for both data acquisition and reduction of single crystal diffuse x-ray scattering collected as a series of area detector frames during continuous sample rotation. The data are stored in HDF5 files, which conform to the NeXus data format standard. These files contain a comprehensive set of metadata, including the incident wavelength, powder calibration scans used to define detector distances, beam centers, and yaw, pitch, and roll corrections. Automated peak searches of the three-dimensional data arrays define a set of Bragg peaks that are used to define an orientation matrix, defined according to Busing and Levy, which is then used to transform the data from angular coordinates to reciprocal space coordinates using the CCTW program. Multiple rotations at different detector translations and offset rotation axes are combined to ensure that there are no gaps in the reconstructed data, and allow the construction of masks to eliminate detector artifacts due to Compton scattering within the sensor layers. Finally, the data can be transformed into 3D-ΔPDF maps using the punch-and-fill method after symmetrization.

OSBORN, RAYMOND↗

Acoustic Emission Analysis Applet (AEAA) Software

NASA Glenn Research and NASA White Sands Test Facility have developed software supporting an automated pressure vessel structural health monitoring (SHM) system based on acoustic emissions (AE). The software, referred to as the Acoustic Emission Analysis Applet (AEAA), provides analysts with a tool that can interrogate data collected on Digital Wave Corp. and Physical Acoustics Corp. software using a wide spectrum of powerful filters and charts. This software can be made to work with any data once the data format is known. The applet will compute basic AE statistics, and statistics as a function of time and pressure (see figure). AEAA provides value added beyond the analysis provided by the respective vendors' analysis software. The software can handle data sets of unlimited size. A wide variety of government and commercial applications could benefit from this technology, notably requalification and usage tests for compressed gas and hydrogen-fueled vehicles. Future enhancements will add features similar to a "check engine" light on a vehicle. Once installed, the system will ultimately be used to alert International Space Station crewmembers to critical structural instabilities, but will have little impact to missions otherwise. Diagnostic information could then be transmitted to experienced technicians on the ground in a timely manner to determine whether pressure vessels have been impacted, are structurally unsound, or can be safely used to complete the mission.

Nichols, Charles T.↗

Thermodynamics of Plutonium Monocarbide from Anharmonic and Relativistic Theory

Thermodynamics of plutonium monocarbide is studied from first-principles theory that includes relativistic electronic structure and anharmonic lattice vibrations. Density-functional theory (DFT) is expanded to include orbital-orbital coupling in addition to the relativistic spin-orbit interaction for the electronic structure and it is combined with anharmonic, temperature dependent, lattice dynamics derived from the self-consistent ab initio lattice dynamics (SCAILD) method. The obtained thermodynamics are compared to results from simpler quasi-harmonic theory and experimental data. Formation enthalpy, specific heat, and Gibbs energy calculated from the anharmonic model are validated by direct comparison with a calculation of phase diagram (CALPHAD) assessment of PuC and sub-stochiometric PuC0.896. Overall, the theory reproduces CALPHAD results and measured data for PuC rather well, but the comparison is hampered by the sub-stoichiometric nature of plutonium monocarbide. It was found that a bare theoretical approach that ignores spin-orbit and orbital-orbital coupling (orbital polarization) of the plutonium 5f electrons promotes too soft phonons and Gibbs energies that are incompatible with that of the CALPHAD assessment of the experimental data. The investigation of PuC suggests that the electronic structure is accurately described by plutonium 5f electrons as “band like” and delocalized, but correlate through spin polarization, orbital polarization, and spin-orbit coupling, in analogy to previous findings for plutonium metal.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NASA's Earth Science Data Systems Standards Process Experiences

NASA has impaneled several internal working groups to provide recommendations to NASA management on ways to evolve and improve Earth Science Data Systems. One of these working groups is the Standards Process Group (SPC). The SPG is drawn from NASA-funded Earth Science Data Systems stakeholders, and it directs a process of community review and evaluation of proposed NASA standards. The working group's goal is to promote interoperability and interuse of NASA Earth Science data through broader use of standards that have proven implementation and operational benefit to NASA Earth science by facilitating the NASA management endorsement of proposed standards. The SPC now has two years of experience with this approach to identification of standards. We will discuss real examples of the different types of candidate standards that have been proposed to NASA's Standards Process Group such as OPeNDAP's Data Access Protocol, the Hierarchical Data Format, and Open Geospatial Consortium's Web Map Server. Each of the three types of proposals requires a different sort of criteria for understanding the broad concepts of "proven implementation" and "operational benefit" in the context of NASA Earth Science data systems. We will discuss how our Standards Process has evolved with our experiences with the three candidate standards.

Ullman, Richard E.↗