Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Surface Radiation Budget (SRB) Release 2.5 QC Shortwave Monthly Data in Native Format (SRB_REL2.5_QCSW_MONTHLY)

These surface radiation budget data include both surface and top of the atmosphere insolation fluxes as well as cloud fraction/amount for the entire globe between 07/01/1983 and 06/30/2005. These parameters were derived with the Quality-Check SW (QCSW) algorithm of the NASA World Climate Research Programme /Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-06-30] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics) to 120 degrees (the poles).; Temporal_Resolution=monthly; Temporal_Resolution_Range=monthly].

SHORTWAVE FLUX↗

Surface Radiation Budget (SRB) Release 2.5 QC Longwave 3 Hourly Monthly Data in Native Format(SRB_REL2.5_QCLW_3HRLY_MONTHLY)

These surface radiation budget data sets include downward fluxes and cloud radiative properties for the entire globe between 07/01/1983 and 06/30/2005. These parameters were parameters derived with the Quality-Check LW (QCLW) algorithm of the NASA World Climate Research Programme /Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2004-12-31] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree in the tropics to 120 degrees at the poles; Temporal_Resolution=3 hourly averaged monthly].

CLOUD FORCING↗

LLNL Automized Surface Titration Model

The LLNL Automized Surface Titration Model (L-ASTM) is a community data-driven surface complexation modeling workflow for simulating potentiometric titration of mineral surfaces. The model accepts raw experimental potentiometric titration data formatted in a findable, accessible, interoperable, and reusable (FAIR) structure. The workflow was coded in Python and coupled to PHREEQC for surface complexation modeling and PEST for data fitting and parameter estimation.

Solchan, Han↗

The MY NASA DATA Project

On the one hand, locating the right dataset, then figuring out how to use it, is a daunting task that is familiar to almost any scientist or graduate student in the fields of Earth system science. On the other hand, the ability to explore authentic Earth system science data, through inquiry-based education, is an important goal in US national education standards. Fortunately, in the digital age, tools are emerging that can make such data exploration commonplace at all educational levels. This paper describes the conception and development of one project that aims to bridge this gap: Mentoring and inquiry using NASA Data on Atmospheric and Earth science for Teachers and Amateurs (MY NASA DATA; mynasadata.larc.nasa.gov). With funding from NASA's Science Mission Directorate, this project was launched in early 2004 with the aim of developing microsets and identifying other enablers for making data accessible. A key feature of the project is a Live Access Server, the first educational implementation of this open source software, developed by NOAA, that makes it possible to explore multiple data formats through a single interface. This powerful tool is made more useful to the primary target audiences (K-12 and amateur scientists) through careful selection of the data offered, user-friendly explanations of the tool itself, and age-appropriate explanations of the parameters. However experience already shows that graduate students and even practicing scientists can also make use of this resource. The website also hosts teacher-contributed lesson plans, and seeks to feature reports of research projects that use the data.

Chambers, Lin H.↗

Online and Offline Data Quality Monitoring for the Mu2e Calorimeter

This thesis presents the design, implementation, and validation of a calorimeter Data Quality Monitoring (DQM) toolchain for the Mu2e experiment at Fermilab. Mu2e searches for charged lepton flavor violation via coherent muon-to-electron conversion in the field of an aluminum nucleus, $\mu^- Al \rightarrow e^-Al$, a process whose observation would constitute clear evidence of physics beyond the Standard Model. Achieving target sensitivity requires stringent control of detector performance and data integrity during acquisition, as subtle issues in readout configuration, data formatting, or electronics behavior can compromise reconstruction and bias downstream analyzes. To address these challenges, this work develops a multi-layer DQM approach spanning both raw data validation and reconstructed digi-level diagnostics. At the low level, a fragment analysis component performs word- and bit-field decoding of calorimeter readout blocks, enabling sanity checks of the expected structure and producing detailed error and integrity statistics useful for commissioning and troubleshooting. At the digi level, the CaloDigiDQM analyzer is implemented within the art framework and transforms each CaloDigiCollection into a structured hierarchy of ROOT histograms designed for fast drill-down diagnostics. The module generates coherent monitoring views at global, disk, board, and channel granularity, including occupancy, waveform-derived features (baseline, RMS, peak amplitude and position), and left-right sensor consistency metrics. Detector-aware channel-to-electronics mapping is performed through the conditions system (CaloDAQMap), ensuring that diagnostics remain aligned with hardware identifiers used in operations. For end-to-end testing without reliance on live DAQ data, a synthetic CaloDigi producer is developed to generate realistic waveforms with controlled noise and pulse shapes. The resulting system supports both offline ROOT-file production and online operation, including optional histogram streaming through otsdaq via ots::HistoSender. This toolchain provides a practical and scalable foundation for calorimeter commissioning and stable data collection, enabling early detection of anomalies and reducing operational risk for Mu2e.

Vakulenko, Mark [Drew U.] (ORCID:0009000276197818)↗

Evaluation of the Relative Contribution of Observing Systems in Reanalyses: Aircraft Temperature Bias and Analysis Innovations

Reanalyses have become important sources of data in weather and climate research. While observations are the most crucial component of the systems, few research projects consider carefully the multitudes of assimilated observations and their impact on the results. This is partly due to the diversity of observations and their individual complexity, but also due to the unfriendly nature of the data formats. Here, we discuss the NASA Modern-Era Retrospective analysis for Research and Applications (MERRA) and a companion dataset, the Gridded Innovations and Observations (GIO). GIO is simply a post-processing of the assimilated observations and their innovations (forecast error and analysis error) to a common spatio-temporal grid, following that of the MERRA analysis fields. This data includes in situ, retrieved and radiance observations that are assimilated and used in the reanalysis. While all these disparate observations and statistics are in a uniform easily accessible format, there are some limitations. Similar observations are binned to the grid, so that multiple observations are combined in the gridding process. The data is then implicitly thinned. Some details in the meta data may also be lost (e.g. aircraft or station ID). Nonetheless, the gridded observations should provide easy access to all the observations input to the reanalysis. To provide an example of the GIO data, a case study evaluating observing systems over the United States and statistics is presented, and demonstrates the evaluation of the observations and the data assimilation. The GIO data is used to collocate 200mb Radiosonde and Aircraft temperature measurements from 1979-2009. A known warm bias of the aircraft measurements is apparent compared to the radiosonde data. However, when larger quantities of aircraft data are available, they dominate the analysis and the radiosonde data become biased against the forecast. When AMSU radiances become available the radiosonde and aircraft analysis and forecast error take on an annual cycle. While this supports results of previous work that recommend bias corrections for the aircraft measurements, the interactions with AMSU radiances will also require further investigation. This also provides an example for reanalysis users in examining the available observations and their impact on the analysis. GIO data is presently available alongside the MERRA reanalysis.

Bosilovich, Michael G.↗

Memory-based frame synchronizer

A frame synchronizer for use in digital communications systems wherein data formats can be easily and dynamically changed is described. The use of memory array elements provide increased flexibility in format selection and sync word selection in addition to real time reconfiguration ability. The frame synchronizer comprises a serial-to-parallel converter which converts a serial input data stream to a constantly changing parallel data output. This parallel data output is supplied to programmable sync word recognizers each consisting of a multiplexer and a random access memory (RAM). The multiplexer is connected to both the parallel data output and an address bus which may be connected to a microprocessor or computer for purposes of programming the sync word recognizer. The RAM is used as an associative memory or decorder and is programmed to identify a specific sync word. Additional programmable RAMs are used as counter decoders to define word bit length, frame word length, and paragraph frame length.

Stattel, R. J.↗

PCI: A PATRAN-NASTRAN model translator

The amount of programming required to develop a PATRAN-NASTRAN translator was surprisingly small. The approach taken produced a highly flexible translator comparable with the PATNAS translator and superior to the PATCOS translator. The coding required varied from around ten lines for a shell element to around thirty for a bar element, and the time required to add a feature to the program is typically less than an hour. The use of a lookup table for element names makes the translator also applicable to other versions of NASTRAN. The saving in time as a result of using PDA's Gateway utilities was considerable. During the writing of the program it became apparent that, with a somewhat more complex structure, it would be possible to extend the element data file to contain all data required to define the translation from PATRAN to NASTRAN by mapping of data between formats. Similar data files on property, material and grid formats would produce a completely universal translator from PATRAN to any FEA program, or indeed any CAE system.

Sheerer, T. J.↗

Software Modules for the Proximity-1 Space Link Interleaved Time Synchronization (PITS) Protocol

The Proximity-1 Space Link Interleaved Time Synchronization (PITS) protocol provides time distribution and synchronization services for space systems. A software prototype implementation of the PITS algorithm has been developed that also provides the test harness to evaluate the key functionalities of PITS with simulated data source and sink. PITS integrates time synchronization functionality into the link layer of the CCSDS Proximity-1 Space Link Protocol. The software prototype implements the network packet format, data structures, and transmit- and receive-timestamp function for a time server and a client. The software also simulates the transmit and receive-time stamp exchanges via UDP (User Datagram Protocol) socket between a time server and a time client, and produces relative time offsets and delay estimates.

Woo, Simon S.↗

Marmot

Marmot is a data formatting and visualization tool for production cost modelling results. It provides an efficient way to view PLEXOS production cost modeling results quickly, while also creating publication ready figures and data tables.

Levie, Daniel↗

NCSU Flux Tower Data

NCSU Flux Tower Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument descripotion Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Sonic Anemometer, 3 Condensation Particle Counters, 1 SP2, 1 POPS Start Date: 2022-06-01 End Date: 2022-9-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU flux tower was located next to the AMF sampling pad. The flux tower consisted of a 10 m telescoping tower. Mounted at the top of the tower was a sonic anemometer (RM Young 8000) and a Krypton Hygrometer. A sample line (¼” conductive tubing) and communication line was laid to a trailer located underneath and slightly adjacent to the tower. The sample line brought aerosol inside the trailer at 4.5 L min-1, where it was distributed between 3 CPCs (TSI 3776c, Dc ~ 2.5 nm, TSI 3771, Dc ~10nm, and TSI 3772, Dc ~40 nm) with different size cuts. Also sampling was a printed particle optical spectrometer (POPS) and a single particle soot photometer (SP2). Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU RDMA data

NCSU RDMA Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Nano-Scanning Mobility Particle (SMPS); A Radial Differential Mobility Analyzer (RDMA) coupled with 1 Condensation Particle Counter Start Date: 2022-06-01 End Date: 2022-9-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU RDMA was operated at a sheath-to-sample flow ratio of 5:1.5 L min−1. The RDMA was configured to scan from 5 to 55 nm. It was located into the temperature-controlled trailer adjacent to the NCSU Flux Tower to observe size distributions of the aerosols.The sample line was dried with three silica-gel driers in series, and then neutralized with X-ray neutralizer. Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU HTDMA data

NCSU HTDMA data Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Humidified Tandem Differential Mobility Analyzer; 2 Differential Mobility Analyzers (DMA1 and DMA2). Start Date: 2022-06-01 End Date: 2022-09-26 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The NCSU HTDMA was operated at a sheath-to-sample flow ratio of 5:1 L min−1. The HTDMA was configured to measure hygroscopic growth factors of dry particles with mobility diameters of D = 15, 20, 30, 40, and 50 nm at RH ~ 70%. A complete cycle for all diameters took ~30 minutes. A sample line brought aerosol inside the trailer at 2.5 L min-1, where it was distributed between NCSU RDMA (1.5 L min-1) and NCSU HTDMA (1 L min-1) lines. The sample line was dried with three silica-gel driers in series, and then neutralized with X-ray neutralizer. The sample line entered DMA1 (operated as an electrostatic classifier). Monodisperse particles with certain fractions were humidified with temperature controlled Nafion membrane immersed in water before entering DMA2 (operated in scanning mobility particle sizer). Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

NCSU Black Carbon (SP2) Data

NCSU SP2 Data Data Level b1: QC checks applied to measurements Data Format: CSV Description: See "instrument description Site: Houston, TX; Tracking Aerosol Convection interactions ExpeRiment (HOU) Location: Houston, TX; AMF1 (main site for TRACER) Facility Code: M1 Category: Aerosol Properties Data Type: PI Data Source Instrument/Data: Single Particle Soot Photometer (SP2) Start Date: 2022-06-01 End Date: 2022-09-27 Contact PI: Markus Petters (mdpetter@ncsu.edu) Funding Source: DOE ASR award US Department of Energy, Office of Science, Biological and Environment Research (grant no. DE-SC 0021074) Instrument description The SP2 was located in the temperature-controlled trailer adjacent to the NCSU Flux Tower to observe refractory black carbon (rBC) number concentration and mixing states of black carbon. The sample line brought aerosol inside the trailer at 4.5 L min-1, where it was distributed between 3 CPCs (TSI 3776c, Dc ~ 2.5 nm, TSI 3771, Dc ~10nm, and TSI 3772, Dc ~40 nm) with different size cuts, a printed particle optical spectrometer (POPS), and SP2. Please contact mdpetter@ncsu.edu for further information.

54 ENVIRONMENTAL SCIENCES↗

Decision Support Tool Evaluation Report for General NOAA Oil Modeling Environment(GNOME) Version 2.0

NASA's Earth Science Applications Directorate evaluated the potential of NASA remote sensing data and modeling products to enhance the General NOAA Oil Modeling Environment (GNOME) decision support tool. NOAA's Office of Response and Restoration (OR&R) Hazardous Materials (HAZMAT) Response Division is interested in enhancing GNOME with near-realtime (NRT) NASA remote sensing products on oceanic winds and ocean circulation. The NASA SeaWinds sea surface wind and Jason-1 sea surface height NRT products have potential, as do sea surface temperature and reflectance products from the Moderate Resolution Imaging Spectroradiometer and sea surface reflectance products from Landsat and the Advanced Spaceborne Thermal Emission and Reflectance Radiometer. HAZMAT is also interested in the Advanced Circulation model and the Ocean General Circulation Model. Certain issues must be considered, including lack of data continuity, marginal data redundancy, and data formatting problems. Spatial resolution is an issue for near-shore GNOME applications. Additional work will be needed to incorporate NASA inputs into GNOME, including verification and validation of data products, algorithms, models, and NRT data.

Spruce, Joseph P.↗

Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud

Cloud computing offers the possibility of making the analysis of Big Data approachable for a wider community due to affordable access to computing power, an ecosystem of usable tools for parallel processing, and migration of many large datasets to archives in the cloud, allowing data-proximal computing. Generally, data analysis acceleration in the cloud comes from running multiple nodes in a split-combine-apply strategy. Data systems such as the Earth Observing System Data and Information System are in a position to "pre-split" the data by storing them in a data store that is optimized for data parallel computing, i.e., an Analytics-Optimized Data Store (AODS). A variety of approaches to AODS are possible, from highly scalable databases to scalable filesystems to data formats optimized for cloud access (e.g., zarr and cloud-optimized datasets), with the optimal choice dependent on both the types of analysis and the geospatial structure of the data. A key question is how much preprocessing of the data to do, both before splitting and as the first part of the apply step. Again, the geospatial structure of the data and the analysis type influence the decision, with the added complexity of the user type. Trans-disciplinary users who are not well-versed in the nuances of quality-filtering and georeferencing of remote sensing orbit/swath/scene data tend to ask for more highly processed data, relying on the data provider to make sensible decisions on preprocessing parameters. (This accounts for the popularity of "Level 3" gridded data, despite the lower spatial resolution it provides.) In this case, data can be preprocessed before the split, resulting in higher performance in the rest of the "apply" step, which can be transformative for use cases such as interactive data exploration at scale. Discipline researchers who are experienced with remote sensing data often prefer more flexibility in customizing the preprocessing data into Analysis Ready Data, resulting in more need for on-the-fly preprocessing.

Lynnes, Christopher↗

BOREAS Elevation Contours over the NSA and SSA in ARC/INFO Generate Format

This data set was prepared by BORIS Staff by reformatting the original data into the ARC/INFO Generate format. The original data were received in SIF at a scale of 1:50,000. BORIS staff could not find a format document or commercial software for reading SIF; the BOREAS HYD-08 team pro-vided some C source code that could read some of the SIF files. The data cover the BOREAS NSA and SSA. The original data were compiled from information available in the 1970s and 1980s. The data are available in ARC/INFO Generate format files.

Knapp, David↗