Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Evolving the Technical Infrastructure of the Planetary Data System for the 21st Century

The Planetary Data System (PDS) was established in 1989 as a distributed system to assure scientific oversight. Initially the PDS followed guidelines recommended by the National Academies Committee on Data Management and Computation (CODMAC, 1982) and placed emphasis on archiving validated datasets. But overtime user demands, supported by increased computing capabilities and communication methods, have placed increasing demands on the PDS. The PDS must add additional services to better enable scientific analysis within distributed environments and to ensure that those services integrate with existing systems and data. To face these challenges the Planetary Data System (PDS) must modernize its architecture and technical implementation. The PDS 2010 project addresses these challenges. As part of this project, the PDS has three fundamental project goals that include: (1) Providing more efficient client delivery of data by data providers to the PDS (2) Enabling a stable, long-term usable planetary science data archive (3) Enabling services for the data consumer to find, access and use the data they require in contemporary data formats. In order to achieve these goals, the PDS 2010 project is upgrading both the technical infrastructure and the data standards to support increased efficiency in data delivery as well as usability of the PDS. Efforts are underway to interface with missions as early as possible and to streamline the preparation and delivery of data to the PDS. Likewise, the PDS is working to define and plan for data services that will help researchers to perform analysis in cost-constrained environments. This presentation will cover the PDS 2010 project including the goals, data standards and technical implementation plans that are underway within the Planetary Data System. It will discuss the plans for moving from the current system, version PDS 3, to version PDS 4.

Beebe, Reta F.↗
NASA NTRS2018

Steps Toward Improved Integration, Search, and Analysis of Heterogeneous Data in the Astrobiology Habitable Environments Database

The Astrobiology Habitable Environments Database (AHED) is a new data system being developed as a long-term, open-access repository for astrobiology data. AHED is intended to store user-contributed results from NASA or externally-funded research in astrobiology, and to encourage sharing and synergy within the astrobiology community. However, the interdisciplinary nature of astrobiology presents some specific challenges to data management, integration, and analysis within AHED. In some disciplines (e.g., genomics), open databases thrive because the contributed products are fairly uniform and standardized (e.g., sequence data). In astrobiology, each investigation produces a unique set of data products; this makes it difficult to search across different datasets to find similar data, or to combine results from separate investigations. With AHED, we are taking steps to ensure there is adequate metadata - both at the dataset and record levels - to facilitate search, integration, and analysis. At the dataset level, we are developing a new metadata standard for describing astrobiology datasets, with detailed information about content, funding source, and scientific relevance, along with a set of topical keywords for characterizing datasets. At the record level, we are encouraging users to provide more structured content and finer-grained metadata. In many user-contributed science data repositories, few restrictions are placed on the uploaded data format, and minimal or no record-level metadata is required; thus users are unburdened when it comes to data preparation. The tradeoff is that deep integration and search across datasets is almost impossible without standardized structures and metadata. Although AHED users are free to upload minimally-described datasets, they will be encouraged to use database authoring tools (supplied by the underlying platform - Open Data Repository's Data Publisher) plus a set of customizable astrobiology-specific templates to help structure their data and provide standardized metadata. In reward for their extra effort, AHED will be able to deliver enhanced search, discovery, and analysis capabilities.

astrobiology↗
NASA NTRS1978

Hybrid holographic non-destructive test system

An automatic hybrid holographic non-destructive testing (HNDT) method and system capable of detecting flaws or debonds contained within certain materials are described. This system incorporates the techniques of optical holography, acoustical/optical holography and holographic correlation in determining the structural integrity of a test object. An automatic processing system including a detector and automatic data processor is used in conjunction with the three holographic techniques for correlating and interpreting the information supplied by the non-destructive systems. The automatic system also includes a sensor which directly translates an optical data format produced by the holographic techniques into electrical signals and then transmits this information to a digital computer for indicating the structural properties of the test object. The computer interprets the data gathered and determines whether further testing is necessary as well as the format of this new testing procedure.

Kurtz, R. L.↗
NASA NTRS1997

Visualization of IACG data

The common data format (CDF), adopted by the international solar terrestrial physics (ISTP) program and the Interagency Consultative Group (IACG), is considered. Extensive data sharing and data analysis are needed to ensure the success of the ISTP/IACG program. The CDF user guidelines and tools for creation, visualization and manipulation are underlined. Computer software applications based on CDF data sets and designed using ISTP/IACG guidelines are shown.

Kessel, Ramona L.↗
NASA NTRS1997

Querying Semi-Structured Data

The amount of data of all kinds available electronically has increased dramatically in recent years. The data resides in different forms, ranging from unstructured data in the systems to highly structured in relational database systems. Data is accessible through a variety of interfaces including Web browsers, database query languages, application-specic interfaces, or data exchange formats. Some of this data is raw data, e.g., images or sound. Some of it has structure even if the structure is often implicit, and not as rigid or regular as that found in standard database systems. Sometimes the structure exists but has to be extracted from the data. Sometimes also it exists but we prefer to ignore it for certain purposes such as browsing. We call here semi-structured data this data that is (from a particular viewpoint) neither raw data nor strictly typed, i.e., not table-oriented as in a relational model or sorted-graph as in object databases. As will seen later when the notion of semi-structured data is more precisely de ned, the need for semi-structured data arises naturally in the context of data integration, even when the data sources are themselves well-structured. Although data integration is an old topic, the need to integrate a wider variety of data- formats (e.g., SGML or ASN.1 data) and data found on the Web has brought the topic of semi-structured data to the forefront of research. The main purpose of the paper is to isolate the essential aspects of semi- structured data. We also survey some proposals of models and query languages for semi-structured data. In particular, we consider recent works at Stanford U. and U. Penn on semi-structured data. In both cases, the motivation is found in the integration of heterogeneous data.

DATA MANAGEMENT↗
NASA NTRS2014

Proto-Examples of Data Access and Visualization Components of a Potential Cloud-Based GEOSS-AI System

Once a research or application problem has been identified, one logical next step is to search for available relevant data products. Thus, an early component of a potential GEOSS-AI system, in the continuum between observations and end point research, applications, and decision making, would be one that enables transparent data discovery and access by users. Such a component might be effected via the systems data agents. Presumably, some kind of data cataloging has already been implemented, e.g., in the GEOSS Common Infrastructure (GCI). Both the agents and cataloging could also leverage existing resources external to the system. The system would have some means to accept and integrate user-contributed agents. The need or desirability for some data format internal to the system should be evaluated. Another early component would be one that facilitates browsing visualization of the data, as well as some basic analyses.Three ongoing projects at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provide possible proto-examples of potential data access and visualization components of a cloud-based GEOSS-AI system. 1. Reorganizing data archived as time-step arrays to point-time series (data rods), as well as leveraging the NASA Simple Subset Wizard (SSW), to significantly increase the number of data products available, at multiple NASA data centers, for production as on-the-fly (virtual) data rods. SSWs data discovery is based on OpenSearch. Both pre-generated and virtual data rods are accessible via Web services. 2. Developing Web Feature Services to publish the metadata, and expose the locations, of pre-generated and virtual data rods in the GEOSS Portal and enable direct access of the data via Web services. SSW is also leveraged to increase the availability of both NASA and non-NASA data.3.Federating NASA Giovanni (Geospatial Interactive Online Visualization and Analysis Interface), for multi-sensor data exploration, that would allow each cooperating data center, currently the NASA Distributed Active Archive Centers (DAACs), to configure its own Giovanni deployment, while also allowing all the deployments to incorporate each others data. A federated Giovanni comprises Giovanni Virtual Machines, which can be run on local servers or in the cloud.

access↗
DOE OSTI2025

On-Demand Column Joining for High Energy Physics

As the Large Hadron Collider (LHC) transitions into the High-Luminosity LHC (HL-LHC) era, the volume of data to be processed is expected to increase significantly. The CMS Experiment currently utilizes various data formats, including AOD, MiniAOD, and NanoAOD, each with different levels of detail and storage requirements. This paper addresses the challenges of data duplication and storage inefficiencies in high-energy physics (HEP) analyses by proposing an on-demand column-joining solution. This approach aims to reduce data duplication by enabling the dynamic combination of NanoAOD data with auxiliary information from larger data tiers, such as MiniAOD. The proposed solution leverages Trino, a high-performance distributed SQL query engine, to perform efficient and scalable data joins. Benchmarks using CMS OpenData demonstrate the feasibility of this approach, showing that it can handle large datasets with low latency. Integration with the scikit-hep ecosystem and the coffea analysis framework is also discussed, highlighting the potential for seamless end-to-end data processing and analysis. Ongoing and future work focuses on expanding benchmarks, integrating ServiceX for data transformation, and exploring the use of native object storage solutions.

Manganelli, Nicholas [Northeastern U.]↗
DOE OSTI2024

The Foundational Industrial Energy Dataset (FIED): Open-Source Data on Industrial Facilities

The state of data on industrial energy use has co-evolved over several decades with the demands of industrial energy analysis. The most recent development - analysis in support of decarbonizing the industrial sector - has changed the characteristics of industrial data that are useful for analysts and model developers. Although data and its collection processes may be cast from a conventional viewpoint as objective and free from the influence of social dynamics, this provides an incomplete picture of not only the processes by which information is generated, but also the limitations and opportunities of data to be useful for analysis. The foundational industry energy data set (FIED) is a result of the confluence of trends in open data and the demand for higher resolution industrial energy analysis. The general approach to compiling the FIED involves accessing, filtering, and formatting data published by federal organizations on the Internet for public use. Unlike most industrial energy datasets, which are published by the U.S. Energy Information Administration (EIA), the FIED relies on core datasets from the U.S. Environmental Protection Agency (EPA). The FIED addresses several of the areas of growing disconnect between the demands of industrial energy analysis and the state of industrial energy data by providing unit-level characterization - including estimates of energy use, greenhouse gas emissions, and design capacities - for facilities that are identified by latitude and longitude. This enables local-level analysis of existing combustion equipment, as well as regional comparisons with traditional industrial energy data estimates. The report summarizes the general logic behind compiling the FIED. The FIED itself and its Python code are available from OpenEI and GitHub, respectively.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Enhanced HLW glass property-composition models - phase 3

During the present phase (Phase 3) of work to enhance and expand the HLW glass property-composition models, test data for 137 glasses were collected and incorporated into the combined WTP/ORP database. The new data include those collected on glasses from two statistically designed matrices to augment the moderate alumina region (the HLW16-MA matrix covering the region of 9 wt% < Al2O3 < 12 wt% with 16 glasses) and the ultra-high alumina region (the HLW16-UHA matrix covering the region of 26 wt% < Al2O3 < 29 wt% with 29 glasses). The addition of ORP glasses over the different phases of testing has significantly expanded the combined WTP/ORP database. The compiled data include glass compositions, PCT (B, Li and Na) releases, spinel T1%, electrical conductivity, viscosity, TCLP-Cd releases, and nepheline formation upon CCC. With the exception of the CCC spinel formation data – the CCC data will be used to support the further development of nepheline models for Hanford HLW glasses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1981

MAGSAT data processing: A report for investigators

The in-flight attitude and vector magnetometer data bias recovery techniques and results are described. The attitude bias recoveries are based on comparisons with a magnetic field model and are thought to be accurate to 20 arcsec. The vector magnetometer bias recoveries are based on comparisons with the scalar magnetometer data and are thought to be accurate to 3 nT or better. The MAGSAT position accuracy goals of 60 m radially and 300 m horizontally were achieved for all but the last 3 weeks of Magsat lifetime. This claim is supported by ephemeris overlap statistics and by comparisons with ephemerides computed with an independent orbit program using data from an independent tracking network. MAGSAT time determination accuracy is estimated at 1 ms. Several errors in prelaunch assumptions regarding data time tags, which escaped detection in prelaunch data tests, and were discovered and corrected postlaunch are described. Data formats and products, especially the Investigator-B tapes, which contain auxiliary parameters in addition to the basic magnetometer and ephemeris data, are described.

Langel, R. A.↗
NASA NTRS1982

Geometric verification

Present LANDSAT data formats are reviewed to clarify how the geodetic location and registration capabilities were defined for P-tape products and RBV data. Since there is only one geometric model used in the master data processor, geometric location accuracy of P-tape products depends on the absolute accuracy of the model and registration accuracy is determined by the stability of the model. Due primarily to inaccuracies in data provided by the LANDSAT attitude management system, desired accuracies are obtained only by using ground control points and a correlation process. The verification of system performance with regards to geodetic location requires the capability to determine pixel positions of map points in a P-tape array. Verification of registration performance requires the capability to determine pixel positions of common points (not necessarily map points) in 2 or more P-tape arrays for a given world reference system scene. Techniques for registration verification can be more varied and automated since map data are not required. The verification of LACIE extractions is used as an example.

Grebowsky, G. J.↗
NASA NTRS1989

An interactive, discipline-independent data visualization system

The data visualization techniques used by National Space Science Data Center Graphics System are discussed. The system includes a self-describing data abstraction for the storage and manipulation of multidimensional data for discipline-independent scientific applications. The system's data format and graphics display are described. Consideration is given to techniques developed for the rapid display and manipulation of large, complex data sets and for manipulating algorithms with portable implementations which can operate on any data object or geometry. The processes of operating the system are given and examples are presented from applying the system to various types of data, including TOMS data, data from the International Satellite Cloud Climatology Project, and IRAS data.

Treinish, Lloyd A.↗
NASA NTRS2009

Simulation and Interpretation of the Genesis of Tropical Storm Gert (2005) as Part of the NASA Tropical Cloud Systems and Processes Experiment

Several hypotheses have been put forward for the how tropical cyclones (tropical storms and hurricanes in the Atlantic) first develop circulation at the surface, a key event that needs to occur before a storm can begin to draw energy from the warm ocean. One hypothesis suggests that the surface circulation forms from a "top-down" approach in which a storm s rotating circulation begins at middle levels of the atmosphere and builds down to the surface through processes related to light "stratiform" (horizontally extensive) precipitation. Another hypothesis suggests a bottom-up approach in which deep thunderstorm towers (convection) play the major role in spinning up the flow at the surface. These "hot towers" form in the area of the mid-level circulation and strongly concentrate this rotation at low levels within their updrafts. Merger of several of these hot towers then intensifies the surface circulation to the point in which a storm forms. This paper examines computer simulations of Tropical Storm Gert (2005), which formed in the Gulf of Mexico during the National Aeronautics and Space Administration s (NASA) Tropical Cloud Systems and Processes (TCSP) Experiment, to investigate the development of low-level circulation and, in particular, whether stratiform or hot tower processes were responsible for the storm s formation. Data from NASA satellites and from aircraft were used to show that the model did a good job of reproducing the formation and evolution of Gert. The simulation shows that a mix of both stratiform and convective rainfall occurred within Gert. While the stratiform rainfall clearly acted to increase rotation at middle levels, the diverging outflow beneath the stratiform rain worked against spinning up the low-level winds. The hot towers appeared to dominate the low-level flow, producing intense rotation within their cores and often being associated with significant pressure falls at the surface. Over time, many of these hot towers merged, with each merger adding to the rotation of the storm and the pressure falls at the surface. This process continued to increase the strength of the storm until the storm made landfall on the east coast of Mexico. These results support the bottom-up hypothesis for development.

Braun, Scott A.↗
NASA NTRS1995

Compendium of NASA data base for the global tropospheric experiment's Transport and Atmospheric Chemistry Near the Equator-Atlantic (TRACE-A)

This compendium describes aircraft data that are available from NASA's Transport and Atmospheric Chemistry near the Equator - Atlantic (TRACE-A) conducted in September/October 1992. The broad objectives of TRACE-A were to study chemical processes and long-range transport associated with South American and African continental outflow during periods of widespread vegetation burning, and to understand the ozone enhancements observed from satellite data measured over the southern tropical Atlantic Ocean during the September/October time period. Flight experiments were conducted from Brazil, South Africa, Namibia, and the Ascension Island. This document provides a representation of aircraft data that are available from NASA Langley's Distributed Active Archive Center (DAAC). The data format of time series and altitude profile plots is not intended to support original analyses, but to assist the reader in identifying data that are of interest. This compendium is for only the NASA aircraft data. The DAAC data base includes numerous supporting data-meteorological products, results from surface studies, satellite observations, and data from sonde releases.

Gregory, Gerald L.↗
NASA NTRS2007

XML Flight/Ground Data Dictionary Management

A computer program generates Extensible Markup Language (XML) files that effect coupling between the command- and telemetry-handling software running aboard a spacecraft and the corresponding software running in ground support systems. The XML files are produced by use of information from the flight software and from flight-system engineering. The XML files are converted to legacy ground-system data formats for command and telemetry, transformed into Web-based and printed documentation, and used in developing new ground-system data-handling software. Previously, the information about telemetry and command was scattered in various paper documents that were not synchronized. The process of searching and reading the documents was time-consuming and introduced errors. In contrast, the XML files contain all of the information in one place. XML structures can evolve in such a manner as to enable the addition, to the XML files, of the metadata necessary to track the changes and the associated documentation. The use of this software has reduced the extent of manual operations in developing a ground data system, thereby saving considerable time and removing errors that previously arose in the translation and transcription of software information from the flight to the ground system.

Wright, Jesse↗
DOE OSTI2022

Leaf C and N content by leaf age, Feb2017, PA-SLZ: Panama

This dataset contains carbon, hydrogen and nitrogen content measurements of sunlit canopy leaves of Apeiba membranacea (APEIME), Guatteria dumetorum (GUATDU), Miconia borealis (MICOBO), Terminalia amazonia (TERMAM), Virola multiflora (VIROSP) and Vochysia ferruginea (VOCHFE) species. Data was collected from the NGEE-Tropics Bosque Protector San Lorenzo (PA-SLZ) site in Panama in February of 2017 as part of the 2017 Brookhaven National Lab–Smithsonian Tropical Research Institute leaf traits by age campaign. A PDF with full sapling protocol is included in this dataset, along with metadata files in Excel file format. Data is in both CSV (Panama2017_CHN.csv) and Excel file formats. See related datasets for further sample details, leaf spectra, sap flow, leaf water potential, leaf mass per area (LMA), and gas exchange measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Demand-Side Grid (dsgrid) TEMPO Light-Duty Vehicle Charging Profiles v2022

Simulated hourly electric vehicle charging profiles for light-duty household passenger vehicles in the contiguous United States, 2018-2050. Profiles are differentiated by scenario, county, household and vehicle types, and charging type. Data was produced in 2022 using the Transportation Energy & Mobility Pathway Options (TEMPO) model and published in demand-side grid (dsgrid) toolkit format. Data are available for three adoption scenarios: "AEO Reference Case", which is aligned with the U.S. EIA Annual Energy Outlook 2018 (linked below), "EFS High Electrification", which is aligned with the High Electrification scenario of the Electrification Futures Study (linked below), and "All EV Sales by 2035", which assumes that average passenger light-duty EV sales reach 50% in 2030 and 100% in 2035. The charging shapes are derived from two key assumptions of which data users should be aware: "ubiquitous charger access", meaning that drivers of vehicles are assumed to have access to a charger whenever a trip is not in progress, and "immediate charging", meaning that immediately after trip completion, vehicles are plugged in and charge until they are either fully recharged or taken on another trip. These assumptions result in a bounding case in which vehicles' state of charge is maximized at all times. This bounding case would minimize range anxiety, but is unrealistic from the point of view of both electric vehicle service equipment (EVSE) (i.e., charger) access, and plug-in behavior as it can result in dozens of charging sessions per week for battery electric vehicles (BEVs) that in reality are often only plugged in a few times per week.

Array↗
NASA NTRS1988

Radar observations of the inner solar system

Concurrent objectives involve dynamical information: maintenance of Mars ephemeris accuracy, Mercury closure-point ranging for relativity theory testing, and refinement of spin-vector estimates for Venus and Mercury. This task has been renamed to reflect accurately the research it supports. The backlog of unprocessed Venus data has been sharply reduced; most images from the 1980 to 1982 conjunctions, and half of those from 1986, are essentially finished. Suitably formatted data have been distributed to (non-JPL) scientific collaborators for geologic analysis, and to the Magellan project.

Jurgens, Raymond F.↗