Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

User Centered, Application Independent Visualization of National Airspace Data

This paper describes an application independent software tool, IV4D, built to visualize animated and still 3D National Airspace System (NAS) data specifically for aeronautics engineers who research aggregate, as well as single, flight efficiencies and behavior. IV4D was origin ally developed in a joint effort between the National Aeronautics and Space Administration (NASA) and the Air Force Research Laboratory (A FRL) to support the visualization of air traffic data from the Airspa ce Concept Evaluation System (ACES) simulation program. The three mai n challenges tackled by IV4D developers were: 1) determining how to d istill multiple NASA data formats into a few minimal dataset types; 2 ) creating an environment, consisting of a user interface, heuristic algorithms, and retained metadata, that facilitates easy setup and fa st visualization; and 3) maximizing the user?s ability to utilize the extended range of visualization available with AFRL?s existing 3D te chnologies. IV4D is currently being used by air traffic management re searchers at NASA?s Ames and Langley Research Centers to support data visualizations.

Murphy, James R.↗

Large-Eddy Simulation of Laser-Ignited Direct Injection Gasoline Spray for Emission Control

Large-Eddy Simulations (LES) of a gasoline spray, where the mixture was ignited rapidly during or after injection, were performed in comparison to a previous experimental study with quantitative flame motion and soot formation data [SAE 2020-01-0291] and an accompanying Reynolds-Averaged Navier–Stokes (RANS) simulation at the same conditions. The present study reveals major shortcomings in common RANS combustion modeling practices that are significantly improved using LES at the conditions of the study, specifically for the phenomenon of rapid ignition in the highly turbulent, stratified mixture. At different ignition timings, benchmarks for the study include spray mixing and evaporation, flame propagation after ignition, and soot formation in rich mixtures. A comparison of the simulations and the experiments showed that the LES with Dynamic Structure turbulence were able to capture correctly the liquid penetration length, and to some extent, spray collapse demonstrated in the experiments. For early and intermediate ignition timings, the LES showed excellent agreement to the measurements in terms of flame structure, extent of flame penetration, and heat-release rate. However, RANS simulations (employing the common G-equation or well-stirred reactor) showed much too rapid flame spread and heat release, with connections to the predicted turbulent kinetic energy. With confidence in the LES for predicted mixture and flame motion, the predicted soot formation/oxidation was also compared to the experiments. The soot location was well captured in the LES, but the soot mass was largely underestimated using the empirical Hiroyasu model. An analysis of the predicted fuel–air mixture was used to explain different flame propagation speeds and soot production tendencies when varying ignition timing.

42 ENGINEERING↗

Engineering specification and system design for CAD/CAM of custom shoes. Phase 5: UMC involvement (January 1, 1989 - June 30, 1989)

The CAD/CAM of custom shoes is discussed. The solid object for machining is represented by a wireframe model with its nodes or vertices specified systematically in a grid pattern covering its entire length (point-to-point configuration). Two sets of data from CENCIT and CYBERWARE were used for machining purposes. It was found that the indexing technique (turning the stock by a small angle then moving the tool on a longitudinal path along the foot) yields the best result in terms of ease of programming, savings in wear and tear of the machine and cutting tools, and resolution of fine surface details. The work done using the LASTMOD last design system results in a shoe last specified by a number of congruent surface patches of different sizes. This data format was converted into a form amenable to the machine tool. It involves a series of sorting algorithms and interpolation algorithms to provide the grid pattern that the machine tool needs as was the case in the point to point configuration discussed above. This report also contains an in-depth treatment of the design and production technique of an integrated sole to complement the task of design and manufacture of the shoe last. Clinical data and essential production parameters are discussed. Examples of soles made through this process are given.

Bao, Han P.↗

A Multi-mission Event-Driven Component-Based System for Support of Flight Software Development, ATLO, and Operations first used by the Mars Science Laboratory (MSL) Project

This viewgraph presentation reviews the architectural description of the Mission Data Processing and Control System (MPCS). MPCS is an event-driven, multi-mission ground data processing components providing uplink, downlink, and data management capabilities which will support the Mars Science Laboratory (MSL) project as its first target mission. MPCS is designed with these factors (1) Enabling plug and play architecture (2) MPCS has strong inheritance from GDS components that have been developed for other Flight Projects (MER, MRO, DAWN, MSAP), and are currently being used in operations and ATLO, and (3) MPCS components are Java-based, platform independent, and are designed to consume and produce XML-formatted data

Mission Data Processing and Control System (MPCS)↗

QuakeSim and the Solid Earth Research Virtual Observatory

We are developing simulation and analysis tools in order to develop a solid Earth science framework for understanding and studying active tectonic and earthquake processes. The goal of QuakeSim and its extension, the Solid Earth Research Virtual Observatory (SERVO), is to study the physics of earthquakes using state-of-the-art modeling, data manipulation, and pattern recognition technologies. We are developing clearly defined accessible data formats and code protocols as inputs to simulations, which are adapted to high-performance computers. The solid Earth system is extremely complex and nonlinear resulting in computationally intensive problems with millions of unknowns. With these tools it will be possible to construct the more complex models and simulations necessary to develop hazard assessment systems critical for reducing future losses from major earthquakes. We are using Web (Grid) service technology to demonstrate the assimilation of multiple distributed data sources (a typical data grid problem) into a major parallel high-performance computing earthquake forecasting code. Such a linkage of Geoinformatics with Geocomplexity demonstrates the value of the Solid Earth Research Virtual Observatory (SERVO) Grid concept, and advances Grid technology by building the first real-time large-scale data assimilation grid.

virtual observatory↗

A synopsis of Langley Research Center's lidar effort for the 1986 FIRE IFO

The lidar data obtained by the Langley Aircraft Lidar in October 1986 in Wisconsin is being reduced in a transparent, simple fashion and will be published in its reduced form in a NASA Reference Publication (RP). This reduced data will also be submitted to the FIRE data archives. Some of this reduced data will be presented at the FIRE FSET Workshop to acquaint the science team with the data format to be used in the archive and the upcoming catalog contained in the RP. A new method was utilized in Wisconsin for obtain the depolarization ratio of aerosols. This method involves using a half-wave plate to calibrate the lidar under field conditions. The theory behind this technique will be presented at this workshop as well as some of the lidar calibration results. The lidar calibration will be utilized in interpreting some of the dual polarization lidar data obtained during the IFO in Wisconsin. Some of these data are also discussed. A continuous wave laser lab-type lidar simulator was constructed during the previous year. One of the primary reasons for the construction of the simulator was to attempt dual-polarization lidar-like calibrations under laboratory, rather than field conditions. The data collected by this system was used to experimentally check and thus, inspire confidence in the algorithms being used to interpret the lidar data obtained in the field. A computer program which simulates noisy lidar data was used as a part of this effort in order to obtain some feel for the noise in the inversion parameters as a function of noise in the actual measurements. The lidar simulation will be described in addition to presenting some of the lab-generated calibration data.

Alvarez, Jose M.↗

Nanoporous Tio2 Water Training Data

Data and input files used to train a Deep Potential (DP) model for the nanoporous TiO2-water interface. The DeepMD-kit code was used to train the DP. Information about data format, and how to use DeepMD-kit can be found at https://docs.deepmodeling.com/projects/deepmd/en/master/

08 HYDROGEN↗

An Object-Oriented Interface to the CCSDS Ground Telecommand Services

The Telecommand Data Routing and Channel Services defined by the Consultative Committee for Space Data Systems (CCSDS) are flexible enough to support a myriad of commanding models. Because the standard is so broad, the traditional approach has been to implement only the portion of the standard needed by the particular spacecraft being tested/operated. Tasked with providing Telecommand Services for an entire class of spacecraft, where each spacecraft may choose any valid CCSDS commanding model, NASA Code 584 designed a common architecture capable of handling the full CCSDS protocol. The solution uses another CCSDS standard - the Standard Formatted Data Unit (SFDU) as the interface to the Telecommand Services. SFDUs provide a consistent way of labelling data objects, as well as allowing data objects to encapsulate other data objects. The resulting interface is: - Flexible: The full Data Routing and Channel Services are available via a single interface. The client (i.e. the command source) may enter commands at any layer within the protocol stack, specify any of the data aggregation or segmentation methods, and dynamically set any configuration parameter defined in the standard. - Object-oriented: Each object specifies both the data and the actions to be performed with the data. An object may contain other objects. - Expandable: New capabilities are added by defining new objects. Objects pass thru the protocol layers until they reach the applicable layer. The resulting design is: - Modular: The logic for each protocol layer is contained in a separate Application Program Interface (API). The objects used for the external interface are also used for communication between layers. - Distributable: The design can be split along any layer boundary for distribution across multiple machines. The objects ensure data consistency across platforms. This paper describes the SFDU-based interface and the resulting protocol implementation. The implementation is currently used by NASA (National Aeronautics and Space Administration) for integration & test of the microwave Anisotropy Probe (MAP) and Earth observer-I (EO-l) spacecraft. It will be used for post-launch operations of these spacecraft as well as the Imager for Magnetopause to Aurora Global Exploration (IMAGE) spacecraft.

Ray, Timothy Joseph↗

Surface Radiation Budget (SRB) Release 2 Shortwave 3 hourly Monthly Data in Native Format (SRB_REL2_SW_3HRLY_MONTHLY)

The SRB data include the average upward and downward fluxes, photosynthetically active radiative flux, aerosol and cloud optical depth, cloud fraction, and solar zenith angle at three hourly intervals for each day for the entire globe between 07/01/1983 and 10/31/1995. These parameters were derived with the Shortwave algorithm of the NASA World Climate Research Programme/Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1983-07-01; Stop_Date=1998-07-26] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics 120 degrees (the poles); Temporal_Resolution=3 hourly; Temporal_Resolution_Range=3 hourly].

AEROSOL OPTICAL DEPTH↗

Surface Radiation Budget (SRB) Release 2.5 Longwave cloud props 3 hourly Data in Native Format (SRB_REL2.5_LW_CLDPROPS_3HRLY)

The Surface Radiation Budget (SRB) data set contain 47 surface and cloud properties including cloud fraction, cloud visible optical depth, cloud top temperature, cloud top pressure, cloud base pressure, and cloud water and ice content for each of 5 cloud types and in total. In addition to these cloud properties, the parameters also include surface pressure, total column ozone, day/night flag, and precipitable water. All perameters were measured at three hourly intervals for each day for the entire globe between 07/01/1983 and 06/30/2005 and serve as inputs to the Global Energy and Water-Cycle Experiment (GEWEX) longwave algorithm (GLW). [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-06-30] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics) to 120 degrees (the poles).; Temporal_Resolution=3 hourly; Temporal_Resolution_Range=3 hourly].

CLOUD TOP TEMPERATURE↗

Improving precision and accuracy of genetic mapping with genotyping-by-sequencing data in outcrossing species

This dataset contains all data and supplementary materials from "Improving precision and accuracy of genetic mapping with genotyping-by-sequencing data in outcrossing species". An Excel file a list of all QTLs and linkage group length (in cM) obtained with two different SNP-calling methods (Tassel-Uneak and Tassel-GBS), genetic map-construction method (linkage-only and reference order-corrected) and depth filters (12x, 20x, 30x and 40x) for genetic mapping of 18 biomass yield traits in a biparental Miscanthus sinensis population using RAD-Seq SNPs is provided as "Supplementary file 1". A Perl script with the code for filtering VCF and HapMap-formatted data files is provided as “Supplementary file 2”. Phenotype data used for QTL mapping is provided as “Supplementary File 3”. A Perl script with the code for the simulation study is provided as “Supplementary file 4”.

GenotypingSimulator↗

Best Practices for Nuclear Experiment Data Preservation at Idaho National Laboratory: A Guide for Researchers and Reactor Operators

Preserving experimental data is essential for supporting advancements in nuclear science and ensuring the longevity of Idaho National Laboratory's contributions to reactor technology and safety. This report provides a comprehensive guide to best practices for experimental data management and preservation, focusing on standardized data formats, redundancy in storage, metadata documentation, and alignment with international standards. By following these recommendations, experimentalists and reactor operators can enhance the accessibility, reproducibility, and utility of critical datasets for regulatory review, validation computational methods, and future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Remote sensing, land use, and demography - A look at people through their effects on the land

Relevant causes of failure by the remote sensing community in the urban scene are analyzed. The reasons for the insignificant role of remote sensing in urban land use data collection are called the law of realism, the incompatibility of remote sensing and urban management system data formats is termed the law of nominal/ordinal systems compatibility, and the land use/population correlation dilemma is referred to as the law of missing persons. The study summarizes the three laws of urban land use information for which violations, avoidance, or ignorance have caused the decline of present remote sensing research. Particular attention is given to the rationale for urban land use information and for remote sensing. It is shown that remote sensing of urban land uses compatible with the three laws can be effectively developed by realizing the 10 percent contribution of remote sensing to urban land use planning data collection.

Paul, C. K.↗

Building Multi-Discipline, Multi-Format Digital Libraries Using Clusters and Buckets

Our objective was to study the feasibility of extending the Dienst protocol to enable a multi-discipline, multi-format digital library. We implemented two new technologies: cluster functionality and publishing buckets. We have designed a possible implementation of clusters and buckets, and have prototyped some aspects of the resultant digital library. Currently, digital libraries are segregated by the disciplines they serve (computer science, aeronautics, etc.), and by the format of their holdings (reports, software, datasets, etc.). NCSTRL+ is a multi-discipline, multi-format digital library (DL) prototype created to explore the feasibility of the design and implementation issues involved with created a unified, canonical scientific and technical information (STI) DL. NCSTRL+ is based on the Networked Computer Science Technical Report Library (NCSTRL), a World Wide Web (WWW) accessible DL that provides access to over 80 university departments and laboratories. We have extended the Dienst protocol (version 4.1.8), the protocol underlying NCSTRL, to provide the ability to cluster independent collections into a logically centralized DL based upon subject category classification, type of organization, and genre of material. The concept of buckets provides a mechanism for publishing and managing logically linked entities with multiple data formats.

Nelson, Michael L.↗

MIBiG 3.0: a community-driven effort to annotate experimentally validated biosynthetic gene clusters

Abstract With an ever-increasing amount of (meta)genomic data being deposited in sequence databases, (meta)genome mining for natural product biosynthetic pathways occupies a critical role in the discovery of novel pharmaceutical drugs, crop protection agents and biomaterials. The genes that encode these pathways are often organised into biosynthetic gene clusters (BGCs). In 2015, we defined the Minimum Information about a Biosynthetic Gene cluster (MIBiG): a standardised data format that describes the minimally required information to uniquely characterise a BGC. We simultaneously constructed an accompanying online database of BGCs, which has since been widely used by the community as a reference dataset for BGCs and was expanded to 2021 entries in 2019 (MIBiG 2.0). Here, we describe MIBiG 3.0, a database update comprising large-scale validation and re-annotation of existing entries and 661 new entries. Particular attention was paid to the annotation of compound structures and biological activities, as well as protein domain selectivities. Together, these new features keep the database up-to-date, and will provide new opportunities for the scientific community to use its freely available data, e.g. for the training of new machine learning models to predict sequence-structure-function relationships for diverse natural products. MIBiG 3.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗

DaYu: Optimizing Distributed Scientific Workflows by Decoding Dataflow Semantics and Dynamics

The combination of ever-growing scientific datasets and distributed workflow complexity creates I/O performance bottlenecks due to data volume, velocity, and variety. Although the increasing use of descriptive data formats (e.g., HDF5, netCDF) helps organize these datasets, it also creates obscure bottlenecks due to the need to translate high level operations into file addresses and then into low-level I/O operations. To address this challenge, we introduce DaYu, a method and toolset for analyzing (a) semantic relationships between logical datasets and file addresses, (b) how dataset operations translate into I/O, and (c) the combination across entire workflows. DaYu's analysis and visualization enables identification of critical bottlenecks and reasoning about remediation. We describe our methodology and propose optimization guidelines. Evaluation on scientific workflows demonstrates up to 3.7x performance improvements in I/O time for obscure bottlenecks. The time and storage overhead for DaYu's time-ordered data is typically under 0.2% of runtime and 0.25% of data volume, respectively.

Tang, Meng↗

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

Earth Probe Total Ozone Mapping Spectrometer (TOMS) Data Product User's Guide

Two data products from the Earth Probe Total Ozone Mapping Spectrometer (EP/TOMS) have been archived at the Distributed Active Archive Center, in the form of Hierarchical Data Format files. The EP/ TOMS began taking measurements on July 15, 1996. The instrument measures backscattered Earth radiance and incoming solar irradiance; their ratio is used in ozone retrievals. Changes in the reflectivity of the solar diffuser used for the irradiance measurement are monitored using a carousel of three diffusers, each exposed to the degrading effects of solar irradiation at different rates. The algorithm to retrieve total column ozone compares measured Earth radiances at sets of three wavelengths with radiances calculated for different total ozone values. The initial error in the absolute scale for TOMS total ozone is 3 percent, the one standard deviation random error is 2 percent, and the drift is less than 0.5 percent over the first year of data. The Level-2 product contains the measured radiances, the derived total ozone amount, and reflectivity information for each scan position. The Level-3 product contains daily total ozone and reflectivity in a 1-degree latitude by 1.25 degrees longitude grid. Level-3 files containing estimates of LTVB at the Earth surface and tropospheric aerosol information are also available, Detailed descriptions of both HDF data-files and the CD-ROM product are provided.

McPeters, R.↗