Search NASA⌕ Search

SEARCH · Search NASA

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Satellite on-board processing for earth resources data

Results of a survey of earth resources user applications and their data requirements, earth resources multispectral scanner sensor technology, and preprocessing algorithms for correcting the sensor outputs and for data bulk reduction are presented along with a candidate data format. Computational requirements required to implement the data analysis algorithms are included along with a review of computer architectures and organizations. Computer architectures capable of handling the algorithm computational requirements are suggested and the environmental effects of an on-board processor discussed. By relating performance parameters to the system requirements of each of the user requirements the feasibility of on-board processing is determined for each user. A tradeoff analysis is performed to determine the sensitivity of results to each of the system parameters. Significant results and conclusions are discussed, and recommendations are presented.

Bodenheimer, R. E.↗

Offset compensation for A/D converters

Analog-to-digital (A/D) converter eliminates dc offset in final digitized signal as well as in analog input by using digital feedback for compensation. Circuit could prove useful in data processing applications in which analog-format data are entered at high rates, as in point-of-sale data input systems.

Brokl, S. S.↗

A catalog of jovian decameter-wave radio observations from 1957 - 1978

Data from over 200,000 hours of observation of Jupiter radio emission in the decameter-wavelength band, were collected from 13 observing sites and are available on magnetic tape. Observations were made at 14 fixed frequencies from 5 to 30 MHz. The characteristics of the tape recording technique and the data format are described. The combination of overlapping data from observing sites scattered world-wide lessens the effect of the earth's daily interruption of the ground-received signal. A power spectral analysis of the data shows no evidence of periodicities within the data other than the well-known influences of Jupiter, Io, and the earth. The dependence of the occurrence probability of emission on System 3 longitude and the phase of Io varies smoothly with frequency down to 15 MHz and then appears quite different at 10 MHz. The morphology of the radio sources is both complex and stable for periods of at least months and probably much longer.

Thieman, J. R.↗

Feasibility of modifying the high resolution infrared radiation sounder (HIRS/2) for measuring spectral components of Earth radiation budget

The concept of adding four spectral channels to the 20 channel HIRS/2 instrument for the purpose of determining the origin and profile of radiant existence from the Earth's atmosphere is considered. Methods of addition of three channels at 0.5, 1.0 and 1.6 micron m to the present 0.7 micron m visible channel and an 18-25 micron m channel to the present 19 channels spaced from 3.7 micron m to 15 micron m are addressed. Optical components and physical positions were found that permit inclusion of these added channels with negligible effect on the performance of the present 20 channels. Data format changes permit inclusion of the ERB data in the 288 bits allocated to HIRS for each scan element. A lamp and collimating optic assembly may replace one of the on board radiometric black bodies to provide a reference source for the albedo channels. Some increase in instrument dimensions, weight and power will be required to accommodate the modifications.

Koenig, E. W.↗

Trends in Planetary Data Analysis. Executive summary of the Planetary Data Workshop

Planetary data include non-imaging remote sensing data, which includes spectrometric, radiometric, and polarimetric remote sensing observations. Also included are in-situ, radio/radar data, and Earth based observation. Also discussed is development of a planetary data system. A catalog to identify observations will be the initial entry point for all levels of users into the data system. There are seven distinct data support services: encyclopedia, data index, data inventory, browse, search, sample, and acquire. Data systems for planetary science users must provide access to data, process, store, and display data. Two standards will be incorporated into the planetary data system: Standard communications protocol and Standard format data unit. The data system configuration must combine a distributed system with those of a centralized system. Fiscal constraints have made prioritization important. Activities include saving previous mission data, planning/cost analysis, and publishing of proceedings.

Evans, N.↗

A 0.15-scale study of configuration effects on the aerodynamic interaction between main rotor and fuselage

Hover and forward flight tests were conducted to investigate the mutual aerodynamic interaction between the main motor and fuselage of a conventional helicopter configuration. A 0.15-scale Model 222 two-bladed teetering rotor was combined with a 0.15-scale model of the NASA Ames 40x80-foot wind tunnel 1500 horsepower test stand fairing. Configuration effects were studied by modifying the fairing to simulate a typical helicopter forebody. Separation distance between rotor and body were also investigated. Rotor and fuselage force and moment as well as pressure data are presented in graphical and tabular format. Data was taken over a range of thrust coefficients from 0.002 to 0.007. In forward flight speed ratio was varied from 0.1 to 0.3 with shaft angle varying from +4 to -12 deg. The data show that the rotors effect on the fuselage may be considerably more important to total aircraft performance than the effect of the fuselage on the rotor.

Trept, Ted↗

A software package for the data-independent management of multidimensional data

The Common Data Format (CDF), a structure which provides true data independence for applications software and has been developed at the National Space Science Data Center, is discussed. The background to the CDF is reviewed, and the CDF is described. The conceptual organization of the CDF is discussed, and a sample CDF structure is shown and described. The implementation of CDF, its status, and its applications are examined.

Treinish, Lloyd A.↗

Issues Involved in the Development of an Open Standard for Data Link of Aviation Weather Information

This paper describes how an effective and efficient data link system for the dissemination of aviation weather information could be constructed. The system is built upon existing 'open standard' foundations drawn from current aviation and computer technologies. Issues of communications protocols and application data formats are discussed. The proposed aviation weather data link system is dependent of the actual link mechanism selected.

Grappel, R. D.↗

Online Visualization and Value Added Services of MERRA-2 Data at GES DISC

NASA climate reanalysis datasets from MERRA-2, distributed at the Goddard Earth Sciences Data and Information Services Center (GES DISC), have been used in broad research areas, such as climate variations, extreme weather, agriculture, renewable energy, and air quality, etc. The datasets contain numerous variables for atmosphere, land, and ocean, grouped into 95 products. The total archived volume is approximately 337 TB ( approximately 562K files) at the end of October 2017. Due to the large number of products and files, and large data volumes, it may be a challenge for a user to find and download the data of interest. The support team at GES DISC, working closely with the MERRA-2 science team, has created and is continuing to work on value added data services to best meet the needs of a broad user community. This presentation, using aerosol over Asia Monsoon as an example, provides an overview of the MERRA-2 data services at GES DISC, including: How to find the data? How many data access methods are provided? What are the best data access methods for me? How do download the subsetted (parameter, spatial, temporal) data and save in preferred spatial resolution and data format? How to visualize and explore the data online? In addition, we introduce a future online analytic tool designed for supporting application research, focusing on long-term hourly time-series data access and analysis.

Shen, Suhung↗

Design for Manufacturing of Structures with Automated Fiber Placement via Integration of Analysis and Process Planning

Under the Design for Manufacturing (DFM) task in the NASA HiCAM program, significant process has been made towards establishing a fully automated optimization process that spans the structural analysis, design, and manufacturing process planning for Automated Fiber Placement (AFP) structures. Previous efforts in this area established the data formats and mapping processes needed to exchange data between disciplines. The software tools used in the framework are HyperX (structural optimization), CAPP (process planning), and VCP (AFP path generation). The work has culminated with automation of data exchanges and an optimization process that drives the three software toward convergence. Within this framework, HyperX is used to generate mass-optimum composite designs which are iterated with VCP and CAPP to improve manufacturability of the designs. As the ply manufacturing process is adjusted by CAPP and VCP, HyperX continually re-assesses the structural integrity of the part and makes adjustments to the laminate as needed. For example, the position of fiber steering and tow overlaps/gaps can necessitate changes to the laminate design. Once the design converges, the end result is a stack of plies that meets both structural and manufacturing requirements. This paper presents the details of the framework and demonstrations the automated process on several parts with significant double-curvature.

HiCAM↗

A Ceph S3 Object Data Store for HEP

We present a novel data format design that obviates the need for data tiers by storing individual event data products in column objects. The objects are stored and retrieved through Ceph S3 technology, with a layout designed to minimize metadata volume and maximize data processing parallelism. Performance benchmarks of data storage and retrieval are presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Efficient Parallelization of Irregular Applications on GPU Architectures

With the enlarging computation capacity of general Graphics Processing Units (GPUs), leveraging GPUs to accelerate parallel applications has become a critical topic in academia and industry. However, a wide range of irregular applications with the computation-/memory-intensive nature cannot easily achieve high GPU utilization. The challenges mainly involve the following aspects: first, data dependence leads to coarse-grained kernel and inefficient parallelism; second, heavy GPU memory usage may cause frequent memory evictions and extra overhead of I/O; third, specific computation patterns produce memory redundancies; last, workload balance and data reusability conjunctly benefit the overall performance, but there may exist a dynamic trade-off between them. Targeting these challenges, this dissertation proposes multiple optimizations to accelerate two real-world applications: many-body correlation functions to simulate nuclear physics in a large-scale scientific system; the other is the eALS-based matrix factorization recommendation system. To accelerate the calculations of many-body correlation functions, this dissertation presents three frameworks in GPU memory management and multi-GPU scheduling. Firstly, an optimized systematic GPU memory management framework, MemHC, utilizes a series of new memory reduction designs in GPU memory allocation, CPU/GPU communications, and GPU memory oversubscription. Secondly, an enhanced multi-GPU scheduling framework, MICCO, particularly by taking both data dimension (e.g., data reuse and data eviction) and computation dimension into account. MICCO designs a heuristic scheduling algorithm and a machine learning-based regression model to generate the optimal settings of a proposed new concept to manage the trade-off. Thirdly, a locality-aware multi-GPU scheduling framework. This scheduler leverages pipeline batch generation with a looking-ahead strategy by building local dependency graphs for memory transfer reduction and better data reuse, achieving up to 79.92% memory cost reduction and 1.67x speedup. To parallelize the eALS-based recommendation system, this dissertation proposes an efficient CPU/GPU heterogeneous recommendation system, HEALS. HEALS employs newly designed architecture-adaptive data formats to achieve load balance and good data locality on CPU and GPU. To mitigate the data dependence, HEALS presents a CPU/GPU collaboration model for both task parallelism and data parallelism with multiple kernel computation optimizations. In summary, this dissertation efficiently accelerates two typical irregular applications on GPUs by building four frameworks, including CPU/GPU collaboration, GPU memory management, and multi-GPU scheduling.

Wang, Qihan↗

An application protocol for CAD to CAD transfer of electronic information

The exchange of Computer Aided Design (CAD) information between dissimilar CAD systems is a problem. This is especially true for transferring electronics CAD information such as multi-chip module (MCM), hybrid microcircuit assembly (HMA), and printed circuit board (PCB) designs. Currently, there exists several neutral data formats for transferring electronics CAD information. These include IGES, EDIF, and DXF formats. All these formats have limitations for use in exchanging electronic data. In an attempt to overcome these limitations, the Navy's MicroCIM program implemented a project to transfer hybrid microcircuit design information between dissimilar CAD systems. The IGES (Initial Graphics Exchange Specification) format is used since it is well established within the CAD industry. The goal of the project is to have a complete transfer of microelectronic CAD information, using IGES, without any data loss. An Application Protocol (AP) is being developed to specify how hybrid microcircuit CAD information will be represented by IGES entity constructs. The AP defines which IGES data items are appropriate for describing HMA geometry, connectivity, and processing as well as HMA material characteristics.

Azu, Charles C., Jr.↗

Air Traffic Management TestBed Data Exchange Model

The Air Traffic Management (ATM) TestBed is a Platform as a Service that is being developed by the National Aeronautics and Space Administration (NASA) to help design, configure, integrate, run, and monitor air traffic simulations. The platform is designed to provide cloud services including back-end, big-data analytics tools, on-demand computing resource management, data storage, and communication middleware. The ATM TestBed reduces the time to test concepts and technologies, supports interactions among various methods such as human-in-the-loop and automation-in-the-loop simulations, and enables collaborative simulations by sharing technologies and tools in the ATM community. In order to allow easier access to simulation components, TestBed provides a messaging support layer for connectivity using a consistent set of input/output interfaces. In addition, a standard data format is introduced to facilitate communication between the components. The data exchange model, supported in the messaging support layer, standardizes the format of the information to be exchanged among the components. This document describes the messaging data model currently developed in TestBed and provides data dictionaries for references to component developers as well as simulation engineers.

air traffic simulation↗

BOREAS Forest Cover Data Layers of the NSA in Raster Format

This data set was processed by BORIS staff from the original vector data of species, crown closure, cutting class, and site classification/subtype into raster files. The original polygon data were received from Linnet Graphics, the distributor of data for MNR. In the case of the species layer, the percentages of species composition were removed. This reduced the amount of information contained in the species layer of the gridded product, but it was necessary in order to make the gridded product easier to use. The original maps were produced from 1:15,840-scale aerial photography collected in 1988 over an area of the BOREAS NSA MSA. The data are stored in binary, image format files and they are available from Oak Ridge National Laboratory. The data files are available on a CD-ROM (see document number 20010000884).

Hall, Forrest G.↗

Data Democratization: Challenges and Opportunities

Democratizing Earth data is one of the challenges many organizations around the world face in order to maximize the use of their Earth data for research, applications, education, and societal benefits. For example, at the NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), over 1600 global and regional datasets in several NASA Earth science focus areas, including atmospheric composition, water and energy cycles, and climate variability, are archived and distributed to the public. Giovanni, the Geospatial Interactive Online Visualization and Analysis Infrastructure, was developed by GES DISC to facilitate data access and exploration, especially for novice users of Earth science. With Giovanni, users can analyze and visualize over 2000 Earth science variables (e.g., precipitation, aerosol, surface wind) without downloading data, software, the expert understanding of data formats and structures, and coding skills, lowering the barrier to data analysis/comparison by preprocessing and accessing to the data. Results of data analysis and visualization can be accessed in several popular formats (e.g., NetCDF, CSV). As a result of Giovanni's efforts, more than 3000 referral papers have been published in various fields. In spite of this, Giovanni is still difficult to use for some users. For instance, if one searches for "precipitation," it will return over 150 related variables. The question is, which one to use? Furthermore, variables from different data providers (e.g., satellites and models) are named differently with different units, further confusing users, especially those outside the communities. Data democratization is complex and multifaceted. Challenges include service and data discovery, user experiences, visualization, data quality, trustworthiness, and more. In this presentation, we will examine Giovanni as an example of challenges and opportunities in developing data democratization services.

data democratization↗

SAMICS: Input data preparation

The Solar Array Manufacturing Industry Costing Standards (SAMICS) provide standard formats, data, assumptions, and procedures for estimating the price that a manufacturer would have to charge for the product of a specified manufacturing process sequence. A line-by-line explanation is given of those standard formats which describe the economically important characteristics of the manufacturing processes and the technological structure of the companies and the industry. This revision provides an updated presentation of Format A Process Description, consistent with the October 1978 version of that form. A checklist of items which should be entered on Format A as direct expenses is included.

Chamberlain, R. G.↗