Search NASA⌕ Search

SEARCH · Search NASA

Results for “storing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗
NASA NTRS1995

Measurements of store forces and moments and cavity pressures for a generic store in and near a box cavity at subsonic and transonic speeds

An experimental force and moment study was conducted in the Langley 8-Foot Transonic Pressure Tunnel for a generic store in and near rectangular box cavities contained in a flat-plate configuration at subsonic and transonic speeds. Surface pressures were measured inside the cavities and on the flat plate. The length-to-height ratios were 5.42, 6.25, 10.83, and 12.50. The corresponding width-to-height ratios were 2.00, 2.00, 4.00, and 4.00. The free-stream Mach number range was from 0.20 to 0.95. Surface pressure measurements inside the cavities indicated that the flow fields for the shallow cavities were either closed or transitional near the transitional/closed boundary. For the deep cavities, the flow fields were either open or near the open/transitional boundary. The presence of the store did not change the type of flow field and had only small effects on the pressure distributions. For transitional or open transitional flow fields, increasing the free-stream Mach number resulted in large reductions in pitching-moment coefficient. Values of pitching-moment coefficient were always much greater for closed flow fields than for open flow fields.

Stallings, Robert L., Jr.↗