Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

More chemical detection through less sampling: amplifying chemical signals in hyperspectral data cubes through compressive sensing

Compressive sensing (CS) is a method of sampling which permits some classes of signals to be reconstructed with high accuracy even when they were sampled at sub-Nyquist rates. In this paper we explore a phenomenon in which bandwise CS sampling of a hyperspectral data cube followed by reconstruction can actually result in amplification of chemical signals contained in the cube. Perhaps most surprisingly, chemical signal amplification generally seems to increase as the level of sampling decreases. In some examples, the chemical signal is significantly stronger in a data cube reconstructed from 10% CS sampling than it is in the raw, 100% sampled data cube. We explore this phenomenon in two real-world datasets including the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset and the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset. Each of these datasets contains the release of a chemical simulant, such as glacial acetic acid, triethyl phospate, and sulfur hexafluoride, and in all cases we use the adaptive coherence estimator (ACE) to detect a target signal in the hyperspectral data cube. We end the paper by suggesting some theoretical justifications for why chemical signals would be amplified in CS sampled and reconstructed hyperspectral data cubes and discuss some practical implications.

Hyperspectral imagery, Compressive Sensing, single↗

Black-box statistical prediction of lossy compression ratios for scientific data

Lossy compressors are increasingly adopted in scientific research, tackling volumes of data from experiments or parallel numerical simulations and facilitating data storage and movement. In contrast with the notion of entropy in lossless compression, no theoretical or data-based quantification of lossy compressibility exists for scientific data. Users rely on trial and error to assess lossy compression performance. As a strong data-driven effort toward quantifying lossy compressibility of scientific datasets, we provide a statistical framework to predict compression ratios of lossy compressors. Our method is a two-step framework where (i) compressor-agnostic predictors are computed and (ii) statistical prediction models relying on these predictors are trained on observed compression ratios. Proposed predictors exploit spatial correlations and notions of entropy and lossyness via the quantized entropy. We study 8+ compressors on 6 scientific datasets and achieve a median percentage prediction error less than 12%, which is substantially smaller than that of other methods while achieving at least a 8.8× speedup for searching for a specific compression ratio and 7.8× speedup for determining the best compressor out of a collection.

97 MATHEMATICS AND COMPUTING↗

Digital Map Rendering Method

The invention is a system and method of compressing terrain data to be used to render a three-dimensional map representation of the terrain data. In general, the invention operates by first selecting the boundaries of the terrain data and to be compressed and dividing the terrain data into regular geometric areas. Next, a type of free-edged, planar geometric surface is defined which is used to approximate the terrain data for each regular geometric area. The approximations are checked to determine if they fall within user selected tolerances. If the approximation for a specific regular geometric area is within the user specified tolerances, the data is saved for that specific regular geometric area. If the approximation for a specific regular geometric area falls outside the user specified tolerances, the regular geometric area is divided and a free-edged, planar geometric surface approximation is made for each of the divided areas. This process is recursively repeated until all of the regular geometric areas are approximated by free-edged, planar surfaces. Finally, the compressed terrain data is used to render a three-dimensional map.

Skoog, Mark↗

Simultaneous compression and opacity data from time-series radiography with a Lagrangian marker

Time-resolved radiography can be used to obtain absolute shock Hugoniot states by simultaneously measuring at least two mechanical parameters of the shock, and this technique is particularly suitable for one-dimensional converging shocks where a single experiment probes a range of pressures as the converging shock strengthens. However, at sufficiently high pressures, the shocked material becomes hot enough that the x-ray opacity falls significantly. Additionally, if the system includes a Lagrangian marker such that the mass within the marker is known, this additional information can be used to constrain the opacity as well as the Hugoniot state. In the limit that the opacity changes only on shock heating, and not significantly on subsequent isentropic compression, the opacity of the shocked material can be determined uniquely. More generally, it is necessary to assume the form of the variation of opacity with isentropic compression or to introduce multiple marker layers. Alternatively, assuming either the equation of state or the opacity, the presence of a marker layer in such experiments enables the non-assumed property to be deduced more accurately than from the radiographic density reconstruction alone. An example analysis is shown for measurements of a converging shock wave in polystyrene at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Use cases of lossy compression for floating-point data in scientific data sets

Architectural and technological trends of systems used for scientific computing call for a significant reduction of scientific data sets that are composed mainly of floating-point data. Here, this article surveys and presents experimental results of currently identified use cases of generic lossy compression to address the different limitations of scientific computing systems. The article shows from a collection of experiments run on parallel systems of a leadership facility that lossy data compression not only can reduce the footprint of scientific data sets on storage but also can reduce I/O and checkpoint/restart times, accelerate computation, and even allow significantly larger problems to be run than without lossy compression. In conclusion, these results suggest that lossy compression will become an important technology in many aspects of high performance scientific computing. Because the constraints for each use case are different and often conflicting, this collection of results also indicates the need for more specialization of the compression pipelines.

97 MATHEMATICS AND COMPUTING↗

Navier-Stokes analysis and experimental data comparison of compressible flow within ducts

Many aircraft employ ducts with centerline curvature or changing cross-sectional shape to join the engine with inlet and exhaust components. S-ducts convey air to the engine compressor from the intake and often decelerate the flow to achieve an acceptable Mach number at the engine compressor by increasing the cross-sectional area downstream. Circular-to-rectangular transition ducts are used on aircraft with rectangular exhaust nozzles to connect the engine and nozzle. To achieve maximum engine performance, the ducts should minimize flow total pressure loss and total pressure distortion at the duct exit. Changes in the curvature of the duct centerline or the duct cross-sectional shape give rise to streamline curvature which causes cross stream pressure gradients. Secondary flows can be caused by deflection of the transverse vorticity component of the boundary layer. This vortex tilting results in counter-rotating vortices. Additionally, the adverse streamwise pressure gradient caused by increasing cross-sectional area can lead to flow separation. Vortex pairs have been observed in the exit planes of both duct types. These vortices are due to secondary flows induced by pressure gradients resulting from streamline curvature. Regions of low total pressure are produced when the vortices convect boundary layer fluid into the main flow. The purpose of the present study is to predict the measured flow field in a diffusing S-duct and a circular-to-rectangular transition duct with a full Navier-Stokes computer program, PARC3D, and to compare the numerical predictions with new detailed experimental measurements. The work was undertaken to extend previous studies and to provide additional CFD validation data needed to help model flows with strong secondary flow and boundary layer separation. The S-duct computation extends the study of Smith et al, and Harloff et al, which concluded that the computation might be improved by using a finer grid and more advanced turbulence models. The present study compares results for both the Baldwin-Lomas and k-epsilon turbulence models and is conducted with a refined grid. For the transition duct, two inlet conditions were considered, the first with straight flow and the second with swirling flow. The first case permits examination of the effects of the geometric transition on the flow field, while the second case includes the rotational flow effect characteristic of a gas turbine engine.

Harloff, G. J.↗

Navier-Stokes analysis and experimental data comparison of compressible flow in a diffusing S-duct

Full three-dimensional Navier-Stokes computational results are compared with new experimental measurements for the flowfield within a round diffusing S-duct. The present study extends previous computational and experimental results for a similar smaller scale S-duct. Predicted results are compared with the experimental static and total pressure fields, and velocity vectors. Additionally, wall pressures, velocity profiles in wall coordinates, and skin friction values are presented. The CFD results employ algebraic and k-epsilon turbulence models. The CFD computed and experimentally determined separated flowfield is carefully examined.

Harloff, Gary J.↗

Navier-Stokes analysis and experimental data comparison of compressible flow in a diffusing S-duct

Full three-dimensional Navier-Stokes computational results are compared with new experimental measurements for the flowfield within a round diffusing S-duct. The present study extends previous computational and experimental results for a similar smaller scale S-duct. Predicted results are compared with the experimental static and total pressure fields, and velocity vectors. Additionally, wall pressures, velocity profiles in wall coordinates, and skin friction values are presented. The CFD results employ algebraic and k-epsilon turbulence models. The CFD computed and experimentally determined separated flowfield is carefully examined.

Harloff, Gary J.↗