Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Improving 3D Wavelet-Based Compression of Hyperspectral Images

Two methods of increasing the effectiveness of three-dimensional (3D) wavelet-based compression of hyperspectral images have been developed. (As used here, images signifies both images and digital data representing images.) The methods are oriented toward reducing or eliminating detrimental effects of a phenomenon, referred to as spectral ringing, that is described below. In 3D wavelet-based compression, an image is represented by a multiresolution wavelet decomposition consisting of several subbands obtained by applying wavelet transforms in the two spatial dimensions corresponding to the two spatial coordinate axes of the image plane, and by applying wavelet transforms in the spectral dimension. Spectral ringing is named after the more familiar spatial ringing (spurious spatial oscillations) that can be seen parallel to and near edges in ordinary images reconstructed from compressed data. These ringing phenomena are attributable to effects of quantization. In hyperspectral data, the individual spectral bands play the role of edges, causing spurious oscillations to occur in the spectral dimension. In the absence of such corrective measures as the present two methods, spectral ringing can manifest itself as systematic biases in some reconstructed spectral bands and can reduce the effectiveness of compression of spatially-low-pass subbands. One of the two methods is denoted mean subtraction. The basic idea of this method is to subtract mean values from spatial planes of spatially low-pass subbands prior to encoding, because (a) such spatial planes often have mean values that are far from zero and (b) zero-mean data are better suited for compression by methods that are effective for subbands of two-dimensional (2D) images. In this method, after the 3D wavelet decomposition is performed, mean values are computed for and subtracted from each spatial plane of each spatially-low-pass subband. The resulting data are converted to sign-magnitude form and compressed in a manner similar to that of a baseline hyperspectral- image-compression method. The mean values are encoded in the compressed bit stream and added back to the data at the appropriate decompression step. The overhead incurred by encoding the mean values only a few bits per spectral band is negligible with respect to the huge size of a typical hyperspectral data set. The other method is denoted modified decomposition. This method is so named because it involves a modified version of a commonly used multiresolution wavelet decomposition, known in the art as the 3D Mallat decomposition, in which (a) the first of multiple stages of a 3D wavelet transform is applied to the entire dataset and (b) subsequent stages are applied only to the horizontally-, vertically-, and spectrally-low-pass subband from the preceding stage. In the modified decomposition, in stages after the first, not only is the spatially-low-pass, spectrally-low-pass subband further decomposed, but also spatially-low-pass, spectrally-high-pass subbands are further decomposed spatially. Either method can be used alone to improve the quality of a reconstructed image (see figure). Alternatively, the two methods can be combined by first performing modified decomposition, then subtracting the mean values from spatial planes of spatially-low-pass subbands.

Klimesh, Matthew↗

Efficient and Flexible Hierarchical Data Layouts for a Unified Encoding of Scalar Field Precision and Resolution

To address the problem of ever-growing scientific data sizes making data movement a major hindrance to analysis, we introduce a novel encoding for scalar fields: a unified tree of resolution and precision, specifically constructed so that valid cuts correspond to sensible approximations of the original field in the precision-resolution space. Furthermore, we introduce a highly flexible encoding of such trees that forms a parameterized family of data hierarchies. We discuss how different parameter choices lead to different trade-offs in practice, and show how specific choices result in known data representation schemes such as zfp[52], idx[58], and jpeg2000 [76]. Lastly, we provide system-level details and empirical evidence on how such hierarchies facilitate common approximate queries with minimal data movement and time, using real-world data sets ranging from a few gigabytes to nearly a terabyte in size. Experiments suggest that our new strategy of combining reductions in resolution and precision is competitive with state-of-the-art compression techniques with respect to data quality, while being significantly more flexible and orders of magnitude faster, and requiring significantly reduced resources.

97 MATHEMATICS AND COMPUTING↗

An object-oriented, technology-adaptive information model

The primary objective was to develop a computer information system for effectively presenting NASA's technologies to American industries, for appropriate commercialization. To this end a comprehensive information management model, applicable to a wide variety of situations, and immune to computer software/hardware technological gyrations, was developed. The model consists of four main elements: a DATA_STORE, a data PRODUCER/UPDATER_CLIENT and a data PRESENTATION_CLIENT, anchored to a central object-oriented SERVER engine. This server engine facilitates exchanges among the other model elements and safeguards the integrity of the DATA_STORE element. It is designed to support new technologies, as they become available, such as Object Linking and Embedding (OLE), on-demand audio-video data streaming with compression (such as is required for video conferencing), Worldwide Web (WWW) and other information services and browsing, fax-back data requests, presentation of information on CD-ROM, and regular in-house database management, regardless of the data model in place. The four components of this information model interact through a system of intelligent message agents which are customized to specific information exchange needs. This model is at the leading edge of modern information management models. It is independent of technological changes and can be implemented in a variety of ways to meet the specific needs of any communications situation. This summer a partial implementation of the model has been achieved. The structure of the DATA_STORE has been fully specified and successfully tested using Microsoft's FoxPro 2.6 database management system. Data PRODUCER/UPDATER and PRESENTATION architectures have been developed and also successfully implemented in FoxPro; and work has started on a full implementation of the SERVER engine. The model has also been successfully applied to a CD-ROM presentation of NASA's technologies in support of Langley Research Center's TAG efforts.

Anyiwo, Joshua C.↗

DNTTD (Distributed Non-Negative Tensor Train Decomposition)

The era of exascale computing opens new venues for innovations and discoveries in many scientific, engineering, and commercial fields. However, with the exa flops also come the extra-large high-dimensional data generated by high performance computing. High-dimensional data is presented as multidimensional arrays, aka tensors. The presence of latent (not directly observable) structures in the tensor allows a unique representation and compression of the data by classical tensor factorization techniques. However, the classical tensor methods are not always stable or they can be exponential in their memory requirements, which makes them not suitable for high-dimensional tensors. Tensor train (TT) is a state-of-the-art tensor network introduced for factorization of high-dimensional tensors. TT transforms the initial high-dimensional tensor in a network of three-dimensional tensors that requires only a linear storage. Many real-world data, such as, density, temperature, population, probability, etc., are non-negative and for an easy interpretation, the algorithms preserving non-negativity are preferred. Here, we introduce a distributed non-negative tensor-train and demonstrate its scalability and the compression on synthetic and real world big datasets.

Bhattarai, Manish↗

A compact x-ray diffraction system for dynamic compression experiments on pulsed-power generators

Pulsed-power generators can produce well-controlled continuous ramp compression of condensed matter for high-pressure equation-of-state studies using the magnetic loading technique. X-ray diffraction (XRD) data from dynamically compressed samples provide direct measurements of the elastic compression of the crystal lattice, onset of plastic flow, strength–strain rate dependence, structural phase transitions, and density of crystal defects, such as dislocations. Here, we present a cost-effective, compact, pulsed x-ray source for XRD measurements on pulsed-power-driven ramp-loaded samples. This combination of magnetically driven ramp compression of materials with a single, short-pulse XRD diagnostic will be a powerful capability for the dynamic materials’ community to investigate in situ dynamic phase transitions critical to equation of states. Finally, we present results using this new diagnostic to evaluate lattice compression in Zr and Al and to capture signatures of phase transitions in CdS.

47 OTHER INSTRUMENTATION↗

Efficient DNA sequence compression with neural networks

Abstract Background The increasing production of genomic data has led to an intensified need for models that can cope efficiently with the lossless compression of DNA sequences. Important applications include long-term storage and compression-based data analysis. In the literature, only a few recent articles propose the use of neural networks for DNA sequence compression. However, they fall short when compared with specific DNA compression tools, such as GeCo2. This limitation is due to the absence of models specifically designed for DNA sequences. In this work, we combine the power of neural networks with specific DNA models. For this purpose, we created GeCo3, a new genomic sequence compressor that uses neural networks for mixing multiple context and substitution-tolerant context models. Findings We benchmark GeCo3 as a reference-free DNA compressor in 5 datasets, including a balanced and comprehensive dataset of DNA sequences, the Y-chromosome and human mitogenome, 2 compilations of archaeal and virus genomes, 4 whole genomes, and 2 collections of FASTQ data of a human virome and ancient DNA. GeCo3 achieves a solid improvement in compression over the previous version (GeCo2) of $2.4\%$, $7.1\%$, $6.1\%$, $5.8\%$, and $6.0\%$, respectively. To test its performance as a reference-based DNA compressor, we benchmark GeCo3 in 4 datasets constituted by the pairwise compression of the chromosomes of the genomes of several primates. GeCo3 improves the compression in $12.4\%$, $11.7\%$, $10.8\%$, and $10.1\%$ over the state of the art. The cost of this compression improvement is some additional computational time (1.7–3 times slower than GeCo2). The RAM use is constant, and the tool scales efficiently, independently of the sequence size. Overall, these values outperform the state of the art. Conclusions GeCo3 is a genomic sequence compressor with a neural network mixing approach that provides additional gains over top specific genomic compressors. The proposed mixing method is portable, requiring only the probabilities of the models as inputs, providing easy adaptation to other data compressors or compression-based data analysis tools. GeCo3 is released under GPLv3 and is available for free download at https://github.com/cobilab/geco3.

Silva, Milton↗

Sound speed and Grüneisen parameter up to three terapascal in shock-compressed iron

This paper presents the first sound speed and Grüneisen parameter data for fluid iron compressed to 3 TPa (30 million atmospheres) and 20 g/cm 3 on the Hugoniot. Both the sound speed and Grüneisen parameter are derivatives of the equation of state (EOS), and thus tightly constrain the contours of the EOS surface. The sound speed data are systematically lower than expected from a simple extrapolation of previous data. The Grüneisen parameter shows a 30% drop at pressures and temperatures above the melt transition. Furthermore, while some models compare well with either the sound speed or Grüneisen parameter, none of today’s state-of-the-art models can explain both sets of data. Furthermore these new data will provide pivotal benchmarks for both future theoretical EOSs of warm dense iron and modeling planetary states and processes.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Fixture For Compression-After-Impact Tests Of Thin Specimens

Special fixture holds specimen of laminated composite material in 20-klb (89-kN) or larger load frame for compression-after-impact test. In preparation for test, specimen damaged by dropping weight on it at known kinetic energy. During test, specimen loaded in compression, and load measured, until specimen fails. Measurement data used to characterize compressive strength of specimen after impact important indicator of ability of structural components made of composite material to tolerate damage. Tests give more-realistic measures of tolerance to damage.

Nettles, Alan T.↗

Manufacturing and Mechanical Testing of TC1225/LM-PAEK and TC1200/PEEK Thermoplastic Composite Panels

Development of thermoplastic composites (TPCs) for aerospace structures is experiencing renewed enthusiasm attributed to the availability of rapid manufacturing technology, ease of joining through fusion welding processes, and the successful utilization of the material in flight critical structures. Semicrystalline thermoplastics such as polyether ether ketone (PEEK), polyether ketone ketone (PEKK), and polyphenylene sulfide (PPS) have been successfully demonstrated as thermoplastic skins, keel beams, and angle brackets for commercial aircraft. Composite specimens were fabricated from the Toray TC1225 and TC1200 unidirectional prepreg systems and tested to gain confidence with NASA in-house TPC processing as part of the Thermoplastics Development for Exploration Application (TDEA) project. TC1225 is a relatively new material system that uses T700GC fibers and low-melt polyaryl ether ketone (LM-PAEK) resin. TC1200 is the latest version of a material system that has been available for several decades with AS4 fibers and PEEK resin. Results for ultrasonic inspection, optical microscopy, acid digestion, and differential scanning calorimetry establish the quality of the panels. Mechanical test data for unnotched and notched laminate tension and compression as well as compression after impact provide data for equivalency assessment and support material selection in TDEA. Satisfactory equivalence of the TC1225 results and the National Center for Advanced Materials Performance (NCAMP) database was found. The results indicate high-quality manufacturing was achieved, and the resulting mechanical test data are in agreement with that in the literature.

Thermoplastic Composites↗

Simulations of biomass compression-screw feeding using a compressible non-Newtonian constitutive model

There is global interest in the conversion of biomass into sustainable low-carbon-footprint fuels and chemicals as an alternative to non-renewable fossil feedstocks. Feeding biomass solids into pressurized reactors is one of the key steps in biomass conversion. Predicting mechanical failure and energy requirements for this step helps avoid upstream processing bottlenecks and enables efficient operation of a biorefinery. Here, in this work, we developed a predictive computational model for biomass screw feeders that capture the highly viscous, non-Newtonian and compressible behavior of biomass slurries. Biomass compressible behavior is formulated by an equation of state and the non-Newtonian rheology is represented by a density-dependent viscosity model. Experimental data from two compression screw-feeder systems are presented as a validation for our model. Our model successfully predicted the location of the compressed biomass “plug”, biomass flow rate, and the required torque at different operating conditions for the experimental conditions studied in this work.

09 BIOMASS FUELS↗

The Effect of Pressure on Halogen Bonding in 4-Iodobenzonitrile

The crystal structure of 4-iodobenzonitrile, which is monoclinic (space group I2/a) under ambient conditions, contains chains of molecules linked through C≡N···I halogen-bonds. The chains interact through CH···I, CH···N and π-stacking contacts. The crystal structure remains in the same phase up to 5.0 GPa, the b axis compressing by 3.3%, and the a and c axes by 12.3 and 10.9 %. Since the chains are exactly aligned with the crystallographic b axis these data characterise the compressibility of the I···N interaction relative to the inter-chain interactions, and indicate that the halogen bond is the most robust intermolecular interaction in the structure, shortening from 3.168(4) at ambient pressure to 2.840(1) Å at 5.0 GPa. The π∙∙∙π contacts are most sensitive to pressure, and in one case the perpendicular stacking distance shortens from 3.6420(8) to 3.139(4) Å. Packing energy calculations (PIXEL) indicate that the π∙∙∙π interactions have been distorted into a destabilising region of their potentials at 5.0 GPa. The structure undergoes a transition to a triclinic ( P 1 ¯ ) phase at 5.5 GPa. Over the course of the transition, the initially colourless and transparent crystal darkens on account of formation of microscopic cracks. The resistance drops by 10% and the optical transmittance drops by almost two orders of magnitude. The I···N bond increases in length to 2.928(10) Å and become less linear [

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Nonadiabatic and three-dimensional effects in compressible turbulent boundary layers

A defect stream function formulation for nonadiabatic flow with small crossflow is developed. The first-integral property of this formulation provides for two removal of the streamline curvature term in the governing equation so that the form of the reduced equation for small crossflow is the same as that for two dimensional flow. The combined law of the wall and wake is used in place of the no-slip boundary condition. The tangential velocity equation for law-of-the-wall flow is shown to be the same for three-dimensions as for two when the Boussinesq approximation applies, and a closed form solution for the crossflow angle in the inner region is obtained. Analytic solutions for nonadiabatic, compressible, equilibrium flow with a Clauser outer-region eddy-viscosity model are obtained, and excellent agreement with experimental skin friction and velocity profile data for nonadiabatic, compressible flat-plate flow is achieved. An analytic solution for a linear inner-region eddy-viscosity model is also obtained; the wake function part of this solution is found to be inconsistent with the empirically established law of the wake.

Barnwell, Richard W.↗

Miniaturized Airborne Imaging Central Server System

In recent years, some remote-sensing applications require advanced airborne multi-sensor systems to provide high performance reflective and emissive spectral imaging measurement rapidly over large areas. The key or unique problem of characteristics is associated with a black box back-end system that operates a suite of cutting-edge imaging sensors to collect simultaneously the high throughput reflective and emissive spectral imaging data with precision georeference. This back-end system needs to be portable, easy-to-use, and reliable with advanced onboard processing. The innovation of the black box backend is a miniaturized airborne imaging central server system (MAICSS). MAICSS integrates a complex embedded system of systems with dedicated power and signal electronic circuits inside to serve a suite of configurable cutting-edge electro- optical (EO), long-wave infrared (LWIR), and medium-wave infrared (MWIR) cameras, a hyperspectral imaging scanner, and a GPS and inertial measurement unit (IMU) for atmospheric and surface remote sensing. Its compatible sensor packages include NASA s 1,024 1,024 pixel LWIR quantum well infrared photodetector (QWIP) imager; a 60.5 megapixel BuckEye EO camera; and a fast (e.g. 200+ scanlines/s) and wide swath-width (e.g., 1,920+ pixels) CCD/InGaAs imager-based visible/near infrared reflectance (VNIR) and shortwave infrared (SWIR) imaging spectrometer. MAICSS records continuous precision georeferenced and time-tagged multisensor throughputs to mass storage devices at a high aggregate rate, typically 60 MB/s for its LWIR/EO payload. MAICSS is a complete stand-alone imaging server instrument with an easy-to-use software package for either autonomous data collection or interactive airborne operation. Advanced multisensor data acquisition and onboard processing software features have been implemented for MAICSS. With the onboard processing for real time image development, correction, histogram-equalization, compression, georeference, and data organization, fast aerial imaging applications, including the real time LWIR image mosaic for Google Earth, have been realized for NASA fs LWIR QWIP instrument. MAICSS is a significant improvement and miniaturization of current multisensor technologies. Structurally, it has a complete modular and solid-state design. Without rotating hard drives and other moving parts, it is operational at high altitudes and survivable in high-vibration environments. It is assembled from a suite of miniaturized, precision-machined, standardized, and stackable interchangeable embedded instrument modules. These stackable modules can be bolted together with the interconnection wires inside for the maximal simplicity and portability. Multiple modules are electronically interconnected as stacked. Alternatively, these dedicated modules can be flexibly distributed to fit the space constraints of a flying vehicle. As a flexibly configurable system, MAICSS can be tailored to interface a variety of multisensor packages. For example, with a 1,024x1,024 pixel LWIR and a 8,984x6,732 pixel EO payload, the complete MAICSS volume is approximately 7x9x11 in. (=18x23x28 cm), with a weight of 25 lb (=11.4 kg).

Sun, Xiuhong↗

Ultrafast processing of pixel detector data with machine learning frameworks

Modern photon science performed at high repetition rate free-electron laser (FEL) facilities and beyond relies on 2D pixel detectors operating at increasing frequencies (towards 100 kHz at LCLS-II) and producing rapidly increasing amounts of data (towards TB/s). This data must be rapidly stored for offline analysis and summarized in real time for online feedback to the scientists. While at LCLS all raw data has been stored, at LCLS-II this would lead to a prohibitive cost; instead, enabling real time processing of pixel detector data (dark, gain, common mode, background, charge summing, subpixel position, photon counting, data summarization) allows reducing the size and cost of online processing, offline processing and storage by orders of magnitude while preserving full photon information. This could be achieved by taking advantage of the compressibility of sparse data typical for LCLS-II applications. Faced with a similar big data challenge a decade ago, computer vision stimulated revolutionary advances in machine learning hardware and software. We investigated if these developments are useful in the field of data processing for high speed pixel detectors and found that typical deep learning models and autoencoder architectures failed to yield useful noise reduction while preserving full photon information, presumably because of the very different statistics and feature sets in computer vision and radiation imaging. However, the raw performance of modern frameworks like Tensorflow inspired us to redesign in Tensorflow mathematically equivalent versions of the state-of-the-art, “classical” algorithms used at LCLS. The novel Tensorflow models resulted in elegant, compact and hardware agnostic code, gaining 1 to 2 orders of magnitude faster processing on an inexpensive consumer GPU, reducing by 3 orders of magnitude the projected cost of online analysis and compression without photon loss at LCLS-II. The novel Tensorflow models also enabled ongoing development of a pipelined hardware system expected to yield an additional 3 to 4 orders of magnitude speedup, necessary for meeting the data acquisition and storage requirements at LCLS-II, potentially enabling acquiring every single FEL pulse at full speed. Computer vision a decade ago was dominated by hand-crafted filters; their structure inspired the deep learning revolution resulting in modern deep convolutional networks; similarly, our novel Tensorflow filters provide inspiration for designing future deep learning models for ultrafast and efficient processing and classification of pixel detector images at FEL facilities.

47 OTHER INSTRUMENTATION↗

Rank-k Maximal Statistics for Divergence and Probability of Misclassification

A technique is developed for selecting from n-channel multispectral data some k combinations of the n-channels upon which to base a given classification technique so that some measure of the loss of the ability to distinguish between classes, using the compressed k-dimensional data, is minimized. Information loss in compressing the n-channel data to k channels is taken to be the difference in the average interclass divergences (or probability of misclassification) in n-space and in k-space.

Decell, H. P., Jr.↗

Effect of Part Size, Displacement Rate, and Aging on Compressive Properties of Elastomeric Parts of Different Unit Cell Topologies Formed by Vat Photopolymerization Additive Manufacturing

Due to its ability to achieve geometric complexity at high resolution and low length scales, additive manufacturing (AM) has increasingly been used for fabricating cellular structures (e.g., foams and lattices) for a variety of applications. Specifically, elastomeric cellular structures offer tunability of compliance as well as energy absorption and dissipation characteristics. However, there are limited data available on compression properties for printed elastomeric cellular structures of different designs and testing parameters. In this work, the authors evaluate how unit cell topology, part size, the rate of compression, and aging affect the compressive response of polyurethane-based simple cubic, body-centered, and gyroid structures formed by vat photopolymerization AM. Finite element simulations incorporating hyperelastic and viscoelastic models were used to describe the data, and the simulated results compared well with the experimental data. Of the designs tested, only the parts with the body-centered unit cell exhibited differences in stress–strain responses at different part sizes. Of the compression rates tested, the highest displacement rate (1000 mm/min) often caused stiffer compressive behavior, indicating deviation from the quasi-static assumption and approaching the intermediate rate response. The cellular structures did not change in compression properties across five weeks of aging time, which is desirable for cushioning applications. This work advances knowledge on the structure–property relationships of printed elastomeric cellular materials, which will enable more predictable compressive properties that can be traced to specific unit cell designs.

36 MATERIALS SCIENCE↗

Autoignition of cyclohexane at low-to-intermediate temperatures: Rapid compression machine experiments and improved comprehensive chemical kinetic model

Cycloalkanes are an important class of hydrocarbons found in conventional and alternative transportation fuels. Being one of the simplest practical cycloalkanes, cyclohexane is often used as a surrogate in studies to understand the oxidation, ignition, and sooting characteristics of cycloalkanes more broadly. Although cyclohexane has been extensively studied, very limited datasets for cyclohexane oxidation at low-to-intermediate temperatures are available in the literature. Moreover, the literature autoignition data from rapid compression machines (RCMs) did not provide information on volume histories or experimental heat transfer characteristics which can significantly impact model predictions, thereby hindering the detailed validation of chemical kinetic models. It has also been observed that the cyclohexane kinetic models developed so far are not able to predict the literature data across a wide range of operating and mixture conditions. Hence, further studies are recommended to understand and improve model predictions for cyclohexane oxidation. In this study, RCM experiments were conducted using cyclohexane/air mixtures at varying compressed pressures (P C =15, 20, and 30 bar), equivalence ratios (ϕ=0.5, 1.0, and 2.0), and compressed temperatures (T C =670–960 K). The current RCM results of cyclohexane were found to complement well with the literature data, with the first-stage IDTs at high pressures and volume histories at all test conditions being first reported for better development and validation of chemical kinetic models. Additionally, a detailed chemical kinetic model for the cyclohexane oxidation has been developed and validated using both newly acquired experimental IDTs in this study and literature experimental studies (IDTs in RCMs and STs, species profiles in jet-stirred reactors, and laminar burning velocities). Unlike literature models, the proposed model was observed to provide an overall better prediction for experimental results over a wide range of conditions. Chemical kinetic analysis of the developed model was further conducted to identify the reaction pathways controlling the autoignition of cyclohexane.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modulated Thermomechanical Analysis of Compression-Molded High-Density Polyethylene

Thermomechanical analysis (TMA) experiments conducted on high-density polyethylene (HDPE) show both reversible and irreversible dimensional changes. To further explore these reversible and irreversible processes, modulated thermomechanical analysis (MTMA) was used. Before reliable data on compression-molded HDPE was collected, a parameter optimization was performed to obtain a suitable MTMA method. Once a suitable method was obtained, several MTMA experiments were conducted on compression-molded HDPE. This work highlights the steps taken during the MTMA parameter optimization and the results obtained from MTMA experiments conducted on pristine compression-molded HDPE samples.

36 MATERIALS SCIENCE↗