SEARCH · Search NASA

Results for “Compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

DOE OSTI2023

AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications

As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences exponential growth. Adaptive Mesh Refinement (AMR) has emerged as an effective solution to address these two challenges. Concurrently, error-bounded lossy compression is recognized as one of the most efficient approaches to tackle the latter issue. Despite their respective advantages, few attempts have been made to investigate how AMR and error-bounded lossy compression can function together. To this end, this study presents a novel in-situ lossy compression framework that employs the HDF5 filter to improve both I/O costs and boost compression quality for AMR applications. We implement our solution into the AMReX framework and evaluate on two real-world AMR applications, Nyx and WarpX, on the Summit supercomputer. Experiments with 512 cores demonstrate that AMRIC improves the compression ratio by 81X and the I/O performance by 39X over AMReX's original compression solution.

Wang, Daoce↗

DOE OSTI2023

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

King, Ryan↗

DOE OSTI2022

Toward Quantity-of-Interest Preserving Lossy Compression for Scientific Data

Today's scientific simulations and instruments are producing a large amount of data, leading to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy compressors are effective in significantly reducing data volumes and efficiently developing databases for multiple scientific applications, they mainly support error controls on raw data, which leaves a significant gap between the data and user's downstream analysis. This may cause unqualified uncertainties in the outcomes of the analysis, a.k.a quantities of interest (QoIs), which are the major concerns of users in adopting lossy compression in practice. In this paper, we propose rigorous mathematical theories to preserve four families of QoIs that are widely used in scientific analysis during lossy compression along with practical implementations. Specifically, we first develop the error control theory for univariate QoIs which are essential for computing physical properties such as kinetic energy, followed by multivariate QoIs that are more commonly used in real-world applications. The proposed method is integrated into a state-of-the-art compression framework in a modular fashion, which could easily adapt to new QoIs and new compression algorithms. Experiments on real-world datasets demonstrate that the proposed method provides faithful error control on important QoIs including kinetic energy, regional average, and isosurface without trials and errors, while offering compression ratios that are up to 4x of the compression ratios provided by state-of-the-art compressors.

Jiao, Pu↗

DOE OSTI2026

Scientific Data Compression for Large Scale Computational Fluid Dynamics (CFD) Simulations

This Cooperative Research and Development Agreement (CRADA) between Oak Ridge National Laboratory (ORNL) and General Electric (GE) investigated methods for reducing the size of large computational fluid dynamics (CFD) simulation datasets using scientific data compression techniques. The work focused on adapting the MultiGrid Adaptive Reduction of Data (MGARD) compression framework and integrating it with high-performance I/O and visualization tools used in CFD workflows. MGARD uses hierarchical multilevel decomposition to enable error-controlled compression of floating-point scientific data while preserving quantities of interest. During the project, MGARD compression was integrated with the ADIOS I/O framework and visualization tools such as ParaView to enable efficient storage, transfer, and analysis of simulation data. The collaboration also explored approaches for improving compression performance for CFD data defined on unstructured meshes. Results demonstrate that scientific data compression can significantly reduce storage requirements and improve data management for large-scale CFD simulations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Small-amplitude Compressible Magnetohydrodynamic Turbulence Modulated by Collisionless Damping in Earth’s Magnetosheath: Observation Matches Theory

Plasma turbulence is a ubiquitous dynamical process that transfers energy across many spatial and temporal scales and affects energetic particle transport. Recent advances in the understanding of compressible magnetohydrodynamic (MHD) turbulence demonstrate the important role of damping in shaping energy distributions on small scales, yet its observational evidence is still lacking. This study provides the first observational evidence of substantial collisionless damping (CD) modulation on the small-amplitude compressible MHD turbulence cascade in Earth’s magnetosheath using four Cluster spacecraft. Based on an improved compressible MHD decomposition algorithm, turbulence is decomposed into three eigenmodes: incompressible Alfvén modes and compressible slow and fast (magnetosonic) modes. Our observations demonstrate that CD enhances the anisotropy of compressible MHD modes because CD has a strong dependence on wave propagation angle. The wavenumber distributions of slow modes are mainly stretched perpendicular to the background magnetic field (B 0 ) and weakly modulated by CD. In contrast, fast modes are subjected to a more significant CD modulation. Fast modes exhibit a weak, scale-independent anisotropy above the CD truncation scale. Below the CD truncation scale, the anisotropy of fast modes enhances as wavenumbers increase. As a result, fast-mode fractions in the total energy of compressible modes decrease with the increase of perpendicular wavenumber (to B 0 ) or wave propagation angle. Our findings reveal how the turbulence cascade is shaped by CD and its consequences for anisotropies in the space environment.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2015

Impact of Effective Compression Ratio on Gasoline-Diesel Dual-Fuel Combustion in a Heavy-Duty Engine Using Variable Valve Actuation

Dual-fuel combustion using port-injected gasoline with a direct diesel injection has been shown to achieve low-temperature combustion with moderate peak pressure rise rates, low engine-out soot and NOx emissions, and high indicated thermal efficiency. A key requirement for extending high-load operation is moderating the reactivity of the premixed charge prior to the diesel injection. Reducing compression ratio, in conjunction with a higher expansion ratio using alternative valve timings, decreases compressed charge reactivity while maintain a high expansion ratio for maximum work extraction. Experimental testing was conducted on a 13L multi-cylinder heavy-duty diesel engine modified to operate dual-fuel combustion with port gasoline injection to supplement the direct diesel injection. The engine employs intake variable valve actuation (VVA) for early (EIVC) or late (LIVC) intake valve closing to yield reduced effective compression ratio. Testing was conducted at a mid-load operating condition using a gasoline-diesel dual-fuel operating strategy. The impact on dual-fuel engine performance and emissions with respect to varying effective compression ratio is quantified within this study. As effective compression ratio is reduced, overall massflow through the engine decreases, yielding both higher gas exchange efficiencies and increased heat transfer losses. With constant combustion phasing gasoline/diesel fueling fraction, and NOx emissions held constant, overall brake thermal efficiency remains relatively constant across effective compression ratios.

Ickes, Andrew↗

DOE OSTI2016

Finite Element Simulation of Compression Molding of Woven Fabric Carbon Fiber/Epoxy Composites: Part I Material Model Development

Woven fabric carbon fiber/epoxy composites made through compression molding are one of the promising choices of material for the vehicle light-weighting strategy. Previous studies have shown that the processing conditions can have substantial influence on the performance of this type of the material. Therefore the optimization of the compression molding process is of great importance to the manufacturing practice. An efficient way to achieve the optimized design of this process would be through conducting finite element (FE) simulations of compression molding for woven fabric carbon fiber/epoxy composites. However, performing such simulation remains a challenging task for FE as multiple types of physics are involved during the compression molding process, including the epoxy resin curing and the complex mechanical behavior of woven fabric structure. In the present study, the FE simulation of the compression molding process of resin based woven fabric composites at continuum level is conducted, which is enabled by the implementation of an integrated material modeling methodology in LS-Dyna. Specifically, the chemo-thermo-mechanical problem of compression molding is solved through the coupling of three material models, i.e., one thermal model for temperature history in the resin, one mechanical model to update the curing-dependent properties of the resin and another mechanical model to simulate the behavior of the woven fabric composites. Preliminary simulations of the carbon fiber/epoxy woven fabric composites in LS-Dyna are presented as a demonstration, while validations and models with real part geometry are planned in the future work.

36 MATERIALS SCIENCE↗

DOE OSTI2017

Modeling and Simulation of Compression Molding Process for Sheet Molding Compound (SMC) of Chopped Carbon Fiber Composites

Compression molded SMC composed of chopped carbon fiber and resin polymer which balances the mechanical performance and manufacturing cost presents a promising solution for vehicle lightweight strategy. However, the performance of the SMC molded parts highly depends on the compression molding process and local microstructure, which greatly increases the cost for the part level performance testing and elongates the design cycle. ICME (Integrated Computational Material Engineering) approaches are thus necessary tools to reduce the number of experiments required during part design and speed up the deployment of the SMC materials. As the fundamental stage of the ICME workflow, commercial software packages for SMC compression molding exist yet remain not fully validated especially for chopped fiber systems. In this study, SMC plaques are prepared through compression molding process. The corresponding simulation models are built in Autodesk Moldflow with the same part geometry and processing conditions as in the molding tests. The output variables of the compression molding simulations, including press force history and fiber orientation of the part, are compared with experimental data. Influence of the processing conditions to the fiber orientation of the SMC plaque is also discussed. It is found that generally Autodesk Moldflow can achieve a good simulation of the compression molding process for chopped carbon fiber SMC, yet quantitative discrepancies still remain between predicted variables and experimental results.

36 MATERIALS SCIENCE↗

DOE OSTI2016

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Abstract. Geoscientific models and measurements generate false precision (scientifically meaningless data bits) that wastes storage space. False precision can mislead (by implying noise is signal) and be scientifically pointless, especially for measurements. By contrast, lossy compression can be both economical (save space) and heuristic (clarify data limitations) without compromising the scientific integrity of data. Data quantization can thus be appropriate regardless of whether space limitations are a concern. We introduce, implement, and characterize a new lossy compression scheme suitable for IEEE floating-point data. Our new Bit Grooming algorithm alternately shaves (to zero) and sets (to one) the least significant bits of consecutive values to preserve a desired precision. This is a symmetric, two-sided variant of an algorithm sometimes called Bit Shaving that quantizes values solely by zeroing bits. Our variation eliminates the artificial low bias produced by always zeroing bits, and makes Bit Grooming more suitable for arrays and multi-dimensional fields whose mean statistics are important. Bit Grooming relies on standard lossless compression to achieve the actual reduction in storage space, so we tested Bit Grooming by applying the DEFLATE compression algorithm to bit-groomed and full-precision climate data stored in netCDF3, netCDF4, HDF4, and HDF5 formats. Bit Grooming reduces the storage space required by initially uncompressed and compressed climate data by 25–80 and 5–65 %, respectively, for single-precision values (the most common case for climate data) quantized to retain 1–5 decimal digits of precision. The potential reduction is greater for double-precision datasets. When used aggressively (i.e., preserving only 1–2 digits), Bit Grooming produces storage reductions comparable to other quantization techniques such as Linear Packing. Unlike Linear Packing, whose guaranteed precision rapidly degrades within the relatively narrow dynamic range of values that it can compress, Bit Grooming guarantees the specified precision throughout the full floating-point range. Data quantization by Bit Grooming is irreversible (i.e., lossy) yet transparent, meaning that no extra processing is required by data users/readers. Hence Bit Grooming can easily reduce data storage volume without sacrificing scientific precision or imposing extra burdens on users.

58 GEOSCIENCES↗

DOE OSTI2018

An L$_0$L$_1$-norm compressive sensing paradigm for the construction of sparse predictive lattice models using mixed integer quadratic programming

First-principles based lattice models allow the modeling of ab initio thermodynamics of crystalline mixtures for applications such as the construction of phase diagrams and the identification of ground state atomic orderings. The recent development of compressive sensing approaches for the construction of lattice models has further enabled the systematic construction of sparse physical models without the need for human intuition other than requiring the compactness of effective cluster interactions. However, conventional compressive sensing based on L1-norm regularization is strictly only applicable to certain classes of optimization problems and is otherwise not guaranteed to generate optimally sparse and transferable results, so that the method can only be applied to some materials science applications. In this paper, we illustrate a more robust L0L1-norm compressive-sensing method that removes the limitations of conventional compressive sensing and generally results in sparser lattice models that are at least as predictive as those obtained from L1-norm compressive sensing. Apart from the theory, a practical implementation based on state-of-the-art mixed-integer quadratic programming (MIQP) is proposed. The robustness of our methodology is illustrated for four different transition-metal oxides with relevance as battery cathode materials: Li2xTi2(1-x)O2, Li2xNi2yO2, MgxCr2O4, and NaxCrO2. This method provides a practical and robust approach for the construction of sparser and more predictive lattice models, improving on the compressive sensing paradigm and making it applicable to a much broader range of applications.

Huang, W↗

DOE OSTI2022

Compressing micro-operations in scheduler entries in a processor

An electronic device includes a processor having a micro-operation queue, multiple scheduler entries, and scheduler compression logic. When a pair of micro-operations in the micro-operation queue is compressible in accordance with one or more compressibility rules, the scheduler compression logic acquires the pair of micro-operations from the micro-operation queue and stores information from both micro-operations of the pair of micro-operations into different portions in a single scheduler entry. In this way, the scheduler compression logic compresses the pair of micro-operations into the single scheduler entry.

Boyer, Michael W.↗

DOE OSTI2023

Classical and quantum compression for edge computing: the ubiquitous data dimensionality reduction

Edge computing aims to address the challenges associated with communicating and transferring large amounts of data generated remotely to a data center in a timely and efficient manner. A central pillar of edge computing is local (i.e., at- or near-source) data processing capability so that data transfer to a data center for processing can be minimized. Data compression at the edge is therefore a natural component of edge workflows. Here we present a survey of data compression algorithms with a focus on edge computing. Not all compression algorithms can accommodate the data type heterogeneity, tight processing and communication time constraints, or energy efficiency requirement characteristics of edge computing. We discuss specific examples of compression algorithms that are being explored in the context of edge computing. We end our review with a brief survey of emerging quantum compression techniques that are of importance in quantum information processing, including the proposed concept of quantum edge computing.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Macro- and micro-compression testing of shales

Here, macro- and micro-geomechanical properties of shales were investigated at millimeter- and micrometer-scale using an example of the Woodford Shale. Geomechanical properties, such as uniaxial (unconfined) compressive strength and Young's modulus, were quantified at the millimeter-scale and compared with results from micro-compression testing experiments of FIB-SEM-nanofabricated micro-pillars. Size-scale and compositional/structural heterogeneity effect on elasto-plastic deformation and failure behavior of shales were investigated. Also, relationship between elemental/mineral composition and unconfined compressive strength and Young's modulus, at a micrometer-scale, was discussed. It was shown that geomechanical properties of shales are scale-dependent and are strongly affected by compositional/structural anisotropy. In particular, micro-compression testing experiments showed non-uniformly distributed compressive strength and Young's modulus within the investigated Woodford Shale rock samples. It was demonstrated, that geomechanical properties of shales, investigated at the micrometer-scale, tend to be affected by different minerals and/or pores, while the same properties, investigated at the millimeter-scale, are governed by different micro-facies (and/or micro-fractures) present within the rock. This shows that geomechanical properties of shales can be dramatically different depending on the scale of investigation and compositional/structural heterogeneity of these rocks, and therefore are not easily transferable across the scales.

58 GEOSCIENCES↗

DOE OSTI2015

Behavior of sodium borosilicate glasses under compression using molecular dynamics

We have performed classical molecular dynamics simulations in order to study the changes under compression in the local and medium range structural properties of three sodium borosilicate glasses with varying sodium content. These glasses have been isostatically compressed up to 20 GPa and then decompressed in order to analyze the different mechanisms that affect densification, alongside with the permanent modifications of the structure after a full compression/decompression cycle. The results show that the atomic packing is the prominent characteristic that governs the amount of densification in the glass, as well as the setup of the permanent densification. During compression, the bulk modulus increases linearly up to approximately 15 GPa and more rapidly for higher pressures, a behavior which is reflected on the rate of increase of the average coordination for B and Na. Radial distribution functions at different pressures during the cycle help to quantify the amount of distortions in the elementary structural units, with a pronounced shortening of the Na–Na and Na–O bond lengths during compression. A subsequent decomposition of the glassy matrix into elementary Voronoi volumes verifies the high compressibility of Na-rich regions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Massive compression for high data rate macromolecular crystallography (HDRMX): impact on diffraction data and subsequent structural analysis

New higher-count-rate, integrating, large-area X-ray detectors with framing rates as high as 17400 images per second are beginning to be available. These will soon be used for specialized macromolecular crystallography experiments but will require optimal lossy compression algorithms to enable systems to keep up with data throughput. Some information may be lost. Can we minimize this loss with acceptable impact on structural information? To explore this question, we have considered several approaches: summing short sequences of images, binning to create the effect of larger pixels, use of JPEG-2000 lossy wavelet-based compression, and use of Hcompress, which is a Haar-wavelet-based lossy compression borrowed from astronomy. We also explore the effect of the combination of summing, binning, and Hcompress or JPEG-2000. In each of these last two methods one can specify approximately how much one wants the result to be compressed from the starting file size. These provide particularly effective lossy compressions that retain essential information for structure solution from Bragg reflections.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

Progressive Tree-Based Compression of Large-Scale Particle Data

Scientific simulations and observations using particles have been creating large datasets that require effective and efficient data reduction to store, transfer, and analyze. However, current approaches either compress only small data well while being inefficient for large data, or handle large data but with insufficient compression. Toward effective and scalable compression/decompression of particle positions, we introduce new kinds of particle hierarchies and corresponding traversal orders that quickly reduce reconstruction error while being fast and low in memory footprint. Our solution to compression of large-scale particle data is a flexible block-based hierarchy that supports progressive, random-access, and error-driven decoding, where error estimation heuristics can be supplied by the user. For low-level node encoding, we introduce new schemes that effectively compress both uniform and densely structured particle distributions. Our proposed methods thus target all three phases of a tree-based particle compression pipeline, namely tree construction, tree traversal, and node encoding. In conclusion, the improved efficacy and flexibility of these methods over existing compressors are demonstrated through extensive experimentation, using a wide range of scientific particle datasets.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Physics-Driven Convolutional Autoencoder Approach for CFD Data Compressions: Preprint

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been proposed and shown to be effective at producing reduced representations of turbulent flow data. However, these approaches focus solely on training the model using point-wise sample reconstruction losses that do not take advantage of the physical properties of turbulent flows. In this paper, we show that training autoencoders with additional physics-informed regularizations, e.g., enforcing incompressibility and preserving enstrophy, improves the compression model in three ways: (i) the compressed data better conform to known physics for homogeneous isotropic turbulence without negatively impacting point-wise reconstruction quality, (ii) inspection of the gradients of the trained model uncovers changes to the learned compression mapping that can facilitate the use of explainability techniques, and (iii) as a performance byproduct, training losses are shown to converge up to 12x faster than the baseline model.

auto-encoders↗

DOE OSTI2017

Cancellation of Raman self-frequency shift for compression of optical pulses

We study to which extent a fiber soliton can be manipulated by a specially chosen continuous pump wave. A group velocity matched pump scatters at the soliton, which is compressed due to the energy/momentum transfer. As the pump scattering is very sensitive to the velocity matching condition, soliton compression is quickly destroyed by the soliton self-frequency shift (SSFS). This is especially true for ultrashort pulses: SSFS inevitably impairs the degree of compression. We demonstrate numerically that soliton enhancement can be restored to some extent and the compressed soliton can be stabilized, provided that SSFS is canceled by a second pump wave. Still the available compression degree is considerably smaller than that in the Raman-free nonlinear fibers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗