Search NASA⌕ Search

SEARCH · Search NASA

Results for “COMPRESSION RATIO”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as CUSZ and cuZFP) have been developed. However, they suffer from either low performance or low compression ratios. To this end, we propose CUSZ+ to target both high compression ratios and throughputs. We identify that data sparsity and data smoothness are key factors for high compression throughputs. Our key contributions in this work are fourfold: (1) We propose an efficient compression workflow to adaptively perform run-length encoding and/or variable-length encoding. (2) We derive Lorenzo reconstruction in decompression as multidimensional partial-sum computation and propose a fine-grained Lorenzo reconstruction algorithm for GPU architectures. (3) We carefully optimize each of CUSZ kernels by leveraging state-of-the-art CUDA parallel primitives. (4) We evaluate CUSZ+ using seven real-world HPC application datasets on V100 and A100 GPUs. Experiments show CUSZ+ improves the compression throughputs and ratios by up to 18.4x and 5.3x, respectively, over CUSZ on the tested datasets.

Tian, Jiannan↗
DOE OSTI2021

Performance of direct injected propane and gasoline in a high stroke-to-bore ratio SI engine: Pathways to diesel efficiency parity with ultra low soot

This work explores pathways to achieve diesel-like, high-efficiency combustion with stoichiometric 3-way catalyst compatible combustion in a single-cylinder spark ignition (SI) research engine. A unique high stroke-to-bore engine design (1.5:1) with cooled exhaust gas recirculation (EGR) and high compression ratio ( r c ) was used to improve engine efficiency by up to 30% compared with a production turbocharged gasoline direct injection spark ignition engine. Engine experiments were conducted with both 91 RON E10 gasoline and liquified petroleum gas (LPG) (i.e. autogas) and were compared to legacy gasoline data on the production engine. Geometric compression ratio ( r c ) of 13.3:1 was used for both fuels with additional experiments at 16.8:1 for LPG only. Measurements of exhaust soot particle size and number concentrations were made with both fuels. Significant reduction in soot particles across the whole particle size range were achieved with LPG due to the elimination of in-cylinder liquid films. The effects of EGR, late intake valve closing (IVC) and fuel characteristics were investigated through their effects on efficiency, combustion stability and soot production. Results of 47% gross thermal efficiency, and 45% net thermal efficiency at stoichiometric engine operation, at up to 17 bar IMEP and 2000 r/min with 16.8:1 r c were achieved with LPG. Estimated brake efficiency values were compared to a contemporary medium duty diesel engine illustrating the benefits of the chosen path for achieving diesel efficiency parity.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

CONTROLLED END GAS AUTO IGNITION WITH EXHAUST GAS RECIRCULATION ON A STOICHIOMETRIC, SPARK IGNITED, NATURAL GAS ENGINE

The goal of this study is to address fundamental limitations to achieving diesel-like efficiencies in heavy duty on-highway natural gas (NG) engines. Engine knock and misfire are barriers to pathways leading to higher efficiency engines. This study explores enabling technologies for development of high efficiency stoichiometric, spark ignited, natural gas engines. These include design strategies for fast and stable combustion and higher dilution tolerance. Additionally, advanced control methodologies are implemented to maintain stable operation between knock and misfire limits. To implement controlled end- gas autoignition (C-EGAI) strategies a Combustion Intensity Metric (CIM) is used for ignition control with the use of a Woodward large engine control module (LECM). Tests were conducted using a single cylinder, variable compression ratio, cooperative fuel research (CFR) engine with baseline conditions of 900 RPM, engine load of 800 kPa indicated mean effective pressure (IMEP), and stoichiometric air/fuel ratio. Exhaust gas recirculation (EGR) tests were performed using a custom EGR system that simulates a high pressure EGR loop and can provide a range of EGR rates from 0 to 40%. The experimental measurements included the variance of EGR rate, compression ratio, engine speed, IMEP, and CIM. These five variables were optimized through a Modified Box- Benken design Surface Response Method (RSM), with brake efficiency as the merit function. A positive linear correlation between CIM and f-EGAI was identified. Consequently, CIM was used as the feedback control parameter for C-EGAI. As such, implementation of C-EGAI effectively allowed for the utilization of high EGR rates and CRs, controlling combustion between a narrower gap between knock and lean limits. The change from fixed to parametric ignition timing with CIM targeted select values of f-EGAI with an average coefficient of variance (COV) of peak pressure of 5.4. The RSM efficiency optimization concluded with operational conditions of 1080 RPM, 1150 kPa IMEP, 10.55:1 compression ratio, and 17.8% EGR rate with a brake efficiency of 21.3%. At this optimized point of peak performance, a f-EGAI for C-EGAI was observed at 34.1% heat release due to auto ignition, a knock onset crank angle value of 10.3° aTDC and ignition timing of - 24.7° aTDC. This work has demonstrated that combustion at a fixed f-EGAI can be maintained through advanced ignition control of CIM without experiencing heavy knocking events.

Cooperative Fuel Research Engine, Auto Ignition, E↗
DOE OSTI2023

Low-carbon fuels for spark-ignited engines: A comparative study of compressed natural gas and liquefied petroleum gas on a CFR engine with exhaust gas recirculation

Decades of work on low-carbon fuels have established their potential for substantial emissions reductions; however, their adoption is still limited by infrastructure concerns and engine efficiency deficits. As infrastructures have begun to evolve, research on strategies that maximize engine efficiency through interactions with fuel properties must also now take center place. This paper compares the performance, emissions, and combustion characteristics of two forefront low-carbon fuels: compressed natural gas (CNG) and liquefied petroleum gas (LPG) in a cooperative fuel research (CFR) engine over a range of compression ratios and engine loads. The effects of exhaust gas recirculation (EGR), end-gas auto-ignition, and a novel combustion control tool, the combustion intensity metric (CIM), were also evaluated at different stoichiometric engine operating conditions. In comparison to LPG, CNG operation demonstrated an extended knock-free regime, allowing engine operation at higher engine loads and compression ratios, but LPG operation exhibited enhanced combustion characteristics with higher peak pressures and faster apparent heat release rates (AHRR). LPG operation achieved higher brake thermal efficiencies and lower equivalent CO 2 emissions compared to CNG operation at the tested engine loads and compression ratios. LPG demonstrated significantly higher EGR tolerance limits compared to CNG, with a maximum of 28% EGR rate, compared to 23% for CNG. This improved EGR dilution tolerance was responsible for a 90% reduction in NOx emissions for LPG compared to a maximum of 70% with CNG. EGR dilution also exhibited more effective knock mitigation potential with LPG, suppressing knock intensity values by up to 98% and transitioning the engine operation towards normal combustion from heavy knocking conditions. As a result, the CIM was found to decrease burn durations and improve the quality of combustion by controlling the desired fraction of end-gas auto-ignition.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2018

Insights into Engine Knock: Comparisons of Knock Metrics across Ranges of Intake Temperature and Pressure in the CFR Engine

Of late there has been a resurgence in studies investigating parameters that quantify combustion knock in both standardized platforms and modern spark-ignition engines. However, it is still unclear how metrics such as knock (octane) rating, knock onset, and knock intensity are related and how fuels behave according to these metrics across a range of conditions. As part of an ongoing study, the air supply system of a standard Cooperative Fuel Research (CFR) F1/F2 engine was modified to allow mild levels of intake air boosting while staying true to its intended purpose of being the standard device for American Society for Testing and Materials (ASTM)-specified knock rating or octane number tests. For instance, the carburation system and intake air heating manifold are not altered, but the engine was equipped with cylinder pressure transducers to enable both logging of the standard knockmeter readout and state-of-the-art indicated data. For this study, the engine was operated using primary reference fuel 90 (PRF90) at 600 rpm, first following the procedures of the ASTM D2699 research octane number test protocol in order to define the geometric compression ratio set point for standard knock number. Thereafter, compression ratio sweeps were conducted at intake temperatures ranging from 30 to 150°C and intake air boost extending from 0 to 0.3 bar above ambient. The resulting operating map provided a broad envelope of compressed in-cylinder conditions relevant to modern spark-ignition engines. Detailed analysis of the indicated data highlighted a poor correlation between established knock intensity metrics and the knockmeter reading, which is used to characterize a fuel’s octane number. It was further found that the auto-ignition characteristics of PRF90 could be perturbed by means of intake air boosting and heating without being captured by the knockmeter reading.

Rockstroh, Toby↗
DOE OSTI2019

The Effect of EGR on Knock Suppression, Efficiency, and Emissions in a Stoichiometric

Exhaust gas recirculation (EGR) is widely employed on internal combustion engines for NOx reduction and knock suppression. In this study a comprehensive analysis was performed to determine the effect of EGR on efficiency, emissions, and knock suppression of stoichiometric, spark ignited, natural gas engines. Tests were conducted using a single cylinder, variable compression ratio, cooperative fuel research (CFR) engine at 900 RPM, engine load of 800 kPa indicated mean effective pressure (IMEP), and stoichiometric conditions. The tests were performed using a custom EGR system capable of providing a range of EGR displacement rates from 0% to 40% of the intake charge at engine power levels between 1.5 and 3.5 kW. The experimental measurements included the variance of EGR rate, compression ratio, boost pressure, and location of 50% mass fraction burned (CA50). CA50 was controlled with ignition timing using a Woodward Large Engine Control Module. The use of EGR was found to expand the knock limit, while reducing NOx emissions and increasing engine efficiency as much as 4.5% through increased compression ratio and power density. The highest EGR rate that demonstrated beneficial gains on the CFR engine was 23%; the optimal EGR rate was found to be 19%.

Bayliff, Scott↗
DOE OSTI2019

The Effect of EGR on Knock Suppression, Efficiency, and Emissions in a Stoichiometric, Spark Ignited, Natural Gas Engine

Exhaust gas recirculation (EGR) is widely employed on internal combustion engines for NOx reduction and knock suppression. In this study a comprehensive analysis was performed to determine the effect of EGR on efficiency, emissions, and knock suppression of stoichiometric, spark ignited, natural gas engines. Tests were conducted using a single cylinder, variable compression ratio, cooperative fuel research (CFR) engine at 900 RPM, engine load of 800 kPa indicated mean effective pressure (IMEP), and stoichiometric conditions. The tests were performed using a custom EGR system capable of providing a range of EGR displacement rates from 0% to 40% of the intake charge at engine power levels between 1.5 and 3.5 kW. The experimental measurements included the variance of EGR rate, compression ratio, boost pressure, and location of 50% mass fraction burned (CA50). CA50 was controlled with ignition timing using a Woodward Large Engine Control Module. The use of EGR was found to expand the knock limit, while reducing NOx emissions and increasing engine efficiency as much as 4.5% through increased compression ratio and power density. The highest EGR rate that demonstrated beneficial gains on the CFR engine was 23%; the optimal EGR rate was found to be 19%.

Cooperative Fuel Research Engine, Exhaust Gas Reci↗
DOE OSTI2025

Ocelot: An Interactive, Efficient Distributed Compression-As-a-Service Platform With Optimized Data Compression Techniques

Large volumes of data generated by scientific simulations, genome sequencing, and other applications need to be moved among clusters for data collection/analysis. Data compression techniques have effectively reduced data storage and transfer costs. However, users' requirements on interactively controlling both data quality and compression ratios are non-trivial to fulfill. Here, we propose a novel Compression-as-a-Service (CaaS) platform called Ocelot with four important contributions: (1) It offers real-time visualization, interactive compression, and transfer of scientific datasets. (2) It incorporates new strategies for compressing diverse types of datasets more effectively than traditional methods. (3) It provides an effective method for estimating the compression ratio and execution time of compression tasks. (4) Experiments on multiple real-world datasets on geographically distributed computers show that Ocelot can significantly improve data transfer efficiency with a performance gain of more than 10x in computing clusters with relatively slow networks.

compression as a service (CaaS)↗
DOE OSTI2018

Compact video content representation for video coding using low multi-linear tensor rank approximation with dynamic core tensor order

Tensor is a multi-way representation of an entity that is widely used in many applications of mathematics and physics. The wide range of tensor algebra operations attract the researchers of graphical and vision field to identify unique methods for various applications such as segmentation, compression, indexing and so on. In this paper, low multi-linear rank approximation of a tensor is used for decomposition so as to perform compression on a video that is represented as a 4D tensor. Thus, the encoder has blocks for (1) multilinear rank approximation method so as to aid decomposition, (2) sparsity removal of residual data to reduce the required memory storage to a small level, (3) quantization on the sparse less residual data and (4) LZ77 dictionary coding for the video. The decoder uses a tensor reconstruction block along with residual error correction block that reduces loss/error in the reconstructed video. The size of core tensor is an important factor in rank approximation. It is identified at run time depending on the video contents. This size is determined adaptively using Tikhonov’s regularization method. The best value of core tensor size is identified with the corner of L-curve which preserves the video contents from heavy loss/error. Experimental results of the proposed work on comparison with H.264/AVC compression method indicate that the proposed method achieves up to 10% improvement in compression ratio with the least amount of loss and a maximum signal to noise ratio of 0.14. The proposed system gives better compression ratio than H.265 for videos with more number of frames without compromising quality.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Toward Quantity-of-Interest Preserving Lossy Compression for Scientific Data

Today's scientific simulations and instruments are producing a large amount of data, leading to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy compressors are effective in significantly reducing data volumes and efficiently developing databases for multiple scientific applications, they mainly support error controls on raw data, which leaves a significant gap between the data and user's downstream analysis. This may cause unqualified uncertainties in the outcomes of the analysis, a.k.a quantities of interest (QoIs), which are the major concerns of users in adopting lossy compression in practice. In this paper, we propose rigorous mathematical theories to preserve four families of QoIs that are widely used in scientific analysis during lossy compression along with practical implementations. Specifically, we first develop the error control theory for univariate QoIs which are essential for computing physical properties such as kinetic energy, followed by multivariate QoIs that are more commonly used in real-world applications. The proposed method is integrated into a state-of-the-art compression framework in a modular fashion, which could easily adapt to new QoIs and new compression algorithms. Experiments on real-world datasets demonstrate that the proposed method provides faithful error control on important QoIs including kinetic energy, regional average, and isosurface without trials and errors, while offering compression ratios that are up to 4x of the compression ratios provided by state-of-the-art compressors.

Jiao, Pu↗
DOE OSTI2024

Next Gen High Efficiency Boosted Engine Development

This work represents an advanced engineering research project partially funded by the U.S. Department of Energy (DOE). Ford Motor Company, FEV North America, and Oak Ridge National Laboratory collaborated to develop a next generation boosted spark ignited engine concept. The project goals, specified by the DOE, were 23% improved fuel economy and 15% reduced weight relative to a 2015 or newer light-duty vehicle. The fuel economy goal was achieved by designing an engine incorporating high geometric compression ratio, high dilution tolerance, low pumping work, and low friction. The increased tendency for knock with high compression ratio was addressed using early intake valve closing (EIVC), cooled exhaust gas recirculation (EGR), an active pre-chamber ignition system, and careful management of the fresh charge temperature. Engine weight reduction measures were implemented throughout the engine system making use of composite materials, advanced manufacturing techniques, and architectural choices. This report outlines the analytical, design, fabrication, and test work conducted for the duration of the project. The combustion system stability, EGR tolerance, and knock resistance were validated on a single cylinder engine. An inline six-cylinder engine was then designed targeting application in the Ford F150. Multi-cylinder engines were produced and tested achieving the target vehicle fuel economy improvement of 23% assessed using measured engine fuel consumption combined with a vehicle drive cycle simulation. Actions were identified and designs were demonstrated to achieve the 15% weight reduction target. This project included items covering a range of technology readiness levels. Some of the technologies explored are production ready, while others were investigated to understand the limitations for what can be achieved in a stoichiometric, gasoline-fueled, spark-ignited internal combustion engine.

42 ENGINEERING↗
DOE OSTI2023

A computational parametric study of ducted fuel injection implementation in a heavy-duty diesel engine

Experiments have shown that ducted fuel injection (DFI) effectively reduces soot emissions from direct-injection diesel engines. Although many computational studies have evaluated DFI’s spray development and soot reduction mechanisms in constant volume chambers, only limited computational work on internal combustion engines exists. The DFI duct assembly changes the engine’s in-cylinder flow, spray, and combustion development. Therefore, current production engine designs might not be optimal for achieving the best engine performance with DFI. Here, this work conducted an extensive numerical study to evaluate how parameter changes affect DFI performance. The parameters include swirl ratio, piston geometry, compression ratio (CR), number of injector orifices, split injection strategy, and exhaust gas recirculation (EGR) in a heavy-duty diesel engine utilizing DFI. The combustion and soot emission data from the Sandia compression ignition optical research engine were used for model validation. Simulations showed that an increased swirl ratio resulted in more intense jet flame-piston interaction, slowing down the combustion heat release during the late combustion stage and leading to lower indicated thermal efficiency (ITE) due to higher exhaust losses. A piston-bowl design with a reentrant inner piston edge yielded the highest thermal efficiency, due to the reduced cylinder head heat transfer loss. Additional injector orifices led to higher efficiency owing to a more advanced combustion phasing. Nevertheless, the maximum pressure rise rate (MPRR) and oxides of nitrogen (NO x ) emissions also increased with the number of injector orifices due to more rapid heat release and higher combustion temperature. Implementation of a split injection strategy combined with a higher EGR rate effectively inhibited the excessive MPRR and NO x formation. In general, the study concluded that DFI is not sensitive to most parameter changes but will benefit from future parameter optimization.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2018

Adaptive wavelet compression of large additive manufacturing experimental and simulation datasets

New manufacturing technologies such as additive manufacturing require research and development to minimize the uncertainties in the produced parts. The research involves experimental measurements and large simulations, which result in huge quantities of data to store and analyze. We address this challenge by alleviating the data storage requirements using lossy data compression. We select wavelet bases as the mathematical tool for compression. Unlike images, additive manufacturing data is often represented on irregular geometries and unstructured meshes. Thus, we use Alpert tree-wavelets as bases for our data compression method. We first analyze different basis functions for the wavelets and find the one that results in maximal compression and miminal error in the reconstructed data. We then devise a new adaptive thresholding method that is data-agnostic and allows a priori estimation of the reconstruction error. Finally, we propose metrics to quantify the global and local errors in the reconstructed data. One of the error metrics addresses the preservation of physical constraints in reconstructed data fields, such as divergence-free stress field in structural simulations. While our compression and decompression method is general, we apply it to both experimental and computational data obtained from measurements and thermal/structural modeling of the sintering of a hollow cylinder from metal powders using a Laser Engineered Net Shape process. The results show that monomials achieve optimal compression performance when used as wavelet bases. The new thresholding method results in compression ratios that are two to seven times larger than the ones obtained with commonly used thresholds. Overall, adaptive Alpert tree-wavelets can achieve compression ratios between one and three orders of magnitude depending on the features in the data that are required to preserve. Furthermore, these results show that Alpert tree-wavelet compression is a viable and promising technique to reduce the size of large data structures found in both experiments and simulations.

42 ENGINEERING↗
DOE OSTI2015

A generalized reconstruction framework for unconventional PET systems

Purpose: Quantitative estimation of the radionuclide activity concentration in positron emission tomography (PET) requires precise modeling of PET physics. The authors are focused on designing unconventional PET geometries for specific applications. This work reports the creation of a generalized reconstruction framework, capable of reconstructing tomographic PET data for systems that use right cuboidal detector elements positioned at arbitrary geometry using a regular Cartesian grid of image voxels. Methods: The authors report on a variety of design choices and optimization for the creation of the generalized framework. The image reconstruction algorithm is maximum likelihood-expectation–maximization. System geometry can be specified using a simple script. Given the geometry, a symmetry seeking algorithm finds existing symmetry in the geometry with respect to the image grid to improve the memory usage/speed. Normalization is approached from a geometry independent perspective. The system matrix is computed using the Siddon’s algorithm and subcrystal approach. The program is parallelized through open multiprocessing and message passing interface libraries. A wide variety of systems can be modeled using the framework. This is made possible by modeling the underlying physics and data correction, while generalizing the geometry dependent features. Results: Application of the framework for three novel PET systems, each designed for a specific application, is presented to demonstrate the robustness of the framework in modeling PET systems of unconventional geometry. Three PET systems of unconventional geometry are studied. (1) Virtual-pinhole half-ring insert integrated into Biograph-40: although the insert device improves image quality over conventional whole-body scanner, the image quality varies depending on the position of the insert and the object. (2) Virtual-pinhole flat-panel insert integrated into Biograph-40: preliminary results from an investigation into a modular flat-panel insert are presented. (3) Plant PET system: a reconfigurable PET system for imaging plants, with resolution of greater than 3.3 mm, is shown. Using the automated symmetry seeking algorithm, the authors achieved a compression ratio of the storage and memory requirement by a factor of approximately 50 for the half-ring and flat-panel systems. For plant PET system, the compression ratio is approximately five. The ratio depends on the level of symmetry that exists in different geometries. Conclusions: This work brings the field closer to arbitrary geometry reconstruction. A generalized reconstruction framework can be used to validate multiple hypotheses and the effort required to investigate each system is reduced. Memory usage/speed can be improved with certain optimizations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Model predictive combustion control of a Gasoline Compression Ignition engine

Gasoline Compression Ignition is a novel combustion concept that derives its superiority from the high compression ratio of a compression ignition engine as well as the properties of gasoline fuel, such as longer ignition delay and higher volatility compared to diesel. Here, this combustion concept was experimentally tested on a 12.4L Class 8 truck engine. Based on these experimental data, prior efforts by the authors focused on the development of an engine model for a heavy-duty engine operating on a low-reactivity fuel. This engine model was leveraged within this study to investigate a combustion control strategy at different engine conditions and injection methods and was augmented to incorporate cycle-to-cycle combustion variations. State estimation is performed by means of a Kalman filter which feeds into a model predictive controller. The model predictive controller chooses control actions based on a predefined cost function under consideration of bounds reflecting physical constraints. The engine model was utilized to establish a state-space model that serves the Kalman filter and model predictive controller for estimation and prediction. A comparative study investigating control actions and engine behavior was performed with and without limiting in-cylinder peak pressure as well as combustion noise, which is of particular interest for early pilot injection strategies. In addition, the proposed control architecture was investigated at two different levels of cycle-to-cycle variations and compared to the performance of a control structure with input disturbance rejection. For increased cycle-to-cycle variations, disturbance estimation reduces state fluctuations and control effort. In general, this investigation highlights control aspects specific to a compression-ignited combustion regime with low-reactivity fuel. The control algorithm is able to maintain the desired references for brake mean effective pressure and combustion phasing while controlling peak in-cylinder pressure and combustion noise.

42 ENGINEERING↗
DOE OSTI2025

Lossy Compression: An Online Multi-Stage Technology for High-Fidelity Synchro- Waveform Measurements

Effective real-time monitoring and analysis of distributed grids necessitate the use of synchro-waveform measurements, which capture almost all high-frequency disturbances and transient phenomena. However, due to limitations in high-speed measurements and network bandwidth, it is challenging to transfer all high-fidelity synchro-waveforms losslessly and successfully. To cope with these challenges, a hybrid-based online multi-stage compression algorithm is proposed to significantly improve the compression efficiency for synchro-waveform measurements. Initially, the multiple discrete Wavelet transformation is deployed to deconstruct the waveform components. The delta encoding is further developed to decrease the magnitude. In conjunction with the Lempel-Ziv-Markov chain, the hybrid compression algorithm is implemented to achieve real-time compression for the synchro-waveform measurements. Moreover, an innovative error index that synergizes the time and frequency domain error and correlation is formulated to evaluate the waveform distortion. By integrating compression ratio, suitable parameters can be optimally selected. Finally, the simulation, laboratory experiments, as well as field tests across a spectrum of sampling frequencies and time intervals are conducted to substantiate the efficacy of the proposed method. Here, the outcomes demonstrated that a compression ratio of approximately 15.5 and 17.83 can be reached for 0.5 s and 1 s data under both offline and online scenarios, which equates to a substantial 93.5% to 94.39% reduction in data storage requirements.

High-fidelity synchro-waveform measurements↗
DOE OSTI2022

SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Here, error-bounded lossy compression has been considered one of the most effective solutions to the above problem. In practice, however, the best-fit compression method often needs to be customized or optimized in particular because of diverse characteristics in different datasets and various user requirements on the compression quality and performance. In this paper, we address this issue with a novel modular, composable compression framework named SZ3. Our contributions are four-folds. (1) We develop SZ3 which features an innovative modular abstraction for the prediction-based compression framework, such that compression modules can be plugged in easily to create new compressors based on characteristics of data and user requirements. (2) We create a new compression pipeline by SZ3 for GAMESS data, which significantly improves the compression ratios over state-of-the-art compressors. (3) We develop an adaptive compression pipeline by SZ3 for APS data with minimal efforts, which leads to the best rate-distortion among all existing error-bounded lossy compressors for any bit-rate. (4) We compare the sustainability of SZ3 with leading error-bounded prediction-based compressors, and then demonstrate the necessity of diverse pipelines by integrating and evaluating several compression pipelines on diverse scientific datasets from multiple disciplines. Experiments show that SZ3 incurs very limited overhead in compressor integration and our customized compression pipelines lead to up to 20% improvement in compression ratios under the same data distortion, when compared with the best existing approach.

97 MATHEMATICS AND COMPUTING↗