Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Model Fit to Experimental Data for Foam-Assisted Deep Vadose Zone Remediation

Foam has been regarded as a promising means of remeidal amendment delivery to overcome subsurface heterogeneity in subsurface remediation processes. This study investigates how a foam model, developed by Method of Characteristics and fractional flow analysis in the companion paper of Roostapour and Kam (2012), can be applied to make a fit to a set of existing laboratory flow experiments (Zhong et al., 2009) in an application relevant to deep vadose zone remediation. This study reveals a few important insights regarding foam-assisted deep vadose zone remediation: (i) the mathematical framework established for foam modeling can fit typical flow experiments matching wave velocities, saturation history , and pressure responses; (ii) the set of input parameters may not be unique for the fit, and therefore conducting experiments to measure basic model parameters related to relative permeability, initial and residual saturations, surfactant adsorption and so on should not be overlooked; and (iii) gas compressibility plays an important role for data analysis, thus should be handled carefully in laboratory flow experiments. Foam kinetics, causing foam texture to reach its steady-state value slowly, may impose additional complications.

Roostapour, A.↗

Energy balance and Alfvén Mach numbers in compressible magnetohydrodynamic turbulence with a large-scale magnetic field

Energy equipartition is a powerful theoretical tool for understanding astrophysical plasmas. It is invoked, for example, to measure magnetic fields in the interstellar medium (ISM), as evidence for small-scale turbulent dynamo action, and, in general, to estimate the energy budget of star-forming molecular clouds. Here, in this study, we motivate and explore the role of the volume-averaged root-mean-squared (rms) magnetic coupling term between the turbulent, δB , and large-scale, B 0 , fields, $\langle$(δB·B 0 ) 2 $\rangle$$_{V}^{1/2}$. By considering the second moments of the energy balance equations we show that the rms coupling term is in energy equipartition with the volume-averaged turbulent kinetic energy for turbulence with a sub-Alfvénic large-scale field. Under the assumption of exact energy equipartition between these terms, we derive relations for the magnetic and coupling term fluctuations, which provide excellent, parameter-free agreement with time-averaged data from 280 numerical simulations of compressible magnetohydrodynamic (MHD) turbulence. Furthermore, we explore the relation between the turbulent mean field and total Alfvén Mach numbers, and demonstrate that sub-Alfvénic turbulence can only be developed through a strong, large-scale magnetic field, which supports an extremely super-Alfvénic turbulent magnetic field. This means that the magnetic field fluctuations are significantly subdominant to the velocity fluctuations in the sub-Alfvénic large-scale field regime. Throughout our study, we broadly discuss the implications for observations of magnetic fields and understanding the dynamics in the magnetized ISM.

79 ASTRONOMY AND ASTROPHYSICS↗

HPC Campaign Management: Remote data access with user-defined error bound using ADIOS and ZFP

Remote access to large-scale scientific datasets, like those generated by combustion simulations or other high-performance computing (HPC) applications, presents a significant challenge. Downloading entire datasets is often impractical due to their size and the bandwidth limitations of typical networks. To address this challenge, we propose a novel approach that enables efficient remote access to large datasets distributed across multiple facilities. Our method enables technologies to download only the data values of a select variable, in a select region of interest, to a user-defined accuracy. For this purpose, we extended the ADIOS IO library to provide read functions with user-defined accuracy, a remote data server that understands multidimensional selections of specific variables, steps and accuracy from an ADIOS dataset, and which uses lossy compression on the remote site to reduce the data to be transferred back to the client. In addition, our extension of the ADIOS library collects metadata from multiple datasets in small files called Campaign Archives, which can be shared among project participants on any HPC, cloud or laptop, and which can easily facilitate the discovery of content and pointers to the data location as well as remote access to the data by local tools as if data was local. This feature called Campaign Management, enables a group of scientists to manage related datasets stored in multiple files, across multiple facilities as if it was in a single file/database. We demonstrate the effectiveness of our approach using a 1.5 TB dataset from the S3D combustion simulation on Frontier at the Oak Ridge Leadership Facility. Even a single variable from this dataset, at 64 GB, is too large to be processed on a standard laptop. We show two different reading patterns for 2D plots and 3D visualization, with careful settings that a scientist studying combustion data would do and show that running the same Python scripts on Frontier directly takes comparable time than running them on the local laptop with remote access to the data on Frontier.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗

Validation of a blowby model using experimental results in motoring condition with the change of compression ratio and engine speed

Blowby and gas flow through the cylinder-piston-ring crevices are phenomena that affect the engine performance and exhaust emissions. Also these phenomena influence the cylinder pressure and temperature and the charge amount during a cycle. The study and validation of a sub-model for these phenomena in the absence of engine combustion deducts all effects arisen from the combustion event. During the current study, blowby sub-model and gas flow through crevices under motoring conditions has been noticed using a volume-orifice theory and the experimental results measured from a research engine. Blowby geometric parameters, consisting of a few critical cross-section areas (orifice areas) and volumes (top land and inter-ring crevice volumes), were measured in ambient temperature and corrected for hot running conditions. The cylinder pressure during cycle was measured by a piezoelectric pressure transducer and the low pressure parts of the cycle were measured using a piezoresistive pressure transducer for referencing purposes. The obtained results show a very good agreement between experimentally measured pressure data and model output for three compression ratios of 7.6, 10.2, 12.4 and three engine speeds of 750, 1500 and 2000 rpm, so that the maximum deviation was almost 5%. The model predicted that the maximum mass loss increased with increase of compression ratio and decreased with increase of engine speed. Also the peak mass loss position happened within the range of 3-9 CA after top dead center. After occurrence of the maximum loss, a reverse flow from the top land crevice into the cylinder was predicted in the model. (author)

33 ADVANCED PROPULSION SYSTEMS↗

Cognition at the Point of Sensing

Over the last 15 years, compressive sensing techniques have been developed which have the potential to greatly reduce the amount of data collected by systems while preserving the amount of information obtained. A cost of this efficiency is that a computationally-intensive optimization routine must be used to put the sensed data into a form that a person can interpret. At the same time, machine learning techniques have experienced tremendous growth as well. Machines have demonstrated the ability learn how to effectively perform tasks such as detection and classification at speeds much faster than humanly possible. Our goal in this project was to study the feasibility of using compressive sensing systems "at the edge." That is, how can compressive sensing sensors be deployed such that information is created at the remote sensor rather than sending raw data to a central processing location? Studies were performed to analyze whether machine learning could be done on the compressively sensed data in its raw form. If a machine is performing the task, is it possible to do so without putting the data into a human interpretable form? We show that this is possible for some systems, in particular a compressive sensing snapshot imaging spectrometer. Machine learning tasks were demonstrated to be more effective and more robust to noise when the machine learning algorithm worked on data in its raw form. This system is shown to outperform a traditional spectrometer. Techniques for reducing the complexity of the reconstruction routine were also analyzed. Techniques for such as data regularization, deep neural networks, and matrix completion were studied and shown to have benefits over traditional reconstruction techniques. In this project we showed that compressive sensing sensors are indeed feasible at the edge. As always, sensors and algorithms must be carefully tuned to work in the constrained environment. In this project we developed tools and techniques to enable those analyses.

47 OTHER INSTRUMENTATION↗

Reference Correlation for the Viscosity of Carbon Dioxide

A comprehensive database of experimental and computed data for the viscosity of carbon dioxide (CO 2 ) was compiled and a new reference correlation was developed. Literature results based on an ab initio potential energy surface were the foundation of the correlation of the viscosity in the limit of zero density in the temperature range from 100 K to 2000 K. Guided symbolic regression was employed to obtain a new functional form that extrapolates correctly to T → 0 K and to 10 000 K. Coordinated measurements at low density made it possible to implement the temperature dependence of the Rainwater-Friend theory in the linear-in-density viscosity term. The residual viscosity could be formulated with a scaling term ργ/T the significance of which was confirmed by symbolic regression. The final viscosity correlation covers temperatures from 100 K to 2000 K for gaseous CO 2 , and from 220 K to 700 K with pressures along the melting line up to 8000 MPa for compressed and supercritical liquid states. The data representation is more accurate than with the previous correlations, and the covered pressure and temperature range is significantly extended. The critical enhancement of the viscosity of CO 2 is included in the new correlation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

TIFF Image Writer patch for OpenSceneGraph

This software consists of code modifications to the open-source OpenSceneGraph software package to enable the creation of TlFF images containing 16 bit unsigned data. They also allow the user to disable compression and set the DPI tags in the resulting TIFF Images. Some image analysis programs require uncompressed, 16 bit unsigned input data. These code modifications allow programs based on OpenSceneGraph to write out such images, improving connectivity between applications.

Eldridge, Bryce↗

A control-oriented combustion model framework for compression ignition engines operating on low-reactivity fuel

This work focuses on zero-dimensional modeling of the heat release rate in a compression ignition engine operating on gasoline-like fuels. Due to the properties of gasoline, such as high volatility and longer ignition delay than diesel, the injection strategies can vary significantly from the operation with conventional diesel fuel. Different injection strategies are commonly used to achieve varying degrees of in-cylinder stratification in order to shape the combustion event and maximize efficiency. The proposed zero-dimensional combustion model was developed to account for the different stages in combustion caused by the fuel stratification. As the ignition delay model is an integral part of the entire combustion process and significantly affects the prediction accuracy, special attention has been paid to local phenomena influencing ignition delay. A one-dimensional spray model by Musculus and Kattke was employed in conjunction with a Lagrangian tracking approach in order to estimate the local air–fuel ratio within the spray tip, as a proxy for reactivity. The local air–fuel ratio, in-cylinder temperature and pressure were used in an integral fashion to estimate the ignition delay. Heat release rates were modeled using first-order non-linear differential equations. The proposed combustion model was validated against experimental data of a heavy-duty compression ignition engine with up to three injection events at mostly 1038 r/min and 14 bar brake mean effective pressure. Further validation of the model was carried out at other engine loads and speeds. Model prediction errors in CA50 of less than 1 °CA across all conditions were found. Modeling results of other combustion metrics such as combustion duration and indicated mean effective pressure are also highly satisfactory. In addition, the model has been shown to be capable of estimating the ringing intensity for most conditions.

Pamminger, Michael↗

Expanding Access to Science Participation: A FAIR Framework for Petascale Data Visualization and Analytics

The massive data generated by scientists daily serve as both a major catalyst for new discoveries and innovations, as well as a significant roadblock that restricts access to the data. Here, our paper introduces a new approach to removing Big Data barriers and democratizing access to petascale data for the broader scientific community. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hiding the complexities of dealing with file systems or cloud services. We enable FAIR (Findable, Accessible, Interoperable, and Reusable) access to datasets such as NASA’s petascale climate datasets. Our paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction utilizes state-of-the art progressive compression algorithms and machine-learning insights to power scalable visualization dashboards for petascale data. The result provides users with the ability to identify extreme events or trends dynamically, expanding access to scientific data and further enabling discoveries. We validate our approach by improving the ability of climate scientists to visually explore their data via three fully interactive dashboards. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution. These dashboards, released in simplified form to the general public, contribute significantly to a broader push to democratize the access and use of climate data.

Computer science↗

Transparent in Situ Data Transformations in ADIOS

Though an abundance of novel "data transformation" technologies have been developed (such as compression, level-of-detail, layout optimization, and indexing), there remains a notable gap in the adoption of such services by scientific applications. In response, we develop an in situ data transformation framework in the ADIOS I/O middleware with a "plug in" interface, thus greatly simplifying both the deployment and use of data transform services in scientific applications. Our approach ensures user-transparency, runtime-configurability, compatibility with existing I/O optimizations, and the potential for exploiting read-optimizing transforms (such as level-of-detail) to achieve I/O reduction. We demonstrate use of our framework with the QLG simulation at up to 8,192 cores on the leadership-class Titan supercomputer, showing negligible overhead. We also explore the read performance implications of data transforms with respect to parameters such as chunk size, access pattern, and the "opacity" of different transform methods including compression and level-of-detail.

Computer Science↗

Pathway to Decarbonization Through Industrial Energy Efficiency: Micro and Macro Perspectives from Compressed Air Usage

Abstract Energy audits directly provided the industrial sector with reduced energy costs and avoided emissions. Still, they also lead to far-reaching indirect and induced local, regional, and national benefits. This paper aims to present the techno-economic-environmental analysis to achieve decarbonization through implementing industrial energy efficiency at micro and macro levels. An integrated techno-economic-environmental methodology is developed. Case studies of micro-level carbon reduction efforts through industrial energy efficiency technologies are presented. The broader macroeconomic and environmental effects of technology on society are analyzed using data from 206 energy audits of industrial compressed air systems conducted over 13 years. The impacts show that energy-efficient improvements lead to direct cost savings for manufacturers, boost economic activity across sectors, and affect carbon dioxide emissions both short-term and long-term in the region. Given their extensive benefits, energy audits significantly influence policymaking. We devised a methodology to link micro-level energy audit data with macroeconomic and environmental analyses to quantify these cascading benefits. The economic scenario analysis shows that $228 M has been saved from direct industrial energy savings from implementing all compressed air recommendations in the studied periods and the region. In addition, the investment made through manufacturers would create 2,025 jobs and $383 M annually, cascading regional economic impacts. The environmental analysis shows that the regional manufacturers have directly avoided about 2.8 M metric tons of carbon dioxide emissions.

Engineering↗

Streaming Compression of Hexahedral Meshes

We describe a method for streaming compression of hexahedral meshes. Given an interleaved stream of vertices and hexahedral our coder incrementally compresses the mesh in the presented order. Our coder is extremely memory efficient when the input stream documents when vertices are referenced for the last time (i.e. when it contains topological finalization tags). Our coder then continuously releases and reuses data structures that no longer contribute to compressing the remainder of the stream. This means in practice that our coder has only a small fraction of the whole mesh in memory at any time. We can therefore compress very large meshes - even meshes that do not file in memory. Compared to traditional, non-streaming approaches that load the entire mesh and globally reorder it during compression, our algorithm trades a less compact compressed representation for significant gains in speed, memory, and I/O efficiency. For example, on the 456k hexahedra 'blade' mesh, our coder is twice as fast and uses 88 times less memory (only 3.1 MB) with the compressed file increasing about 3% in size. We also present the first scheme for predictive compression of properties associated with hexahedral cells.

99 GENERAL AND MISCELLANEOUS↗

SPRUCE Vegetation Community Survey Data from SPRUCE Experimental Plots, 2014-2020

This dataset provides vegetation survey data collected across vegetation community plots within the 10 chambered treatment plots (6, 19, 11, 20, 4, 13, 8, 16, 10, 17) and 3 unchambered ambient plots (7, 14, 21) from the Spruce and Peatland Responses Under Changing Environments (SPRUCE) experimental site within the Marcell Experimental Forest in northern Minnesota, USA. Collections occurred from 2014-2020 (2014-04-27 to 2020-08-06). The vegetation community plots, three in each experimental plot, were established in 2014 and designated to be undisturbed and reserved for long-term sampling. Vegetation survey data were collected at the peak of each growing season by placing a 1x2 meter rectangular grid over each community plot. The 1x2 meter grid is subset into 50 20x20 cm grid cells. Observations are of the presence of each species in each grid cell for each subplot. That’s a total of 39 subplots across the 13 experimental plots. From 2018 to 2020, shrub stem density was counted and percent shrub cover was estimated in five selected grid cells in each vegetation community plot. Also included are photographs of each community plot taken at the time of data collection for each measurement year. These data provide insight into the responses of plant community composition to warming and increased carbon dioxide. These data were use in analyses in McPartland et al (2018; 2020). This dataset contains three data files in comma-separate values (*.csv) format and seven compressed (*.zip) files containing 877 JPEG (*.jpg) files. Additional metadata are provided: a data dictionary and a file-level metadata file in comma-separate values (.csv) format and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

FedCSpc: A Cross-Silo Federated Learning System With Error-Bounded Lossy Parameter Compression

Cross-Silo federated learning is widely used for scaling deep neural network (DNN) training over data silos from different locations worldwide while guaranteeing data privacy. Communication has been identified as the main bottleneck when training large-scale models due to large-volume model parameters and gradient transmission across public networks with limited bandwidth. Most previous works focus on gradient compression, while limited work tries to compress parameters that can not be ignored and extremely affect communication performance during the training. Here, to bridge this gap, we propose FedCSpc: an efficient cross-silo federated learning system with an XAI-driven adaptive parameter compression strategy for large-scale model training. Our work substantially differs from existing gradient compression techniques due to the distinct data features of gradient and parameter. The key contributions of this paper are fourfold. (1) Our designed FedCSpc proposes to compress the parameter during the training using the state-of-the-art error-bounded lossy compressor – SZ3. (2) We develop an adaptive compression error bound adjustment algorithm to guarantee the model accuracy effectively. (3) We exploit an efficient approach to utilize the idle CPU resources of clients to compress the parameters. (4) We perform a comprehensive evaluation with a wide range of models and benchmarks on a GPU cluster with 65 GPUs. Results show that FedCSpc can achieve the same model accuracy as FedAvg while reducing the data volume of parameters and gradients in communication by up to 7.39× and 288×, respectively. With 32 clients on a 4 Gb size model, FedCSpc significantly outperforms FedAvg in wall-clock time in the emulated WAN environment (at the bandwidth of 1 Gbps or lower without loss of generality).

SZ3↗

Dynamic Mode Decomposition for Compressive System Identification

Dynamic mode decomposition has emerged as a leading technique to identify spatiotemporal coherent structures from high-dimensional data, benefiting from a strong connection to nonlinear dynamical systems via the Koopman operator. In this work, we integrate and unify two recent innovations that extend DMD to systems with actuation [Proctor et al., 2016] and systems with heavily subsampled measurements [Brunton et al., 2015]. When combined, these methods yield a novel framework for compressive system identification [code is publicly available at: https://github.com/zhbai/cDMDc]. It is possible to identify a low-order model from limited input-output data and reconstruct the associated full-state dynamic modes with compressed sensing, adding interpretability to the state of the reduced-order model. Moreover, when full-state data is available, it is possible to dramatically accelerate downstream computations by first compressing the data. We demonstrate this unified framework on two model systems, investigating the effects of sensor noise, different types of measurements (e.g., point sensors, Gaussian random projections, etc.), compression ratios, and different choices of actuation (e.g., localized, broadband, etc.). In the first example, we explore this architecture on a test system with known low-rank dynamics and an artificially inflated state dimension. The second example consists of a real-world engineering application given by the fluid flow past a pitching airfoil at low Reynolds number. This example provides a challenging and realistic test-case for the proposed method, and results demonstrate that the dominant coherent structures are well characterized despite actuation and heavily subsampled data.

97 MATHEMATICS AND COMPUTING↗

Method to measure orientation of discontinuous fiber embedded in the polymer matrix from computerized tomography scan data

Usage of discontinuous glass fibers in injection and compression molded resin components is rapidly increasing to improve their mechanical properties. Since added fiber contributes to more strength along the fiber direction compared to transverse direction, the mechanical properties of such components strongly depend on the fiber orientation. Thus it is important to estimate the fiber orientation distribution in such materials. Here, we are presenting recently developed method to estimate fiber orientation from 3D image of fibers generated using micro CT scan. Typically the 3D images from CT scan are very large and it becomes difficult to separate each fiber and extract end point information. In this paper a novel method to address this challenge is presented. The micro-CT images were broken into finite volume, reducing data size, and then each fiber was reduced to its own center line, further reducing the data size, using Mimics Innovation Suite (Materialise NV). These 3D centerlines were then used to quantify the 2nd order orientation tensor. Our results from the proposed method are compared with the measurements using well established industry standard approach called method of ellipses for validation. The key challenges in estimating the fiber orientation are identified and future improvements are proposed.

36 MATERIALS SCIENCE↗

Localized material compression to correct distortion in wire arc additive manufacturing

Wire Arc Additive Manufacturing (WAAM) is an advanced manufacturing technology which utilizes welding systems to generate three dimensional geometries in a layer-by-layer fashion. Distortion or warping of a print substrate and WAAM components due to thermally induced residual stresses is an ongoing challenge limiting the widespread adoption of WAAM technologies for producing components. In this manuscript, a novel approach is described to address thermal distortion in deposited components by applying lateral compressions along the length of the deposited material. To demonstrate this method, a series of single-track walls were printed and compressed at evenly spaced intervals using a modified hydraulic cutter tool. The jaws of the tool were modified to compress material rather than to shear it. A mathematical model was developed to relate the curvature of the deposited material to the volume of compression required to eliminate this distortion. Validation of this model was performed using 3D scan data to compare the change in wall curvature induced by compression to the volume of the applied compressions. Substrate deflection was also compared against a control wall, and implementation of wall compression reduced maximum deflections by 93% across a series of four depositions and subsequent compressions. Wall cross sections were also analyzed to determine the impact of compression on material hardness and grain structure. The results demonstrate that successively placed lateral compressions can effectively control and potentially eliminate bending distortion in printed parts. This methodology can be further developed to form a robust model for correction of thermally-induced distortion in WAAM components.

Additive manufacturing↗

4D Imaging of ZnO-Coated Nanoporous Al 2 O 3 Aerogels by Chemically Sensitive Ptychographic Tomography: Implications for Designer Catalysts

The 3D chemical structure (4D spectromicroscopy) of nanoporous Al 2 O 3 aerogels coated with ZnO by atomic layer deposition (ALD) was studied by multienergy scanning transmission X-ray microscopy. These materials are representative of a class of designer catalysts in which the nanoporous support is prepared separately from the active catalyst material, which is subsequently introduced by ALD, thereby allowing independent optimization of the morphology, chemistry, and spatial distribution of the support and catalyst. The samples studied were prepared by Ga ion and Xe plasma focused ion beam (FIB) milling as well as drop casting from water suspension. Zn L and Al K edge spectra of six samples with three different ZnO loadings were measured to investigate how loading and different sample preparation methods affect the 3D distribution of the ZnO and Al 2 O 3 . Scanning transmission X-ray microscopy (STXM) and ptychographic imaging at two energies each at the Zn L 3 and Al K edge were measured. The ptychography data were analyzed by using the SHARP reconstruction code to generate quantitative 2D chemical maps of the Al 2 O 3 and the ZnO. The STXM and ptychography maps were then measured at a sequence of tilt angles, covering up to 160° of rotation. The 3D structure of the ZnO and Al 2 O 3 was derived from the tilt series data by tomographic reconstruction using a compressed sensing algorithm. A twodimensional spatial resolution (half-period) of 6 nm, measured by Fourier ring correlation, and a 3D spatial resolution (half-period) of 9 nm, measured by Fourier shell correlation, were achieved when using the COSMIC beamline at the Advanced Light Source (ALS). The results show that for all of the ZnO loadings studied there is nonuniform coverage of the ZnO on the Al 2 O 3 aerogel framework. In addition, we found that both FIB methods create sample artifacts, although the distortion was less with Xe plasma than Ga ion FIB.

36 MATERIALS SCIENCE↗