Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

A chemical/mineralogical investigation of the behavior of sulfoaluminate binders submitted to accelerated carbonation

The paper addresses the carbonation of CSA based binders from the mechanical, chemical and mineralogical point of view. Three different binders have been investigated, revealing that many hydrated phases can protect ettringite against carbonation. In particular, the presence of AFm phases gives a significant contribution to buffer the pH in alkaline range and to preserve the protective film of steel reinforcement bars. In a carbonated environment AFm phases act as ionic exchangers: carbonate ions replace sulfates in the interlayer and in these conditions the released sulfate ions contribute to the formation of new ettringite, with a beneficial effect on compressive strength performances. Experimental data are compared with models and carbonation mechanisms are described.

36 MATERIALS SCIENCE↗
NASA NTRS1971

Compressed gas handbook

Handbook includes thermodynamic and related fluid flow data required to analyze high pressure compressible and incompressible fluid systems. Some theory and applications include thermodynamic fundamentals, gas behavior, adiabatic and isentropic flow, shock waves, flow measurement, and adiabatic and isothermal friction flow in pipes.

Cota, R. A.↗
NASA NTRS1972

Source deck compression and update program (CAPS)

Computer program for compressing program source decks and other data coded in Hollerith format is described. Compression of card image record by substitution of special code characters is discussed. Program is written for IBM 360/75/95 Release 19 computer.

Merrill, E. O.↗
DOE OSTI2019

Parallel membership queries on very large scientific data sets using bitmap indexes

© 2019 John Wiley & Sons, Ltd. Many scientific applications produce very large amounts of data as advances in hardware fuel computing and experimental facilities. Managing and analyzing massive quantities of scientific data is challenging as data are often stored in specific formatted files, such as HDF5 and NetCDF, which do not offer appropriate search capabilities. In this research, we investigated a special class of search capability, called membership query, to identify whether queried elements of a set are members of an attribute. Attributes that naturally have classification values appear frequently in scientific domains such as category and object type as well as in daily life such as zip code and occupation. Because classification attribute values are discrete and require random data access, performing a membership query on a large scientific data set creates challenges. We applied bitmap indexing and parallelization to membership queries to overcome these challenges. Bitmap indexing provides high performance not only for low cardinality attributes but also for high cardinality attributes, such as floating-point variables, electric charge, or momentum in a particle physics data set, due to compression algorithms such as Word-Aligned Hybrid. We conducted experiments, in a highly parallelized environment, on data obtained from a particle accelerator model and a synthetic data set.

Yildiz, Beytullah↗
DOE OSTI2023

Refined room-temperature equation of state of Bi up to 260 GPa

At room temperature, bismuth undergoes several structural transitions with increasing pressure before taking on a body-centered cubic (bcc) phase at approximately 8 GPa. The bcc structure is stable to the highest measured pressure and its simplicity, along with its high compressibility and atomic number, makes it an enticing choice as a pressure calibrant. Here, we present three data sets on the compression of bismuth in a diamond anvil cell in a neon pressure medium, up to a maximum pressure of about 260 GPa. The use of a soft pressure medium reduces deviatoric stress when compared to previous work. With an expanded pressure range, a higher point density, and a decreased uniaxial stress component, we are able to provide more reliable equation of state parameters. We also conduct density functional theory electronic-structure calculations that confirm that the bcc phase is energetically favored at high pressure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Shock Hugoniot measurements of single-crystal 1,3,5-triamino-2,4,6-trinitrobenzene (TATB) compressed to 83 GPa

We present laser-driven shock Hugoniot measurements of single-crystal (SC) 1,3,5-triamino-2,4,6-trinitrobenzene (TATB) between 15 and 83 GPa, spanning pressures below and well above the Chapman–Jouguet pressure of ~28 GPa for TATB formulations (TATB grains mixed with plastic binders at 5–10 wt. %). The new SC data are generally ~3% more compressible than previously published data on neat and formulated TATB measured in gas-gun and explosive-driven experiments. An exception is at compressions in the density of ~1.5 (~30–40 GPa), where our new SC data exhibit significantly lower pressures than previous results on overdriven TATB formulations, suggesting that our SC samples remain largely unreacted below 35 GPa over the short nanosecond-time scales inherent to our laser-driven experiments. We report these novel equation-of-state measurements are a critical step toward understanding TATB in its most fundamental form and improving predictive modeling of TATB-based explosives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Experimental Study of the Fundamental Properties of Warm Dense Mixtures

The aim of the proposed research was to provide a multi-scale study of the properties of warm dense hydrocarbons, by studying the thermodynamic properties through the equation of state and the microscopic properties by x-ray scattering. Understanding the fundamental properties of warm dense mixtures is an intellectual challenge due to the complexity of the system. Unlike liquids or gases, where constituent particle interactions occur through collisions or bonding between valence electrons, in these strongly coupled systems the atoms will be partially ionized and compressed so tightly together that interactions between the inner core electrons can play a role in the systems chemistry. Advances in computational capabilities and development of new theoretical models have been used to predict the properties of mixtures but there is currently no experimental data of the fundamental interaction between the particles in mixtures to test these predictions against. The proposed research was to experimentally investigate the interaction of the different species in hydrocarbons by measuring the compressibility of substances with different carbon and hydrogen ratios and the complexity of the microscopic interactions through elastic and inelastic x-ray scattering. To study the bulk properties of warm dense hydrocarbons we established the Warm Dense Matter Research Laboratory (WDMRL) in the Institute for Shock Physics at Washington State University. The goal was for experiments in the WDMRL to determine shock loading conditions of interest in the hydrocarbon mixtures. We planned on using Hugoniot EOS measurements and a range of carbon and hydrogen concentrations to determine conditions when the EOS of the mixture varied significantly from that of the classical mixing model. Even though shock transit measurements through aluminum foils suggested pressures upto 400GPa, the experiments in the WDMRL were unsuccessful in getting usable shockwave compression data above 100GPa in polystyrene which was below the pressure of interest for hydrocarbon mixtures (>200GPa). To complete the project, we tested a technique using x-ray phase contrast imaging to map the location of tracer layers in a test sample of polycarbonate to record the material motion in dynamically compressed samples. A technique that will be useful for future warm dense matter experiments. These experiments used <200nm gold layers in polycarbonate samples to measure the material velocity and shock speed using x-ray phase contrast imaging. These results were compared to continuum surface measurements performed at ISP and show that the tracer layer technique can measure hydrodynamic properties accurately in dynamically compressed materials.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Accelerating Relative-error Bounded Lossy Compression for HPC datasets with Precomputation-Based Mechanisms

Scientific simulations in high-performance computing (HPC) environments are producing vast volume of data, which may cause a severe I/O bottleneck at runtime and a huge burden on storage space for post-analysis. Unlike the traditional data reduction schemes (such as deduplication or lossless compression), not only can error-controlled lossy compression significantly reduce the data size but it can also hold the promise to satisfy user demand on error control. Point-wise relative error bounds (i.e., compression errors depends on the data values) are widely used by many scientific applications in the lossy compression, since error control can adapt to the precision in the dataset automatically. Point-wise relative error bounded compression is complicated and time consuming. In this work, we develop efficient precomputation-based mechanisms in the SZ lossy compression framework. Our mechanisms can avoid costly logarithmic transformation and identify quantization factor values via a fast table lookup, greatly accelerating the relative-error bounded compression with excellent compression ratios. In addition, our mechanisms also help reduce traversing operations for Huffman decoding, and thus significantly accelerate the decompression process in SZ. Experiments with four well-known real-world scientific simulation datasets show that our solution can improve the compression rate by about 30% and decompression rate by about 70% in most of cases, making our designed lossy compression strategy the best choice in class in most cases.

compression rate↗
NASA NTRS1991

The use of direct numerical simulation data in turbulence modeling

Direct numerical simulations (DNS) of turbulent flows provide a complete data base to develop and to test turbulence models. In this article, the progress made in developing models for the dissipation rate equation is reviewed. New scaling arguments for the various terms in the dissipation rate equation were tested using data from DNS of homogeneous shear flows. Modifications to the epsilon-equation model that take into account near-wall effects were developed using DNS of turbulent channel flows. Testing of new models for flows under mean compression was carried out using data from DNS of isotropically compressed turbulence. In all of these studies the data from the simulations was essential in guiding the model development. The next generation of DNS will be at higher Reynolds numbers, and will undoubtedly lead to improved models for computations of flows of practical interest.

Mansour, N. N.↗
DOE OSTI2023

Development and evaluation of a skeletal mechanism for EHN additized gasoline mixtures in large Eddy simulations of HCCI combustion

Advanced Low Temperature Combustion modes, such as the Sandia proposed Additive-Mixing Fuel Injection (AMFI), can unlock significant potential to boost fuel conversion efficiency and ultimately improve the energy conversion of internal combustion engines. This is a novel improved combustion process that is enabled by supplying small (<5%) variable amounts of autoignition improver to the fuel to enhance the engine operation and control. Common, diesel-fuel ignition-quality enhancing additive, 2-ethylexyl nitrate (EHN), is doped into gasoline to enable Sandia LTGC + AMFI combustion. This manuscript focuses on the development of a reduced sub-mechanism for EHN chemical kinetics at engine relevant conditions that is implemented into a skeletal mechanism for chemical kinetic studies of gasoline surrogate fuels. The mechanism validation utilized zero-dimensional numerical simulations and comparison to shock tube ignition-delay data of pure and EHN-doped n-heptane. Additional validation is presented with Homogeneous Charge Compression-Ignition (HCCI) engine data of pure and EHN-doped research-grade E10 gasoline. Then, the mechanism was deployed in a 3-D computational fluid dynamics (CFD) using Large Eddy Simulations (LES) to model the HCCI engine experiments of 0.4% vol EHN additized E10 gasoline at several equivalence ratios. Simulations showed a very good performance of the mechanism, and the model accurately reproduced (a) the ignition point, (b) combustion phasing, (c) combustion duration, and (d) the peak of the heat release rates of the engine experiments. The results show that EHN promotes Low-Temperature Heat Release, ultimately driving the gasoline to autoignite at thermodynamic conditions where the fuel would not otherwise ignite. Overall, this work demonstrates a viable reduced chemical-kinetic mechanism for EHN and shows that it can be combined with a skeletal gasoline mechanism for CFD-LES analysis of well-mixed LTGC that matches well with experimental results. The CFD-LES analysis also shows the spatial distribution of EHN-fuel interactions that control the autoignition throughout the combustion chamber.

Guleria, Gaurav↗
DOE OSTI2018

DuoModel: Leveraging Reduced Model for Data Reduction and Re-Computation on HPC Storage

High-performance computing (HPC) applications generate large amounts of floating-point data that need to be stored and analyzed efficiently to extract the insights and advance knowledge discovery. With the growing disparities between compute and I/O, optimizing the storage stack alone may not suffice to cure the I/O problem. There has been a strong push in the HPC communities to perform data reduction before data is transmitted to storage in order to lower the I/O cost. However, as of now, neither lossless nor lossy compressors can achieve the adequate reduction ratio that is desired by applications. This paper proposes DuoModel, a new approach that leverages the similarity between the full and reduced application models, and further improve the data reduction ratio. DouModel further improves the compression ratio of state-of-the-art compressors via compressing the differences (termed as delta) between the data products of the two models. For data analytics, the high fidelity data can be re-computed by launching the reduced model and applying the compressed delta. Our evaluations confirm that DuoModel can further push the limit of data reduction while the high fidelity of data is maintained.

Luo, Huizhang (ORCID:0000000323920267)↗
NASA NTRS1981

End-to-end quality measure for transmission of compressed imagery over a noisy coded channel

For the transmission of imagery at high data rates over large distances with limited power and system gain, it is usually necessary to compress the data before transmitting it over a noisy channel that uses channel coding to reduce the effect of noise introduced errors. Both compression and channel noise introduce distortion into the imagery. In order to design a communication link that provides adequate quality of received images, it is necessary first to define some suitable distortion measure that accounts for both these kinds of distortion and then to perform various tradeoffs to arrive at system parameter values that will provide a sufficiently low level of received image distortion. The overall mean square error is used as the distortion measure and a description of how to perform these tradeoffs are included.

Korwar, V. N.↗
DOE OSTI2017

Extending Skel to Support the Development and Optimization of Next Generation I/O Systems

As the memory and storage hierarchy get deeper and more complex, it is important to have new benchmarks and evaluation tools that allow us to explore the emerging middleware solutions to use this hierarchy. Skel is a tool aimed at automating and refining this process of studying HPC I/O performance. It works by generating application I/O kernel/benchmarks as determined by a domain-specific model. This paper provides some techniques for extending Skel to address new situations and to answer new research questions. For example, we document use cases as diverse as using Skel to troubleshoot I/O performance issues for remote users, refining an I/O system model, and facilitating the development and testing of a mechanism for runtime monitoring and performance analytics. We also discuss data oriented extensions to Skel to support the study of compression techniques for Exascale scientific data management.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Data for: Patel et al. Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data

This dataset contains data and code used for the paper "Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data" [DOI COMING SOON]A large literature exists on mechanisms driving soil production of the greenhouse gases CO2 and CH4. Measurements of these gases’ fluxes are often performed using closed-chamber incubations in the laboratory or in situ, i.e., in the field. Although it is common knowledge that measurements obtained through field studies vs. laboratory incubations can diverge because of the vastly different conditions of these environments, few studies have systematically examined these patterns. It is crucial to understand the magnitude and reasons for any differences, as these data are used to parametrize and benchmark ecosystem- to global-scale models, which are then susceptible to the biases of the source data. Here, we specifically examine how greenhouse gas measurements may be influenced by whether the measurement/incubation was conducted in the field vs. laboratory, focusing on CO2 and CH4 measurements. We use Q10 of greenhouse gas flux (temperature sensitivity) for our analyses, because of the ubiquity of this metric in biological and Earth system sciences and its importance to many modeling frameworks. We predicted that laboratory measurements would be less variable, but also less representative of true field conditions. However, there was greater variability in the Q10 values calculated from lab-based measurements of CO2 fluxes, because lab experiments explore extremes rarely seen in situ, and reflect the physical and chemical disturbances occurring during sampling, transport, and incubation. Overall, respiration Q10 values were significantly greater in laboratory incubations (mean = 4.19) than field measurements (mean = 3.05), with strong influences of incubation temperature and climate region/biome. However, this was in part because field measurements typically represent total respiration (Rs), whereas lab incubations typically represent heterotrophic respiration (Rh), making direct comparisons difficult to interpret. Focusing only on Rh-derived Q10, these values showed almost identical distributions across laboratory (n = 1110) and field (n = 581) experiments, providing strong support for using the former as an experimental proxy for the latter, although we caution that geographic biases in the extant data make this conclusion tentative. Due to a smaller sample size of CH4 Q10 data, we were unable to perform a comparable robust analysis, but we expect similar interactions with soil temperature, moisture, and environmental/climatic variables. Our results here suggest the need for more concerted efforts to document and standardize these data, including sample and site metadata. This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/field_lab_q10 (DOI: 10.5281/zenodo.7106554).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Interpreting strain tensor data to characterize and monitor reservoirs for CO2 storage and other applications

Recent advances in instrumentation have made it feasible to measure the transient strain tensor caused by small changes in fluid volume or pressure in the subsurface and this has opened the door to new opportunities for characterization and monitoring. We have deployed strainmeters and then conducted injection well tests in an underlying reservoir at 530m depth. The resulting data indicated that the horizontal strain at shallow strainmeters (30 to 40m depth) was tensile and the vertical strain was compressive. The radial strain was less than the horizontal strain, and the strain rates decreased from 100 nanostrain/day to roughly 10 n/d over a few days. The signal at two strainmeters at shallow depth were consistent, although the magnitude of the horizontal strains were different reflecting the different radial directions from the well. The signal at a deep strainmeter deployed at reservoir depth was much different, with tensile vertical strains and compressive horizontal strains. These data can be interpreted by inverting poroelastic forward models developed using numerical and analytical methods. The average horizontal strain in the caprock resembles the transient pressure in the underlying reservoir and classic type-curve methods from transient well testing can be used for preliminary interpretations of strain data. We have developed closed-form analytical solutions to a pressurized poroelastic inclusion and inhomogeneity in a half-space. This model is fast and can be inverted to estimate reservoir stiffness and geometry. Numerical models developed using finite element methods allow more details of the subsurface to be included in the inversion, but they require much longer run times and this makes inversion cumbersome using standard methods. We have developed an inversion approach that uses a proxy model created using machine learning to do most of the forward calculations. The proxy model is periodically updated and refined using the finite element model to ensure accuracy. This approach significantly reduces the computational requirements and makes it feasible to use Bayesian inversion with large numerical models. We have shown that the strain tensor in the caprock is sensitive to pressure in the reservoir, boundaries in the reservoir, and pressure in the caprock caused by leaks. These results indicate that coupling strain tensor data with inversion has the potential to help evaluate reservoirs during initial characterization, and to monitor them during the CO2 injection and storage process.

Murdoch, Larry↗
NASA NTRS1975

Development of procedures for calculating stiffness and damping properties of elastomers. Part 3: The effects of temperature, dissipation level and geometry

Effects of temperature, dissipation level and geometry on the dynamic behavior of elastomer elements were investigated. Force displacement relationships in elastomer elements and the effects of frequency, geometry and temperature upon these relationships are reviewed. Based on this review, methods of reducing stiffness and damping data for shear and compression test elements to material properties (storage and loss moduli) and empirical geometric factors are developed and tested using previously generated experimental data. A prediction method which accounts for large amplitudes of deformation is developed on the assumption that their effect is to increase temperature through the elastomers, thereby modifying the local material properties. Various simple methods of predicting the radial stiffness of ring cartridge elements are developed and compared. Material properties were determined from the shear specimen tests as a function of frequency and temperature. Using these material properties, numerical predictions of stiffness and damping for cartridge and compression specimens were made and compared with corresponding measurements at different temperatures, with encouraging results.

Smalley, A. J.↗
NASA NTRS1980

Measurements of Unsteady Vortex Flowfields

A combined surface hot film and laser velocimeter measurement technique has been developed for the study of time-dependent turbulent flows. Data obtained in a compressible cylinder wake (M(sub infinity) = 0.6) are presented, and its structure in both the Eulerian and Lagrangian frames is discussed. Turbulence data obtained by conventional and phase averaging of the velocity fluctuations provide details of the small- and large-scale contributions to the total turbulent field.

Owen, F. K.↗
DOE OSTI2023

Discussion on “Saving Storage in Climate Ensembles: A Model-Based Stochastic Approach”

Abstract We thank the authors for this interesting paper that highlights important ideas and concepts for the future of climate model ensembles and their storage, as well as future uses of stochastic emulators. Stochastic emulators are particularly relevant because of the statistical nature of climate model ensembles, as discussed in previous work of the authors (Castruccio et al. in J Clim 32:8511–8522, 2019; Hu and Castruccio in J Clim 34:8409–8418, 2021). We thank the authors for sharing of some of their data with us in order to illustrate this discussion. In the following, in Sect. 1 we discuss alternative techniques currently used and studied, namely lossy compression and ideas emerging from the climate modeling community, that could feed the discussion on ensemble and storage. In that section, we also present numerical results of compression performed on the data shared by the authors. In Sect. 2, we discuss the current statistical model proposed by the authors and its context. We discuss other potential uses of stochastic emulators in climate and Earth modeling.

97 MATHEMATICS AND COMPUTING↗