Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

DESI 2024 V: Full-Shape galaxy clustering from galaxies and quasars

We present the measurements and cosmological implications of the galaxy two-point clustering using over 4.7 million unique galaxy and quasar redshifts in the range 0.1 < z < 2.1 divided into six redshift bins over a ∼ 7,500 square degree footprint, from the first year of observations with the Dark Energy Spectroscopic Instrument (DESI Data Release 1). By fitting the full power spectrum, we extend previous DESI DR1 baryon acoustic oscillation (BAO) measurements to include redshift-space distortions and signals from the matter-radiation equality scale. For the first time, this Full-Shape analysis is blinded at the catalogue-level to avoid confirmation bias and the systematic errors are accounted for at the two-point clustering level, which automatically propagates them into any cosmological parameter. When analyzing the data in terms of compressed model-agnostic variables, we obtain a combined precision of 4.7% on the amplitude of the redshift space distortion (RSD) signal reaching a similar precision with just one year of DESI data than with twenty years of observation from the previous generation survey. We also analyze the data to directly constrain the cosmological parameters within the ΛCDM model using perturbation theory and combine this information with the reconstructed DESI DR1 galaxy BAO. Using a Big Bang Nucleosynthesis Gaussian prior on the baryon density parameter, ω b , and a weak Gaussian prior on the spectral index, n s , we constrain the matter density is Ω m = 0.296±0.010 and the Hubble constant H 0 = (68.63 ± 0.79)[km s -1 Mpc -1 ]. Additionally, we measure the amplitude of clustering σ 8 = 0.841±0.034. The DESI DR1 galaxy clustering results are in agreement with the ΛCDM model based on general relativity with parameters consistent with those from Planck. The cosmological interpretation of these results in combination with DESI DR1 Ly-α forest data and external datasets are presented in the companion paper [1].

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Nanoscale defect evaluation framework combining real-time transmission electron microscopy and integrated machine learning-particle filter estimation

Observation of dynamic processes by transmission electron microscopy (TEM) is an attractive technique to experimentally analyze materials’ nanoscale phenomena and understand the microstructure-properties relationships in nanoscale. Even if spatial and temporal resolutions of real-time TEM increase significantly, it is still difficult to say that the researchers quantitatively evaluate the dynamic behavior of defects. Images in TEM video are a two-dimensional projection of three-dimensional space phenomena, thus missing information must be existed that makes image’s uniquely accurate interpretation challenging. Therefore, even though they are still a clustering high-dimensional data and can be compressed to two-dimensional, conventional statistical methods for analyzing images may not be powerful enough to track nanoscale behavior by removing various artifacts associated with experiment; and automated and unbiased processing tools for such big-data are becoming mission-critical to discover knowledge about unforeseen behavior. We have developed a method to quantitative image analysis framework to resolve these problems, in which machine learning and particle filter estimation are uniquely combined. The quantitative and automated measurement of the dislocation velocity in an Fe-31Mn-3Al-3Si autunitic steel subjected to the tensile deformation was performed to validate the framework, and an intermittent motion of the dislocations was quantitatively analyzed. The framework is successfully classifying, identifying and tracking nanoscale objects; these are not able to be accurately implemented by the conventional mean-path based analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2023

TopoSZ: Preserving Topology in Error-Bounded Lossy Compression

Existing error-bounded lossy compression techniques control the pointwise error during compression to guarantee the integrity of the decompressed data. However, they typically do not explicitly preserve the topological features in data. When performing post hoc analysis with decompressed data using topological methods, preserving topology in the compression process to obtain topologically consistent and correct scientific insights is desirable. In this paper, we introduce TopoSZ, an error-bounded lossy compression method that preserves the topological features in 2D and 3D scalar fields. Specifically, we aim to preserve the types and locations of local extrema as well as the level set relations among critical points captured by contour trees in the decompressed data. The main idea is to derive topological constraints from contour-tree-induced segmentation from the data domain, and incorporate such constraints with a customized error-controlled quantization strategy from the SZ compressor (version 1.4). In conclusion, our method allows users to control the pointwise error and the loss of topological features during the compression process with a global error bound and a persistence threshold.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1989

Toward an image compression algorithm for the high-resolution electronic still camera

Taking pictures with a camera that uses a digital recording medium instead of film has the advantage of recording and transmitting images without the use of a darkroom or a courier. However, high-resolution images contain an enormous amount of information and strain data-storage systems. Image compression will allow multiple images to be stored in the High-Resolution Electronic Still Camera. The camera is under development at Johnson Space Center. Fidelity of the reproduced image and compression speed are of tantamount importance. Lossless compression algorithms are fast and faithfully reproduce the image, but their compression ratios will be unacceptably low due to noise in the front end of the camera. Future efforts will include exploring methods that will reduce the noise in the image and increase the compression ratio.

Nerheim, Rosalee↗
DOE OSTI2021

An Experimental Study of Uncertainty Considerations Associated with Predicting Auto-ignition Timing using Livengood-Wu Integral Method

The application of the Livengood-Wu (LW) integral method as a tool to estimate knock onset in spark ignited (SI) engines and combustion phasing in advanced compression ignition (ACI) engines has been demonstrated through simulations several times. In this study, the effect of uncertainties associated with parameters required for the LW integral method, when used as a tool for model based control of ignition timing in an ACI engine, were experimentally studied using five full boiling range gasoline fuels. As a first step, the method was applied to experimental data from a rapid compression machine and it was found that the ability of the LW integral method to predict ignition timing was very sensitive to the performance of the chemical kinetic model of each fuel. The method was subsequently applied to experimental data from a single-cylinder gasoline engine with simple approximations for the LW integral input parameters, and it was found that the predicted time of ignition was significantly different from the actual start of combustion. Systematic evaluation of various parametric uncertainties conducted thereafter showed that the uncertainty in cylinder charge temperature has the greatest influence. Improved methods of estimating cylinder charge temperature are proposed to account for the previously determined corrections, to enable the use of the LW integral method for model based control of ignition timing.

Compression Ignition↗
NASA NTRS2014

Comparison of H+ and He+ Plasmapause Locations Based on Resurrected and Reevaluated OGO-5 Ion Composition Data Base

Orbiting Geophysical Observatory 5 (OGO 5) magnetospheric ion-composition data (H+, He+ and O+) from an ion spectrometer (Sharp, 1969) have been retrieved from old magnetic tapes archived at the National Space Science Data Center (NSSDC). The highly compressed binary format was converted into a user-friendly ASCII format and these data have been made available online. We have inspected reliability and consistency of this data set in state of the art current knowledge. Comparing with the climatological model IRI-2012 and the mathematical model FLIP a shift of absolute and relative ion densities with time was revealed. We have suggested a correction procedure of individual H+, He+ and O+ ion densities. Using the corrected data set, we investigated plasmapause locations based on density gradient in H+, and He+. Correlation coefficient of both locations was determined as approx. 0.886 and the typical difference (Delta)L approx. 0.1. The electron density at the He+ plasmapause location for all cases is >100/cu cm.

Plasmasphere↗
DOE OSTI2020

In situ X-ray spatial profiling reveals uneven compression of electrode assemblies and steep lateral gradients in lithium-ion coin cells

Coin cells are used extensively as test devices in battery research for evaluation of new materials and optimization of cycling protocols. Here, in situ X-ray diffraction profilometry is used to characterize spatial distribution of the active materials, lithiation, and phase distribution in electrodes of NCM523/graphite coin cells. The X-ray data indicate uneven areal compression of the electrode assembly in such cells, which we trace to a specific design feature that leads to elastic deformation of a metal spacer. Steep lithiation gradients observed in the electrodes imply radially-dependent resistivity, for which uneven compression of the separator is a likely cause. Electrochemical model calculations suggest that variable porosity of the polymer separator would account for the salient features of spatial profiles observed in these coin cells.

25 ENERGY STORAGE↗
NASA NTRS1988

Universality relationships in condensed matter - Bulk modulus and sound velocity

New forms for the bulk modulus and sound velocity of solids under compression, based on the universal equation of state of Vinet, Ferrante, Smith, and Rose (1987) are presented. These expressions are compared with a number of bulk modulus formulas previously utilized in high-pressure studies. It is demonstrated that this form yields a superior fit to experimental data to very high compressions, for a very wide range of solids. These solids cover the entire range of values of the pressure derivative of the bulk modulus which has been observed in high-pressure measurements.

Schlosser, Herbert↗
DOE OSTI2019

Evidence for Crystalline Structure in Dynamically-Compressed Polyethylene up to 200 GPa

Abstract We investigated the high-pressure behavior of polyethylene (CH 2 ) by probing dynamically-compressed samples with X-ray diffraction. At pressures up to 200 GPa, comparable to those present inside icy giant planets (Uranus, Neptune), shock-compressed polyethylene retains a polymer crystal structure, from which we infer the presence of significant covalent bonding. The A 2 /m structure which we observe has previously been seen at significantly lower pressures, and the equation of state measured agrees with our findings. This result appears to contrast with recent data from shock-compressed polystyrene (CH) at higher temperatures, which demonstrated demixing and recrystallization into a diamond lattice, implying the breaking of the original chemical bonds. As such chemical processes have significant implications for the structure and energy transfer within ice giants, our results highlight the need for a deeper understanding of the chemistry of high pressure hydrocarbons, and the importance of better constraining planetary temperature profiles.

36 MATERIALS SCIENCE↗
NASA NTRS1989

A comparison of select image-compression algorithms for an electronic still camera

This effort is a study of image-compression algorithms for an electronic still camera. An electronic still camera can record and transmit high-quality images without the use of film, because images are stored digitally in computer memory. However, high-resolution images contain an enormous amount of information, and will strain the camera's data-storage system. Image compression will allow more images to be stored in the camera's memory. For the electronic still camera, a compression algorithm that produces a reconstructed image of high fidelity is most important. Efficiency of the algorithm is the second priority. High fidelity and efficiency are more important than a high compression ratio. Several algorithms were chosen for this study and judged on fidelity, efficiency and compression ratio. The transform method appears to be the best choice. At present, the method is compressing images to a ratio of 5.3:1 and producing high-fidelity reconstructed images.

Nerheim, Rosalee↗
NASA NTRS1994

Fabric geometry distortion during composites processing

Waviness and tow misalignment are often cited as possible causes of data scatter and lower compression stiffness and strength in textile composites. Strength differences of as much as 40 percent have been seen in composites that appear to have the same basic material and structural properties -- i.e., yarn orientation, yarn size, interlacing geometry. Fabric geometry distortion has been suggested as a possible reason for this discrepancy, but little quantitative data or substantial evidence exists. The focus of this research is to contribute to the present understanding of the causes and effects of geometric distortion in textile composites. The initial part of the study was an attempt to gather qualitative information on a variety of textile structures. Existing and new samples confirmed that structures with a significant direction presence would be more susceptible to distortion due to the compaction process. Thus, uniweaves (fiber vol frac: 54-72 percent) biaxial braids (vf: 34-58 percent) demonstrated very little fabric geometry distortion. In stitched panels, only slight buckling of z-direction stitches was observed, primarily near the surface. In contrast, for structures with high compaction ratios -- e.g., large cylindrical yarns (2.5:1) orpowder towpreg (4:1) -- there were visible distortions where previously smooth and periodic undulations were transformed to abrupt changes in direction. A controlled study of the effect of forming pressure on distortion was conducted on type 162 glass plain weave fabrics. Panels (6 x 6 in) were produced via a resin infusion type setup, but with an EPON 815 epoxy resin. Pressures ranging from hand layup to 200 psi were used (vf: 34-54 percent). Photomicrographs indicated that at pressures up to 50 psi, large changes in thickness were due primarily to resin squeeze out. At higher pressures, when intimate contact was made between the layers, there was some tow flattening and in-plane shifting to optimize nesting. However, even at 200 psi the period and amplitude of the tow undulation remained constant, suggesting that for this relatively fine fabric, distortions from compaction were not a problem. Because of the interest in using larger tows (to reduce cost) and more complex structures, tests were also run on 2D triaxial glass braid (113 yd/lb at 0, 225 yd/lb at +/- 45). Forming pressures of 20, 50, 200, and 500 psi were used, and short block compression tests were run. The 500 psi specimen had a 10 percent decrease in modulus and an almost 50 percent decrease in strength (vs. 20 psi). Because the total fiber wgt/panel was kept constant, the thickness varied from 0.32 to 0.22 in (49-70 percent vf). Yet, the strength value is clearly below what would be expected, even with the decrease in thickness. Photomicrographs of these samples will be taken to determine if more fabric distortion exists in the 500 psi specimens. Finally, because the ultimate goal is to be able to predict and control distortion in a variety of textile structures, a model compaction test was developed to directly measure the deformation of the tows during compaction. Layers of dry glass fabric were placed in a mold with a clear plexiglass window. The yarn amplitude and period was then calculated using image analysis of the videotaped deformation. Preliminary tests demonstrated the feasibility of this technique for simple fabrics with large tows.

Chen, Julie↗
DOE OSTI2021

A case study on parallel HDF5 dataset concatenation for high energy physics data analysis

In High Energy Physics (HEP), experimentalists generate large volumes of data that, when analyzed, helps us better understand the fundamental particles and their interactions. This data is often captured in many files of small size, creating a data management challenge for scientists. In order to better facilitate data management, transfer, and analysis on large scale platforms, it is advantageous to aggregate data further into a smaller number of larger files. However, this translation process can consume significant time and resources, and if performed incorrectly the resulting aggregated files can be inefficient for highly parallel access during analysis on large scale platforms. In this paper, we present our case study on parallel I/O strategies and HDF5 features for reducing data aggregation time, making effective use of compression, and ensuring efficient access to the resulting data during analysis at scale. We focus on NOvA detector data in this case study, a large-scale HEP experiment generating many terabytes of data. Here, the lessons learned from our case study inform the handling of similar datasets, thus expanding community knowledge related to this common data management task.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1999

High Data Rate Instrument Study

The High Data Rate Instrument Study was a joint effort between the Jet Propulsion Laboratory (JPL) and the Goddard Space Flight Center (GSFC). The objectives were to assess the characteristics of future high data rate Earth observing science instruments and then to assess the feasibility of developing data processing systems and communications systems required to meet those data rates. Instruments and technology were assessed for technology readiness dates of 2000, 2003, and 2006. The highest data rate instruments are hyperspectral and synthetic aperture radar instruments which are capable of generating 3.2 Gigabits per second (Gbps) and 1.3 Gbps, respectively, with a technology readiness date of 2003. These instruments would require storage of 16.2 Terebits (Tb) of information (RF communications case of two orbits of data) or 40.5 Tb of information (optical communications case of five orbits of data) with a technology readiness date of 2003. Onboard storage capability in 2003 is estimated at 4 Tb; therefore, all the data created cannot be stored without processing or compression. Of the 4 Tb of stored data, RF communications can only send about one third of the data to the ground, while optical communications is estimated at 6.4 Tb across all three technology readiness dates of 2000, 2003, and 2006 which were used in the study. The study includes analysis of the onboard processing and communications technologies at these three dates and potential systems to meet the high data rate requirements. In the 2003 case, 7.8% of the data can be stored and downlinked by RF communications while 10% of the data can be stored and downlinked with optical communications. The study conclusion is that only 1 to 10% of the data generated by high data rate instruments will be sent to the ground from now through 2006 unless revolutionary changes in spacecraft design and operations such as intelligent data extraction are developed.

Schober, Wayne↗
DOE OSTI2023

Soot Formation and Ignition Characteristics of Ethanol/Gasoline Blends in a Rapid Compression Machine

With the ever-increasing demand for sustainable energy, alcohol fuels have garnered interest for use in heavy duty engines. The significant infrastructure for ethanol production and blending of ethanol with gasoline make these fuels/fuel blends desirable candidates. However, development of heavy duty engine technology that is capable of burning alcohol fuels while retaining the advantages of traditional diesel combustion requires an improved understanding of the soot formation for these fuels under conditions relevant to mixing-controlled combustion. This work uses an extinction diagnostic to study the sooting tendency of ethanol and gasoline/ethanol blends ranging from E10 to E98 during ignition in a homogeneous environment. Experiments were conducted in a rapid compression machine (RCM) for compressed conditions of 20 ± 1 bar and an approximately constant temperature (± 10K) which was unique for each fuel. For a given soot volume fraction, a linear relationship was observed between ethanol content and the equivalence ratio in which that soot volume fraction was formed. Accounting for the oxygenated nature of ethanol, E85 and E98 fuels produced similar amounts of soot at a given Φ ox, , suggesting other factors outside of fuel oxygen content, such as fuel morphology, impact soot formation. Ignition delay data is reported for compressed pressures of 20 ± 1 bar and compressed temperatures ranging from 633 – 670 K for E10 and 771 – 789 K for E98. Varying pressures for E10 and E98 at conditions producing similar soot volume fractions demonstrated a linear dependence of soot formation on pressure, regardless of if the pressure considered was at top dead center or peak combustion pressure. Furthermore, the data gleaned from this work will be used to select soot models and chemical kinetic mechanisms for RCM simulations to ultimately model heavy duty engine technology with the studied fuels.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Error-controlled Progressive Retrieval of Scientific Data under Derivable Quantities of Interest

The unprecedented amount of scientific data has introduced heavy pressure on the current data storage and transmission systems. Progressive compression has been proposed to mitigate this problem, which offers data access with on-demand precision. However, existing approaches only consider precision control on primary data, leaving uncertainties on the quantities of interest (QoIs) derived from it. In this work, we present a progressive data retrieval framework with guaranteed error control on derivable QoIs. Our contributions are three-fold. (1) We carefully derive the theories to strictly control QoI errors during progressive retrieval. Our theory is generic and can be applied to any QoIs that can be composited by the basis of derivable QoIs proved in the paper. (2) We design and develop a generic progressive retrieval framework based on the proposed theories, and optimize it by exploring feasible progressive representations. (3) We evaluate our framework using five real-world datasets with a diverse set of QoIs. Experiments demonstrate that our framework can faithfully respect any user-specified QoI error bounds in the evaluated applications. This leads to over 2.02× performance gain in data transfer tasks compared to transferring the primary data while guaranteeing a QoI error that is less than 1E-5.

Wu, Xuan↗