Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Effect of particle characteristics on the evolution of particle size, particle morphology, and fabric of sands loaded under uniaxial compression

This work presents the results and analyses of uniaxial compression experiments performed on three silica sands. The sands have comparable particle-size distributions, but their particles differ in morphology and strength. Cylindrical samples of the three sands were compressed in a loading device placed inside an X-ray microscope (XRM) and scanned at multiple stress levels during uniaxial compression. 3D tomography data of the samples obtained from the XRM at different stress levels were then analyzed to obtain the distributions of particle size, particle morphology, and interparticle contact normals within the sample. Results indicate that: (1) the compressibility of the sands loaded under uniaxial compression is closely tied to particle morphology and strength and (2) the anisotropy in the orientations of interparticle contact normals generally increases with axial stress; however, this increase is limited by the occurrence of particle crushing in the sample.

3D X-ray computed tomography↗
DOE OSTI2026

Compressive Response and Energy Absorption of Additively Manufactured Elastomers with Varied Simple Cubic Architectures

Additive manufacturing, and particularly the vat photopolymerization process, enables the fabrication of complex geometries at high resolution and small length scales, making it well-suited for fabricating cellular structures (e.g., foams and lattices). Among these, elastomeric cellular structures are of growing interest due to their tunable compliance and energy dissipation. However, comprehensive data on the compressive behavior of these structures remains limited, especially for investigating the structure-property effects from changing the density and distribution of material within the cellular structure. This study explores how the mechanical response of polyurethane-based simple cubic structures changes when varying volume fraction, unit cell length, and unit cell patterning, which have not been systematically investigated previously in additively manufactured elastomers. Increasing volume fraction from 10% to 50% yielded significant changes in compressive stress–strain performance (decreasing strain at 0.5 MPa by 41.6% and increasing energy absorption density by 3962.5%). Although changing the unit cell length between 2.5 and 7 mm in ~30 mm parts did not result in statistically different stress–strain responses, modifying the configuration of struts of different thicknesses across designs with 30% volume fraction altered the stress–strain behavior (differences of 12.5% in strain at 0.5 MPa and 109.4% for energy absorption density). Power law relationships were developed to understand the interactions between volume fraction, unit cell length, and elastic modulus, and experimental data showed strong fits (R 2 > 0.91). These findings enhance the understanding of how multiple structural design aspects influence the performance of elastomeric cellular materials, providing a foundation for informing strategic design of tailorable materials for diverse mechanical applications.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Application of the van der Pauw method for electrical conductivity measurements at high temperatures using an insulating compressing ring

High quality data on the high temperature electrical properties of ceramics, particularly oxides, is of great value for material selection, design, and modeling for a broad range of emerging applications. Utilizing the mismatch in the coefficient of thermal expansion between two materials, a purely mechanical method for establishing electrical contact in the van der Pauw geometry to measure the bulk resistivity of ceramic disks at high temperatures is presented. Measurements of a reference material, 20 mol. % Gd-doped cerium oxide, are presented up to 1000 °C. The viability of electrical measurements up to a maximum temperature of 1600 °C is also considered. Measurements are performed using multiple techniques and compared to literature values finding excellent agreement. Finally, the approach described in this work enables the van der Pauw method to be applied to many ceramic materials over a wide range of temperatures and environments.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Technical Report: Accessor Realization

As we have seen the arithmetic power of hardware architectures growing much faster than the memory bandwidth, there is an urgent need to rethink the way we operate, communicate, and store data. A promising strategy for overcoming the “memory wall” is the decoupling of memory precision from arithmetic precision as proposed in Anzt et al.. Such a decoupling of memory precision and arithmetic precision requires a “memory accessor” that handles the conversion between formats (resp. compression of the data) on the fly in registers. For such a memory accessor to be useful in practice, it has to combine multiple characteristics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Scalable Incremental Checkpointing using GPU-Accelerated De-Duplication

Writing large amounts of data concurrently to stable storage is a typical I/O pattern of many HPC workflows. This pattern introduces high I/O overheads and results in increased storage space utilization especially for workflows that need to capture the evolution of data structures with high frequency as checkpoints. In this context, many applications, such as graph pattern matching, perform sparse updates to large data structures between checkpoints. For these applications, incremental checkpointing techniques that save only the differences from one checkpoint to another can dramatically reduce the checkpoint sizes, I/O bottlenecks, and storage space utilization. However, such techniques are not without challenges: it is non-trivial to transparently determine what data has changed since a previous checkpoint and assemble the differences in a compact fashion that does not result in excessive metadata. State-of-art data reduction techniques (e.g., compression and de-duplication) have significant limitations when applied to modern HPC applications that leverage GPUs: slow at detecting the differences, generate a large amount of metadata to keep track of the differences, and ignore crucial spatiotemporal checkpoint data redundancy. This paper addresses these challenges by proposing a Merkle tree-based incremental checkpointing method to exploit GPUs' high memory bandwidth and massive parallelism. Experimental results at scale show a significant reduction of the I/O overhead and space utilization of checkpointing compared with state-of-the-art incremental checkpointing and compression techniques.

Tan, Nigel↗
DOE OSTI2020

A data-driven approach to sampling matrix selection for compressive sensing

Sampling is a fundamental aspect of any implementation of compressive sensing. Typically, the choice of sampling method is guided by the reconstruction basis. However, this approach can be problematic with respect to certain hardware constraints and is not responsive to domain-specific context. We propose a method for defining an order for a sampling basis that is optimal with respect to capturing variance in data, thus allowing for meaningful sensing at any desired level of compression. We focus on the Walsh-Hadamard sampling basis for its relevance to hardware constraints, but our approach applies to any sampling basis of interest. We illustrate the effectiveness of our method on the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset, the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset, and a Colorado State University Swiss Ranger depth image dataset. The spectral datasets consist of simulant experiments, including releases of chemicals such as GAA and SF6. We combine our sampling and reconstruction with the adaptive coherence estimator (ACE) and bulk coherence for chemical detection and we incorporate an algorithmic threshold for ACE values to determine the presence or absence of a chemical. We compare results across sampling methods in this context. We have successful chemical detection at a compression rate of 90%. For all three datasets, we compare our sampling approach to standard orderings of sampling basis such as random, sequency, and an analog of sequency that we term `frequency.' In one instance, the peak signal to noise ratio was improved by over 30% across a test set of depth images.

compressive sensing, hyperspectral imaging, Walsh-↗
DOE OSTI2023

CODAS Data from Oliktok Point, Beaufort Sea, Alaska

Cryosphere/Ocean Distributed Acoustic Sensing (CODAS) data collected from the Beaufort Sea, Alaska, using ~37.4 km of dark telecommunications fiber located at Oliktok Point, Alaska. Data were collected with a Silixa iDAS, using 10 m gauge length, 2 m spatial resolution, and 1000 Hz sample rate. Provided here are the DAS-recorded time series for the rapid refreeze event described in Baker & Abbott (2022) (see link below). This covers a date range of 2021-11-10 15:00 UTC to 2021-11-11 17:00 UTC. Data have been decimated to 100 Hz and 20 m (i.e., every 10th channel for 1831 channels, total), as used in Baker & Abbott (2022). Data have been extracted from raw format into 1-hour long .sac* files and organized into directories by channel number, spanning channels 100 to 18400. Time series units are nano-strainrate (nm/m/s). For distribution, data have been compressed into .zip files containing all time series files for 100 channels. *For information on the Seismic Analysis Code (SAC) file format: https://seiscode.iris.washington.edu/projects/sac

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗
DOE OSTI2025

A surprising proliferation of detwinning in β -tin at extreme loading rates

Integrating data from dynamic compression experiments of condensed matter across three national laboratories has led to insight and quantitative calibration of materials strength over decades of loading rate. For many materials, a single strength model (such as PTW) is sufficient to capture the flow-stress strain rate relationship which is monotonic. Here, we show here that β -tin, a tetragonal metal, exhibits dramatic deviations from this behavior. Naive fitting to a single PTW model is insufficient to capture the behavior; indeed, such resulting inferred flow stress versus strain exhibits a non-monotonic behavior. We suggest a resolution to this by proposing that in β -tin there are important Bauschinger effects arising from favorable conditions for twinning and detwinning. A simple yield surface model when paired with PTW hardening captures the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗
DOE OSTI2025

High-performance data format for scientific data storage and analysis

Here, in this article, we present the High-Performance Output (HiPO) data format developed at Jefferson Laboratory for storing and analyzing data from Nuclear Physics experiments. The format was designed to efficiently store large amounts of experimental data, utilizing modern fast compression algorithms. The purpose of this development was to provide organized data in the output, facilitating access to relevant information within the large data files. The HiPO data format has features that are suited for storing raw detector data, reconstruction data, and the final physics analysis data efficiently, eliminating the need to do data conversions through the lifecycle of experimental data. The HiPO data format is implemented in C++ and JAVA, and provides bindings to FORTRAN, Python, and Julia, providing users with the choice of data analysis frameworks to use. In this paper, we will present the general design and functionalities of the HiPO library and compare the performance of the library with more established data formats used in data analysis in High Energy and Nuclear Physics (such as ROOT and Parquete). In columnar data analysis, HiPO surpasses established data formats in performance and can be effectively applied to data analysis in other scientific fields.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Calibrating the SPECTACULAR constitutive model using legacy Sandia data for two filled epoxy systems: 828/CTBN/DEA/GMB and 828/DEA/GMB

The SPECTACULAR model is a development extension of the Simplified Potential Energy Clock (SPEC) model. Both models are nonlinear viscoelastic constitutive models used to predict a wide range of time-dependent behaviors in epoxies and other glass-forming materials. This report documents the procedures used to generate SPECTACULAR calibrations for two particulate-filled epoxy systems, 828/CTBN/DEA/GMB and 828/DEA/GMB. No previous SPECTACULAR or SPEC calibration exists for 828/CTBN/DEA/GMB, while a legacy SPEC calibration exists for 828/DEA/GMB. To generate the SPECTACULAR calibrations, a step-by-step procedure was executed to determine parameters in groups with minimal coupling between parameter groups. This procedure has often been deployed to calibrate SPEC, therefore the resulting SPECTACULAR calibration is backwards compatible with SPEC (i.e. none of the extensions specific to SPECTACULAR are used). The calibration procedure used legacy Sandia experimental data stored on the Polymer Properties Database website. The experiments used for calibration included shear master curves, isofrequency temperature sweeps under oscillatory shear, the bulk modulus at room temperature, the thermal strain during a temperature sweep, and compression through yield at multiple temperatures below the glass transition temperature. Overall, the calibrated models fit the experimental data remarkably well. However, the glassy shear modulus varies depending on the experiment used to calibrate it. For instance, the shear master curve, isofrequency temperature sweep under oscillatory shear, and the Young's modulus in glassy compression yield values for the glassy shear modulus at the reference temperature that vary by as much as 15 %. Also, for 828/CTBN/DEA/GMB, the temperature dependence of the glassy shear modulus when fit to the Young's modulus at different temperatures is approximately four times larger than when it is determined from the isofrequency temperature sweep under oscillatory shear. For 828/DEA/GMB, the temperature dependence of the shear modulus determined from the isofrequency temperature sweep under oscillatory shear accurately predicts the Young's modulus at different temperatures. When choosing values for the shear modulus, fitting the glassy compression data was prioritized. The new and legacy calibrations for 828/DEA/GMB are similar and appear to have been calibrated from the same data. However, the new calibration improves the fit to the thermal strain data. In addition to the standard calibrations, development calibrations were produced that take advantage of development features of SPECTACULAR , including an updated equilibrium Helmholtz free energy that eliminates undesirable behavior found in previous work. In addition to the previously mentioned experimental data, the development calibrations require data for the heat capacity during a stress-free temperature sweep to calibrate thermal terms.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Genetic algorithm optimization of a chemical kinetic mechanism for propane at engine relevant conditions

Propane has demonstrated significant potential for reductions in greenhouse gas and pollutant emissions in medium- and heavy-duty engine applications, but further improvements require accurate, compact, and scalable chemical kinetic mechanisms to design the next generation of propane fueled engines, particularly at the boosted operating conditions necessary to meet the power density demand of medium- and heavy-duty applications. In this work, six key chemical reactions were identified in a reduced mechanism with 70 species and 352 reactions through a sensitivity analysis performed at conditions typical of thermodynamic trajectories observed in a high compression ratio, long stroke engine operated on propane from throttled to boosted operating conditions. While the original mechanism was validated against rapid compression machine (RCM) data, it was found to overpredict experimental autoignition tendencies in 2-zone, 0-D SI engine simulations performed in Chemkin Pro. Subsequently, a genetic algorithm approach was used to optimize the six reaction rate parameters within established uncertainty bounds by performing RCM simulations and comparing to two independent sets of literature ignition delay times for propane, thus generating two new kinetic mechanisms. The first optimization achieved a mean absolute percent error (MPE) reduction in 2nd stage ignition delay of 61.4% in seven generations, while the second optimization utilized a newer experimental RCM dataset, and achieved MPE reduction of 56.7% in seven generations, and further marginal improvement to 57.8% reduction in 34 generations. Finally, the two mechanisms were then evaluated again in the 2-zone 0-D SI engine model in Chemkin Pro comparing typical mean and knocking cycle trajectories, and it was found that the second optimized mechanism provided better prediction of knock onset at the representative conditions evaluated in this work, particularly for higher load operating conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Advanced Polymer Characterization: Modular Operations for Spectral Alignment by Iterative Compression (MOSAIC)

Matrix-assisted laser desorption/ionization (MALDI) mass spectrometry encodes structural information across diverse homo- and copolymer ensembles, yet decrypting these spectra requires a systematic analytical approach. We introduce Modular Operations for Spectral Alignment by Iterative Compression (MOSAIC)─a general cipher algorithm that applies modular arithmetic to filter monomer-derived mass contributions and cluster MALDI peaks by nonconstitutional repeating units (non-CRUs). MOSAIC performs sequential modular operations using monomer mass differences as base units to compress complex spectral data, revealing end-group distributions and comonomer incorporation. As a demonstration, we applied MOSAIC to five copolymers formed by two different polymerization mechanisms. Furthermore, the resulting remainder–mass plots clearly resolve polymer homologs with distinct non-CRUs into visually apparent clusters, enabling intuitive assignment of mass spectral features.

Wang, Hanlin M. [University of Illinois at Urbana−↗
DOE OSTI2024

Simultaneous compression of NaCl, Au, and ruby: toward mutually consistent pressure scales

Here, we evaluate pressure consistency of equations of state (EOS) for NaCl and Au at 300 K. The simultaneous measurements of unit-cell volumes (V) with ruby R1 line shifts (Δλ) in a helium (He) loaded diamond cell effectively remove potential systematic errors. Compression and decompression data were automatically collected at 1 sec interval, yielding a dense dataset with >8,000 (V, Δλ) pairs each for NaCl and Au. Solidification of He has noticeable effects on both V and Delta lambda (hence P). Only data up to similar to 14 GPa, or 6000 (V, P) pairs, can be considered hydrostatic within the resolution. The P-V data are fitted to the Rydberg-Vinet and the 3 rd order Birch-Murnaghan EOS. Predicted pressures of these EOSs agree with those given by the Ruby2020 ruby scale to within +/- 0.05 GPa. Overall, pressures predicted by the Rydberg-Vinet EOS are in better agreement with the average of commonly used NaCl and Au pressure scales.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

In situ synchrotron diffraction of pressure-induced phase transition in DyPO 4 under variable hydrostaticity

In situ synchrotron x-ray diffraction was conducted on polycrystalline DyPO 4 to elucidate the details of the pressure-induced transition from the xenotime polymorph to the monazite polymorph. We used three different pressure-transmitting media (neon, a 16:3:1 methanol-ethanol-water mixture, and potassium chloride) to investigate the effect of hydrostaticity on the phase behavior. Specifically, our data clearly show a hydrostatic onset pressure of the xenotime-monazite transition of 9.1 GPa, considerably lower than the 15.3 GPa previously determined by Raman spectroscopy. Based on (quasi)hydrostatic data taken in a neon environment, third-order Birch-Murnaghan equation-of-state fits give a xenotime bulk modulus of 144 GPa and a monazite bulk modulus of 180 GPa (both with pressure derivatives of 4.0). Structural data and axial compressibilities show that DyPO 4 is sensitive to shear and has an anisotropic response to pressure. More highly deviatoric conditions cause the onset of the transition to shift to pressures at least as low as 7.0 GPa. We attribute early transition to shear-induced distortion of the PO4 tetrahedra. Finally, our characterization of the high-pressure behavior of DyPO 4 under variable hydrostaticity is critical for advancing rare earth orthophosphate fiber coating applications in ceramic matrix composites and may inform future tailoring of phase composition for controlled shear and pressure applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Model-independent versus model-dependent interpretation of the SDSS-III BOSS power spectrum: Bridging the divide

The traditional clustering analyses of galaxy redshift surveys compress the clustering data into a set of late-time physical variables in a model-independent way. This approach has recently been extended by an additional shape variable encoding early-time physics information. Here we apply this new technique, ShapeFit, to SDSS-III BOSS data and show that it matches the constraining power of alternative, model-dependent approaches, which directly constrain the model’s parameters adopting a cosmological model ab initio. ShapeFit is ~30 times faster, model independent, naturally splits early- and late-time variables, and enables a better control of observational systematics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗