Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Compression Algorithm Analysis of In-Situ (S)TEM Video: Towards Automatic Event Detection and Characterization

Precise analysis of both (S)TEM images and video are time and labor intensive processes. As an example, determining when crystal growth and shrinkage occurs during the dynamic process of Li dendrite deposition and stripping involves manually scanning through each frame in the video to extract a specific set of frames/images. For large numbers of images, this process can be very time consuming, so a fast and accurate automated method is desirable. Given this need, we developed software that uses analysis of video compression statistics for detecting and characterizing events in large data sets. This software works by converting the data into a series of images which it compresses into an MPEG-2 video using the open source “avconv” utility [1]. The software does not use the video itself, but rather analyzes the video statistics from the first pass of the video encoding that avconv records in the log file. This file contains statistics for each frame of the video including the frame quality, intra-texture and predicted texture bits, forward and backward motion vector resolution, among others. In all, avconv records 15 statistics for each frame. By combining different statistics, we have been able to detect events in various types of data. We have developed an interactive tool for exploring the data and the statistics that aids the analyst in selecting useful statistics for each analysis. Going forward, an algorithm for detecting and possibly describing events automatically can be written based on statistic(s) for each data type.

algorithm analysis↗

Approximate Bayesian computation for forward modeling in cosmology

Bayesian inference is often used in cosmology and astrophysics to derive constraints on model parameters from observations. This approach relies on the ability to compute the likelihood of the data given a choice of model parameters. In many practical situations, the likelihood function may however be unavailable or intractable due to non-gaussian errors, non-linear measurements processes, or complex data formats such as catalogs and maps. In these cases, the simulation of mock data sets can often be made through forward modeling. We discuss how Approximate Bayesian Computation (ABC) can be used in these cases to derive an approximation to the posterior constraints using simulated data sets. This technique relies on the sampling of the parameter set, a distance metric to quantify the difference between the observation and the simulations and summary statistics to compress the information in the data. We first review the principles of ABC and discuss its implementation using a Population Monte-Carlo (PMC) algorithm and the Mahalanobis distance metric. We test the performance of the implementation using a Gaussian toy model. We then apply the ABC technique to the practical case of the calibration of image simulations for wide field cosmological surveys. We find that the ABC analysis is able to provide reliable parameter constraints for this problem and is therefore a promising technique for other applications in cosmology and astrophysics. Our implementation of the ABC PMC method is made available via a public code release.

79 ASTRONOMY AND ASTROPHYSICS↗

The Coal-Seq III Consortium. Advancing the Science of CO 2 Sequestration in Coal Seam and Gas Shale Reservoirs

The Coal-Seq consortium is a government-industry collaborative that was initially launched in 2000 as a U.S. Department of Energy sponsored investigation into CO2 sequestration in deep, unmineable coal seams. The consortium’s objective aimed to advancing industry’s understanding of complex coalbed methane and gas shale reservoir behavior in the presence of multi-component gases via laboratory experiments, theoretical model development and field validation studies. Research from this collaborative effort was utilized to produce modules to enhance reservoir simulation and modeling capabilities to assess the technical and economic potential for CO2 storage and enhanced coalbed methane recovery in coal basins. Coal-Seq Phase 3 expands upon the learnings garnered from Phase 1 & 2, which has led to further investigation into refined model development related to multicomponent equations-of-state, sorption and diffusion behavior, geomechanical and permeability studies, technical and economic feasibility studies for major international coal basins the extension of the work to gas shale reservoirs, and continued global technology exchange. The first research objective assesses changes in coal and shale properties with exposure to CO2 under field replicated conditions. Results indicate that no significant weakening occurs when coal and shale were exposed to CO2, therefore, there was no need to account for mechanical weakening of coal due to the injection of CO2 for modeling. The second major research objective evaluates cleat, Cp, and matrix, Cm, swelling/shrinkage compressibility under field replicated conditions. The experimental studies found that both Cp and Cm vary due to changes in reservoir pressure during injection and depletion under field replicated conditions. Using laboratory data from this study, a compressibility model was developed to predict the pore-volume compressibility, Cp, and the matrix compressibility, Cm, of coal and shale, which was applied to modeling software to enhance model robustness. Research was also conducted to improve algorithms and generalized adsorption models to facilitate realistic simulation of CO2 sequestration in coal seams and shale gas reservoirs. The interaction among water and the adsorbed gases, carbon dioxide (CO2), methane (CH4), and nitrogen (N2) in coalbeds is examined using experimental in situ laboratory techniques to comprehensively model CBM production and CO2 sequestration in coals. An equation of state (EOS) module was developed which is capable of predicting the density of pure components and mixtures involving the wet CBM gases CH4, CO2, and N2 at typical reservoir condition, and is used to inform CO2 injection models. The final research objective examined the effects adsorbed CO2 has on coal strength and permeability. This research studied the weakening or failure of coal by the adsorption of CO2 from empirically derived gas production data to develop models for advanced modeling of permeability changes during CO2 sequestration. The results of this research effort have been used to construct a new and improved model for assessing changes in permeability of coal reservoirs due CO2 injection. The modules developed from these studies and knowledge learned are applied to field validation and basin assessment studies. These data were used to assess the flow and storage of CO2 in a shale reservoir, test newly developed code against large-scale projects, and conduct a basin-oriented review of coal storage potential in the San Juan Basin. The storage potential and flow of CO2 was modeled for shale sequestration of a proprietary Marcellus Shale horizontal gas production well using COMET3 simulation software. Simulation results from five model runs indicate that stored CO2 quantities are linked to the duration of primary production preceding injection. Matrix CO2 saturation is observed to increase in each shale zone after injection with an increase in primary production, and the size of the CO2 plume is also observed to increase in size the longer initial production is sustained. The simulation modules developed around the Coal-Seq experimental work are also incorporated into a pre-existing large-scale numerical simulation model of the Pump Canyon CO2-ECBM pilot in the San Juan Basin. The new model was applied to re-history match the data set to explore the improvements made in permeability prediction against previously published data sets and to validate this module. The assessment of the new data, however, indicates that the impact of the variable Cp is negligible on the overall behavior of the coal for CO2 storage purposes. Applying these new modules, the San Juan Basin and the Marcellus Shale are assessed for their technical ECBM/AGR and CO2 storage potential and the economic potential of these operations. The San Juan Basin was divided into 4 unique geographic zones based on production history, and the Marcellus was divided into nine. Each was assessed based upon each zone’s properties, and simulations were run to assess the potential of full Basin development. Models of a fully developed San Juan Basin suggest the potential for up to 104 Tcf of CO2 storage, and 12.3 Tcf of methane recovery. The Marcellus models suggest 1,248 Tcf of CO2 storage and 924 Tcf of AGR. The economics are deemed favorable where credits cover the cost of CO2 in the San Juan Basin, and in many cases in the Marcellus, but to maximize storage potential, credits need to extend to pay the operator to store CO2.

01 COAL, LIGNITE, AND PEAT↗

Investigation of fast and efficient lossless compression algorithms for macromolecular crystallography experiments

Structural biology experiments benefit significantly from state-of-the-art synchrotron data collection. One can acquire macromolecular crystallography (MX) diffraction data on large-area photon-counting pixel-array detectors at framing rates exceeding 1000 frames per second, using 200 Gbps network connectivity, or higher when available. In extreme cases this represents a raw data throughput of about 25 GB s −1 , which is nearly impossible to deliver at reasonable cost without compression. Our field has used lossless compression for decades to make such data collection manageable. Many MX beamlines are now fitted with DECTRIS Eiger detectors, all of which are delivered with optimized compression algorithms by default, and they perform well with current framing rates and typical diffraction data. However, better lossless compression algorithms have been developed and are now available to the research community. Here one of the latest and most promising lossless compression algorithms is investigated on a variety of diffraction data like those routinely acquired at state-of-the-art MX beamlines.

36 MATERIALS SCIENCE↗

Measurement of the sound speed in dense fluid deuterium along the cryogenic liquid Hugoniot

Many experimental studies, spanning several decades of research and using various dynamic compression schemes, have been conducted to investigate cryogenic liquid deuterium under strong shock compression. The consensus emerging from these studies is that of a progressive dissociation of the D 2 molecules into an electrically conducting, atomic plasma, when subjected to shock pressures exceeding ~50 GPa. While state-of-the-art numerical simulations based on density-functional-theory or quantum Monte-Carlo techniques capture this behavior quite well, subtle differences subsist between these simulations and the available experimental data regarding the pressure-density compressibility. Here, leveraging a recently developed analysis method for high-resolution Doppler interferometric velocity data, we present Eulerian sound speed measurements in compressed deuterium to shock pressures between 50 and 200 GPa. These results, extracted from laser-driven shockwave experiments, are found to agree with several of the most accurate equation of state models for deuterium at those conditions up to ~150 GPa. However, the data indicate that these models fail to reproduce the experimentally observed sound speed at higher pressures, approaching 200 GPa. In particular, we unveil a discrepancy between the experimental results and the equation of state model that is most commonly used in inertial confinement fusion at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A COMPRESSED SENSING METHOD WITH ANALYTICAL RESULTS FOR LIDAR FEATURE CLASSIFICATION

We present an innovative way to autonomously classify LiDAR points into bare earth, building, vegetation, and other categories. One desirable product of LiDAR data is the automatic classification of the points in the scene. Our algorithm automatically classifies scene points using Compressed Sensing Methods via Orthogonal Matching Pursuit algorithms utilizing a generalized K-Means clustering algorithm to extract buildings and foliage from a Digital Surface Models (DSM). This technology reduces manual editing while being cost effective for large scale automated global scene modeling. Quantitative analyses are provided using Receiver Operating Characteristics (ROC) curves to show Probability of Detection and False Alarm of buildings vs. vegetation classification. Histograms are shown with sample size metrics. Our inpainting algorithms then fill the voids where buildings and vegetation were removed, utilizing Computational Fluid Dynamics (CFD) techniques and Partial Differential Equations (PDE) to create an accurate Digital Terrain Model (DTM) [6]. Inpainting preserves building height contour consistency and edge sharpness of identified inpainted regions. Qualitative results illustrate other benefits such as Terrain Inpainting s unique ability to minimize or eliminate undesirable terrain data artifacts. Keywords: Compressed Sensing, Sparsity, Data Dictionary, LiDAR, ROC, K-Means, Clustering, K-SVD, Orthogonal Matching Pursuit

99 GENERAL AND MISCELLANEOUS↗

Compressibility Anomaly in Magnetic Heuslar Alloy Ni{sub 2}MnGa and Co{sub 2}FeSi

Results of synchrotron based high pressure x ray diffraction measurements on Heuslar alloys Ni{sub 2}MnGa and Co{sub 2}FeSi are reported up to 30.6 and 24.6 GPa respectively. Pressure volume data for Ni{sub 2}MnGa shows normal compressibility behaviour up to 30.6 GPa with the value of bulk modulus Bo and its pressure derivative B' as 130 GPa and 4.97 respectively. In case of Co{sub 2}FeSi, the P-V data shows normal behaviour upto 5 Gpa and hereafter linear P-V relation. The estimated ambient pressure compressibility based on data up to 5 GPa is 267 GPa (with B' = 4). The fit to linear P-V data above 5 GPa yields a compressibility of 279.5.

36 MATERIALS SCIENCE↗

Cosmological constraints from a joint DESI DR1 Full-Shape and DR2 BAO

We present a cosmological analysis combining full-shape (FS) clustering measurements from the Dark Energy Spectroscopic Instrument (DESI) DR1 with baryon acoustic oscillation (BAO) measurements from DESI DR2. To achieve a robust combination that accounts for the correlation between the two data releases, we employ the ShapeFit compression method and estimate the joint covariance using EZmocks. This compressed approach inherently mitigates the prior volume effects that have previously dominated Bayesian constraints from DESI data with minimal external priors. Consequently, we obtain — for the first time within a Bayesian framework — reliable DESI-only constraints on extensions to ΛCDM using only a Big Bang Nucleosynthesis prior on the baryon density and a wide prior on the spectral index. In flat ΛCDM, we find Ω m = 0.3035 ± 0.0085, h = 0.6876 ± 0.0059, and σ 8 = 0.822 ± 0.034. For the w 0 w a CDM dynamical dark energy model, we measure w 0 = -0.49 ± 0.25 and w a = -1.52 ± 0.77, improving constraints by ∼ 30% relative to the analogous DR1 measurement and reducing the discrepancy with ΛCDM to 1.4σ when compared to BAO only analyses. We also report competitive limits on the sum of neutrino masses and spatial curvature. This work demonstrates that the ShapeFit compression provides a prior-robust and computationally efficient pathway to constrain beyond-ΛCDM physics with large-scale structure.

baryon acoustic oscillations↗

HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs

Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to address this problem, as it allows for on-demand data retrieval with significantly reduced data movement cost. However, most existing progressive methods are designed for CPUs, leaving a gap for them to unleash the power of today’s heterogeneous computing systems with GPUs.In this work, we propose HP-MDR, a high-performance and portable data refactoring and progressive retrieval framework for GPUs. Our contributions are four-fold: (1) We carefully optimize the bitplane encoding and lossless encoding, two key stages in progressive methods, to achieve high performance on GPUs; (2) We propose pipeline optimization and incorporate it with data refactoring and progressive retrieval workflows to further enhance the performance for large data process; (3) We leverage our framework to enable high-performance data retrieval with guaranteed error control for common Quantities of Interest; (4) We evaluate HP-MDR and compare it with state of the arts using five real-world datasets. Experimental results demonstrate that HP-MDR delivers an average 13.68 × and 6.31 × throughput in data refactoring and progressive retrieval tasks, respectively. It also leads to 11.22 × throughput for recomposing required data representations under Quantity-of-Interest error control and 6.04 × performance for the corresponding end-to-end data retrieval, when compared with state-of-the-art solutions.

Li, Yanliang [University of Oregon]↗

Compression dynamics of quasi-spherical wire arrays with different linear mass profiles

Results of experimental studies of the implosion of quasi-spherical wire (or metalized fiber) arrays are presented. The goal of the experiments was to achieve synchronous three-dimensional compression of the plasma produced in different regions of a quasi-spherical array into its geometrical center. To search for optimal synchronization conditions, quasi-spherical arrays with different initial profiles of the linear mass were used. The following dependences of the linear mass on the poloidal angle were used: m{sub l}(θ) ∝ sin{sup –1}θ and m{sub l}(θ) ∝ sin{sup –2}θ. The compression dynamics of such arrays was compared with that of quasi-spherical arrays without linear mass profiling, m{sub l}(θ) = const. To verify the experimental data, the spatiotemporal dynamics of plasma compression in quasi-spherical arrays was studied using various diagnostics. The experiments on three-dimensional implosion of quasi-spherical arrays made it possible to study how the frozen-in magnetic field of the discharge current penetrates into the array. By measuring the magnetic field in the plasma of a quasi-spherical array, information is obtained on the processes of plasma production and formation of plasma flows from the wire/fiber regions with and without an additionally deposited mass. It is found that penetration of the magnetic flux depends on the initial linear mass profile m{sub l}(θ) of the quasi-spherical array. From space-resolved spectral measurements and frame imaging of plasma X-ray emission, information is obtained on the dimensions and shape of the X-ray source formed during the implosion of a quasi-spherical array. The intensity of this source is estimated and compared with that of the Z-pinch formed during the implosion of a cylindrical array.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Acoustical, morphological and optical properties of oral rehydration salts (ORS)

Ultrasonic velocity, density and viscosity were measured in different concentrations of oral rehydration salts (ORS) at room temperature 303 k. From the experimental data other related thermodynamic parameters, viz adiabatic compressibility, intermolecular free length, acoustic impedence, relaxation time are calculated. The experimental data were discussed in the light of molecular interaction existing in the liquid mixtures. The results have been discussed in terms of solute-solvent interaction between the components. Structural characterization is important for development of new material. The morphology, structure and grain size of the samples are investigated by SEM. The optical properties of the sample have been studied using UV Visible spectroscopy.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Shock compression of liquid helium to 360 GPa

Data for the shock equation of state of helium are obtained up to 360⁢G⁡Pa, nearly doubling the pressure of previous experimental measurements. The helium samples are first precompressed to 2.7 g⁡c⁢m −3 in a diamond anvil cell prior to laser-driven shock compression at the Omega Laser Facility. Time-resolved Doppler velocimetry and pyrometry reveal significant reflectivity and greater compressibility compared to the predictions of existing broad-range tabular equation of state models, which may be caused by the onset of ionization. These experimental observations, however, are largely captured with molecular-dynamics simulations based on density functional theory, affirming the ability of first-principles techniques to capture complex physics, while enabling critical insight for the behavior of warm dense helium in Jovian interiors and white dwarf atmospheres.

Physics - Plasma physics↗

Initial Testing of an In Situ Load Retention Aging Vessel

A thermal aging vessel instrumented with load cells was fabricated. The primary function of the vessel is to continuously monitor the in situ load retention of up to three compressed polymer coupons undergoing thermally accelerated aging under nitrogen. A secondary function is to enable gas sampling of the vessel headspace during thermal aging. Heating of the vessel is achieved using a custom heater jacket. To improve upon our conventional aging study methods which require periodic interruption of aging to perform load testing in an Instron machine at room temperature, this technology aims to automate/facilitate data acquisition/analysis, improve data quality, and enable uninterrupted compression of the polymer which represents the service condition. As an example case to assess functionality of the in situ vessel, the load retention of a siloxane elastomer material additively manufactured by direct-ink-writing (DIW) was measured at three different isothermal aging temperatures for ~1 month. Initial compression of the coupons while near the aging temperature was achieved by temporarily opening the heated vessel to access the interior chamber and manually tightening four nuts to drive the heated compression plate down onto the heated coupons. Initial testing demonstrated achievement of the primary load retention monitoring function. Unfortunately, the vessel leaked which prevented gas sampling; an active purge was used to maintain a nitrogen atmosphere. Welded or otherwise sealed joints, which could be implemented in a future design, would likely eliminate leak paths. To apply time-temperature superposition (TTS), a technique used to provide long-term prediction of the load retention from short-term isothermal data, the load retention needed to be calculated relative to the load at an estimated “equilibrium” time, after most of the transient viscoelastic physical relaxation occurred. The peak load immediately after compression could not be used as the load retention basis for two reasons: (1) age-related changes must be isolated from non-age-related physical relaxation before applying TTS and (2) the manual mechanism used to compress the specimens at the aging temperature was neither smooth nor repeatable which affected the peak load value. To better understand the effect of the mode of initial compression on the measured load, and possibly better estimate “equilibrium” physical relaxation times, systematic stress relaxation experiments were performed using an Instron machine with a thermal chamber. At a given temperature, the DIW polymer was compressed to a fixed strain in either a stepped or continuous manner at two different rates, then held at that strain for 24 hrs. The results indicated that, at a given temperature, the different stress relaxation curves appeared to converge to the same curve at some “equilibrium” time when the non-age-related physical relaxation was mostly complete. Though this observation suggests that the discontinuous manual compression employed by the vessel is feasible, a compression mechanism that is rapid, smooth, and repeatable would enhance its use.

36 MATERIALS SCIENCE↗

Prediction of epigenetically regulated genes in breast cancer cell lines

Methylation of CpG islands within the DNA promoter regions is one mechanism that leads to aberrant gene expression in cancer. In particular, the abnormal methylation of CpG islands may silence associated genes. Therefore, using high-throughput microarrays to measure CpG island methylation will lead to better understanding of tumor pathobiology and progression, while revealing potentially new biomarkers. We have examined a recently developed high-throughput technology for measuring genome-wide methylation patterns called mTACL. Here, we propose a computational pipeline for integrating gene expression and CpG island methylation profles to identify epigenetically regulated genes for a panel of 45 breast cancer cell lines, which is widely used in the Integrative Cancer Biology Program (ICBP). The pipeline (i) reduces the dimensionality of the methylation data, (ii) associates the reduced methylation data with gene expression data, and (iii) ranks methylation-expression associations according to their epigenetic regulation. Dimensionality reduction is performed in two steps: (i) methylation sites are grouped across the genome to identify regions of interest, and (ii) methylation profles are clustered within each region. Associations between the clustered methylation and the gene expression data sets generate candidate matches within a fxed neighborhood around each gene. Finally, the methylation-expression associations are ranked through a logistic regression, and their significance is quantified through permutation analysis. Our two-step dimensionality reduction compressed 90% of the original data, reducing 137,688 methylation sites to 14,505 clusters. Methylation-expression associations produced 18,312 correspondences, which were used to further analyze epigenetic regulation. Logistic regression was used to identify 58 genes from these correspondences that showed a statistically signifcant negative correlation between methylation profles and gene expression in the panel of breast cancer cell lines. Subnetwork enrichment of these genes has identifed 35 common regulators with 6 or more predicted markers. In addition to identifying epigenetically regulated genes, we show evidence of differentially expressed methylation patterns between the basal and luminal subtypes. Our results indicate that the proposed computational protocol is a viable platform for identifying epigenetically regulated genes. Our protocol has generated a list of predictors including COL1A2, TOP2A, TFF1, and VAV3, genes whose key roles in epigenetic regulation is documented in the literature. Subnetwork enrichment of these predicted markers further suggests that epigenetic regulation of individual genes occurs in a coordinated fashion and through common regulators.

59 BASIC BIOLOGICAL SCIENCES↗

Load Deflection Data (LDDATA)

The current data set is load deflection data (Stress vs strain for compression stress and stress vs elongation for tension stress) from a material test. The goal of the test was to characterize this rubber-like material by looking at different variables: sample creation process, anisotropy, temperature, etc. The data will be used with the Texas A&M Online Research Experience for Undergraduates (O-REU) program. This program is joint with LANL. The student is not an official LANL student so they will not be able to access data and documents on the yellow. The load deflection data set is unclassified and will be sent to the student for analysis. Analysis will include curve fitting, scalar value analysis (stiffness, toughness, etc.) and analysis of variance to determine what variables statistically affect the response while correcting for covariates (temperature soak time and humidity). Data will be stored as Matlab structs and as HDF5 files. Same data, different formats.

36 MATERIALS SCIENCE↗

Libra: Scalable Load Balance Analysis

Libra is a tool for scalable analysis of load balance data from all processes in a parallel application. Libra contains an instrumentation module that collects model data from parallel applications and a parallel compression mechanism that uses distributed wavelet transforms to gather load balance model data in a scalable fashion. Data is output to files, and these files can be viewed in a GUI tool by Libra users. The GUI tool associates particular load balance data with regions for code, emabling users to view the load balance properties of distributed "slices" of their application code.

Source record↗

Libra: Scalable Load Balance Analysis

Libra is a tool for scalable analysis of load balance data from all processes in a parallel application. Libra contains an instrumentation module that collects model data from parallel applications and a parallel compression mechanism that uses distributed wavelet transforms to gather load balance model data in a scalable fashion. Data is output to files, and these files can be viewed in a GUI tool by Libra users. The GUI tool associates particular load balance data with regions for code, emabling users to view the load balance properties of distributed "slices" of their application code.

Source record↗

Synthetic Streamflow Datasets to Support Emulation of Water Allocations via LSTM

This archive is the data companion to the bonney_et-al_2026_erc metarepo which generates synthetic data, trains an LSTM model, and generates performance metrics on the trained model. While the generation of the synthetic data is fully reprodicible, it is a computationally expensive process. This data archive contains the synthetic datasets needed for training and testing an LSTM model and reproduction of figures and tables. In addition, supplemenatary data products generating and visualizing results is also included, such as geospatial data for the basin. Contents There are two high level directories: `WRAP_archive/` and `repo_data/`. The `WRAP_archive` directory contains compressed intermediate dataproducts from the dataset generation workflow (marked as "I_Dataset_Generation" in the metarepo). These data products are not required by any scripts in the metarepo, but they are archived as they are expensive to generate and may have useful information for other analyses. The `repo_data` directory contains the necessary data for reproducing the workflow in the metarepo and should be decompressed and moved into the top level of the metarepo. Additional details are provided in README.md.

drought↗