Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Data center cooling method

A method aspect for removing heat from a data center may use liquid coolant cooled without vapor compression refrigeration on a liquid cooled information technology equipment rack. The method may also include regulating liquid coolant flow to the data center through a range of liquid coolant flow values with a controller-apparatus based upon information technology equipment temperature threshold of the data center.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Utah FORGE: Well 14-2 Logs and Data from Roosevelt Hot Spring Area

This is a compilation of logs and data from Well 14-2 in the Roosevelt Hot Springs area in Utah. This well is also in the Utah FORGE study area. Data includes: flowmeter survey (1989), geochemistry (1977-1978, 1977-1983), injection test data (1979, 1982), and spinner surveys (1989, 1985-1986). Logs include: borehole compensated sonic and gamma ray (600'-6112'), borehole geometry and gamma ray (50'-4829'), caliper (0'-1720'), compensated neutron formation density (600'-6121'), induction electric (650'-6118'), mud log (79'-6100'), steam injection survey (50'-1175'), subsurface pressure surveys (0'-6087'), and subsurface temperature surveys (0'-6106'). The file is in a compressed .zip format and there is a data inventory table (Excel spreadsheet) in the root folder that is a guide to the data that is accessible in subfolders.

14-2↗

guppy i : a code for reducing the storage requirements of cosmological simulations

ABSTRACT As cosmological simulations have grown in size, the permanent storage requirements of their particle data have also grown. Even modest simulations present a major logistical challenge for the groups which run these boxes and researchers without access to high performance computing facilities often need to restrict their analysis to lower quality data. In this paper, we present guppy, a compression algorithm and code base tailored to reduce the sizes of dark matter-only cosmological simulations by approximately an order of magnitude. guppy is a ‘lossy’ algorithm, meaning that it injects a small amount of controlled and uncorrelated noise into particle properties. We perform extensive tests on the impact that this noise has on the internal structure of dark matter haloes, and identify conservative accuracy limits which ensure that compression has no practical impact on single-snapshot halo properties, profiles, and abundances. We also release functional prototype libraries in C, Python, and Go for reading and creating guppy data.

79 ASTRONOMY AND ASTROPHYSICS↗

Automated identification of deformation twin systems in Mg WE43 from SEM DIC

In this study, the application of machine learning and computer vision approaches to microscale deformation data for the automated identification of deformation twinning systems, and their associated twin area, is introduced. Deformation data was obtained during in-situ SEM compression testing of a WE43 Mg alloy using digital image correlation (DIC) modified for use with electron microscopy. A 5.7 mm × 3.4 mm area of interest was analyzed, generating ~100 million data points of deformation. Experimental twin trace directions were determined by applying k-means clustering, morphological thinning, and Hough transforms to the deformation data. The identification of deformation twinning was achieved by consideration of the twin trace direction, its strain value, and its evolution. The deformation map was divided into areas corresponding to individual active twin systems, enabling the analysis of microstructure dependence of deformation behavior and twinning activity. The performance of the proposed twinning identification approach was evaluated by accuracy, precision, and sensitivity metrics. The effect of the tuning parameters used in the algorithm on the performance is also discussed.

36 MATERIALS SCIENCE↗

Dimensionality Reduction Algorithms for Big Nuclear Data Streams with Application to SCALE Cross Sections

A central problem in performing accurate nuclear reactor simulations is the ability to capture the changes in the few group microscopic cross sections as functions of system state, e.g. moderator density, fuel temperature, or neutron spectrum, and time and/or burnup of the fuel. For most reactor simulation scenarios, this results in huge data stream, which must be interpolated as needed by downstream calculations (e.g., core-wide simulation). This is typically accomplished by using sophisticated interpolating functions to capture the few-group variations over the wide range of conditions expected during operation. To address handling this big data, this paper explores the use of dimensionality reduction (DR) techniques to identify the true dimensionality of the data prior to its use in the calculations. This could significantly reduce the computational cost required for data processing/manipulation, thus reducing a significant portion of the total calculations time. By way of an example, in the current version of the ORIGEN-ARP module, the assembly-averaged microscopic cross sections at different conditions, e.g., fuel enrichments, irradiation history and water density, which are calculated using the TRITON sequence and interpolated on-demand by the ARP module to model assembly depletion for a wide range of assembly types (e.g. Westinghouse 17x17 and GE 9x9) over a wide range of conditions. This approach typically results in ∼1 GB per assembly type, which although not insurmountable, can be impractical for distribution. and it is the premise of this paper that most of this data is heavily correlated and hence can take great benefit of condensation via DR. To demonstrate DR, the proposed algorithm is applied to the nuclear data streams generated by SCALE 6.1. Using the depletion sequence (TRITON), microscopic cross sections are calculated for a mixed oxide (MOX) fuel assembly design at a representative range of fuel enrichments and fuel burnup. In conventional core simulators, multi dimensional interpolation of these cross sections is used to provides neutronics feedback due to local conditions without returning to expensive TRITON calculations for every change. This paper shows that dimensionality reduction can help compress the size of the cross section data without sacrificing the accuracy of their reconstruction at all conditions of interest. This work explores the application of dimensionality reduction algorithms to nuclear data streams typically employed in support of conventional full-core reactor calculations which rely on interpolation of pre-calculated microscopic cross sections. In particular, analysis of the few group MOX cross sections revealed that a large degree of dependencies exist between the few-group cross sections, which can be revealed via range-finding algorithms. Specifically, correlations between different reaction types for the same isotope have been identified, and correlations between different enrichments and correlations across different isotopes have been identified. This paper demonstrates that the reduction errors can be quantified, and they are uncorrelated with the range of variations for the various cross sections. In future work, we will focus on identifying the smallest rank that takes into account all types of correlations across the range of conditions used to model cross section variations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Solving protein structure from sparse serial microcrystal diffraction data at a storage-ring synchrotron source

In recent years, the success of serial femtosecond crystallography and the paucity of beamtime at X-ray free-electron lasers have motivated the development of serial microcrystallography experiments at storage-ring synchrotron sources. However, especially at storage-ring sources, if a crystal is too small it will have suffered significant radiation damage before diffracting a sufficient number of X-rays into Bragg peaks for peak-indexing software to determine the crystal orientation. As a consequence, the data frames of small crystals often cannot be indexed and are discarded. Introduced here is a method based on the expand–maximize–compress (EMC) algorithm to solve protein structures, specifically from data frames for which indexing methods fail because too few X-rays are diffracted into Bragg peaks. The method is demonstrated on a real serial microcrystallography data set whose signals are too weak to be indexed by conventional methods. In spite of the daunting background scatter from the sample-delivery medium, it was still possible to solve the protein structure at 2.1 Å resolution. The ability of the EMC algorithm to analyze weak data frames will help to reduce sample consumption. Furthermore, it will also allow serial microcrystallography to be performed with crystals that are otherwise too small to be feasibly analyzed at storage-ring sources.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Parallel In Situ Indexing for Data-intensive Computing

As computing power increases exponentially, vast amount of data is created by many scientific re- search activities. However, the bandwidth for storing the data to disks and reading the data from disks has been improving at a much slower pace. These two trends produce an ever-widening data access gap. Our work brings together two distinct technologies to address this data access issue: indexing and in situ processing. From decades of database research literature, we know that indexing is an effective way to address the data access issue, particularly for accessing relatively small fraction of data records. As data sets increase in sizes, more and more analysts need to use selective data access, which makes indexing an even more important for improving data access. The challenge is that most implementations of in- dexing technology are embedded in large database management systems (DBMS), but most scientific datasets are not managed by any DBMS. In this work, we choose to include indexes with the scientific data instead of requiring the data to be loaded into a DBMS. We use compressed bitmap indexes from the FastBit software which are known to be highly effective for query-intensive workloads common to scientific data analysis. To use the indexes, we need to build them first. The index building procedure needs to access the whole data set and may also require a significant amount of compute time. In this work, we adapt the in situ processing technology to generate the indexes, thus removing the need of read- ing data from disks and to build indexes in parallel. The in situ data processing system used is ADIOS, a middleware for high-performance I/O. Our experimental results show that the indexes can improve the data access time up to 200 times depending on the fraction of data selected, and using in situ data processing system can effectively reduce the time needed to create the indexes, up to 10 times with our in situ technique when using identical parallel settings.

97 MATHEMATICS AND COMPUTING↗

Time-resolved X-ray diffraction diagnostic development for the National Ignition Facility

Here we present the development of an experimental platform that can collect four frames of x-ray diffraction data along a single line of sight during laser-driven, dynamic-compression experiments at the National Ignition Facility. The platform is comprised of a diagnostic imager built around ultrafast sensors with a 2-ns integration time, a custom target assembly that serves also to shield the imager, and a 10-ns duration, quasi-monochromatic x-ray source produced by laser-generated plasma. We demonstrate the performance with diffraction data for Pb ramp compressed to 150 GPa and illuminated by a Ge x-ray source that produces ∼7 × 10 11 , 10.25-keV photons/ns at the 400 μm diameter sample.

36 MATERIALS SCIENCE↗

The Cost of Decarbonization and Energy Upgrade Retrofits for US Homes

Cost is a major barrier when upgrading homes to reduce carbon emissions required to meet DOE’s climate-related goals. This report summarizes a nationwide effort to gather home energy upgrade project cost data along with household energy performance data. The goal was to develop cost benchmarks and to guide future R&D efforts aimed at cost compression and scaling of the residential upgrade market. The cost data were compiled for both total project costs and costs of individual measures. The majority of energy savings were modeled, with some models using measured site data for calibration. The database was analyzed using clustering techniques to find common energy and CO2 reduction approaches. The individual measures were combined into archetypal solutions to determine least-cost approaches to maximizing energy and carbon savings. Several financial analyses were preformed to examine other cost metrics beyond first cost. Project data was obtained for 1,739 projects, from 15 states and 12 energy programs, with a total of 10,512 individual measures. The database includes a wide-array of projects, ranging from single-measure HVAC upgrades to net-zero energy whole home remodels. Projects were predominantly single-family detached dwellings with wood frame construction. Most of the data was obtained from energy programs because they had recorded the necessary information and were willing to share with this study. This sample of convenience can provide broad guidance and national cost benchmarks, but lacks sufficient detail to draw more disaggregated conclusions, such as geographical trends. The majority of data contributions were obtained without compensation from sources where the required data was already in some sort of structured format. We compensated sources to enter data from individual projects into a structured data format for about 500 projects, with an average cost of about $40 per project. The database was highly skewed to lower cost, lower impact projects due to the nature of the sample of convenience. Less than 10% of projects had savings greater than 50%. The cost data for individual measures in the database are being used in other DOE efforts on residential energy use/decarbonization. This data collection effort should continue in order to provide the best-informed guidance for DOE and industry R&D, as well as deployment efforts (including policy and program planning).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

An Adaptable Seismic Data Format

We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.

58 GEOSCIENCES↗

THE SLOW-MODE NATURE OF COMPRESSIBLE WAVE POWER IN SOLAR WIND TURBULENCE

We use a large, statistical set of measurements from the Wind spacecraft at 1 AU, and supporting synthetic spacecraft data based on kinetic plasma theory, to show that the compressible component of inertial range solar wind turbulence is primarily in the kinetic slow mode. The zero-lag cross-correlation C({delta}n, {delta}B{sub ||}) between proton density fluctuations {delta}n and the field-aligned (compressible) component of the magnetic field {delta}B{sub ||} is negative and close to -1. The typical dependence of C({delta}n, {delta}B{sub ||}) on the ion plasma beta {beta}{sub i} is consistent with a spectrum of compressible wave energy that is almost entirely in the kinetic slow mode. This has important implications for both the nature of the density fluctuation spectrum and for the cascade of kinetic turbulence to short wavelengths, favoring evolution to the kinetic Alfven wave mode rather than the (fast) whistler mode.

79 ASTRONOMY AND ASTROPHYSICS↗

Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'

This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.

2018 NEON and 2025 CHESS Campaigns↗

Stability-preserving Lossy Compression for Large-scale Partial Differential Equations

Checkpoint/Restart (C/R) strategies are vital for fault tolerance in PDE-based scientific simulations, yet traditional checkpointing incurs significant I/O overhead. Lossy compression offers a scalable solution by reducing checkpoint data size, but conventional methods often lack control over physical invariants (e.g., energy), leading to instability such as oscillations or divergence in Partial Differential Equations (PDE) systems. This paper introduces a stability-preserving compression approach tailored for PDE simulations by explicitly controlling kinetic and potential energy perturbations to ensure stable restarts. Extensive experiments conducted across diverse PDE configurations demonstrate that our method maintains numerical stability with minimal error magnification—even across multiple checkpoint-restart cycles—outperforming state-of-the-art lossy compressors. Parallel evaluations on the Frontier supercomputer show up to 8.4× improvement in checkpoint write performance and 6.3× in read performance, while maintaining relative L2 errors ∼ 2e-6 throughout continued simulation. These results provide practical guidance for balancing compression accuracy, stability, and computational efficiency in large-scale PDE applications.

Gong, Qian [ORNL] (ORCID:0000000235704142)↗

An analysis of parameter compression and Full-Modeling techniques with Velocileptors for DESI 2024 and beyond

In anticipation of forthcoming data releases of current and future spectroscopic surveys, we present the validation tests and analysis of systematic effects within velocileptors modeling pipeline when fitting mock data from the AbacusSummit N-body simulations. We compare the constraints obtained from parameter compression methods to the direct fitting (Full-Modeling) approaches of modeling the galaxy power spectra, and show that the ShapeFit extension to the traditional template method is consistent with the Full-Modeling method within the standard ΛCDM parameter space. We show the dependence on scale cuts when fitting the different redshift bins using the ShapeFit and Full-Modeling methods. We test the ability to jointly fit data from multiple redshift bins as well as joint analysis of the pre-reconstruction power spectrum with the post-reconstruction BAO correlation function signal. We further demonstrate the behavior of the model when opening up the parameter space beyond ΛCDM and also when combining likelihoods with external datasets, namely the Planck CMB priors. Finally, we describe different parametrization options for the galaxy bias, counterterm, and stochastic parameters, and employ the halo model in order to physically motivate suitable priors that are necessary to ensure the stability of the perturbation theory.

79 ASTRONOMY AND ASTROPHYSICS↗

Utah FORGE: Well Acord 1-26 Logs and Data: Roosevelt Hot Spring Area

This is a compilation of logs and data from Well Acord 1-26 in the Roosevelt Hot Springs area in Utah. This well is also in the Utah FORGE study area. Logs include: mud log (45'-12645'), compensated densilog (1102'-7923', 7900'-12644'), neutron log (1102'-7923'), dual induction focused logs (1100'-7923', 7904'-11447'), BHC acoustilog (7800'-11439'), differential temperature log (380'-11448'), gamma ray neutron logs (7900'-12148', 12000'-12647'), temperature logs (7900'-12144', 7900'-12145', 7800'-12655', 7900'-12655'), and caliper log (7800'-12655'), densilog (7900'-12655'). The file is in a compressed .zip format and there is a data inventory table (Excel spreadsheet) in the root folder that is a guide to the data that is accessible in subfolders.

15 GEOTHERMAL ENERGY↗

High-pressure structural systematics of dysprosium metal compressed in a neon pressure medium to 182 GPa

Here we present an experimental and theoretical study of dysprosium metal compressed in the soft pressure transmitting medium Ne up to 182 and 300 GPa, respectively. Angle-dispersive x-ray powder diffraction data from each of the high-pressure polymorphs shows anisotropic compression behavior indicating changes to the electron density distribution throughout its polymorphic landscape. We compare the monoclinic (mC4) and orthorhombic (oF16) structures for the collapsed structure for Dy above 82 GPa and verify that the oF16 structure offers a better fit to our data than the previously reported mC4 structure. Further, we have found that the oF16 structure undergoes similar anisotropic compression of its lattice parameters, with a turning point above 160 GPa; suggesting a potential phase transition at pressures much higher than achieved in this study. Density functional theory calculations show the likely candidate for this new high-pressure phase is the isosymmetric oF8 structure, which is predicted to be lower in energy than the oF16 structure above 275 GPa.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

High-pressure structural behavior and equation of state of NaZnF{sub 3}

We report the results of density functional theory ab-initio calculations and monochromatic synchrotron X-ray diffraction study carried out for orthorhombic NaZnF{sub 3} in the pressure range 0-40 GPa. Perovskite-to-postperovskite phase transition was anticipated by first-principles computations and then observed in high-pressure diamond anvil cell synchrotron diffraction experiment between 14 and 22 GPa. Above 25 GPa postperovskite structure (CaIrO{sub 3} type, space group Cmcm) coexists with another phase, yet unidentified. On decompression, pure postperovskite-type structure was found to be stable down to 4 GPa; below this pressure sample contained both perovskite and postperovskite modifications. Fit of experimental P-V data to the third-order Birch-Murnaghan equation of state gave bulk moduli, K{sub P,0} 64.98+-2.67 and 69.88+-3.69 GPa for perovskite and postperovskite modifications, respectively. Both phases demonstrated strong anisotropy of compressibility. For postperovskite NaZnF{sub 3}, the highest compression was observed along the direction perpendicular to the planes of ZnF{sub 6} octahedra arrangement. - Graphical Abstract: Fit of P-V data obtained from high-pressure X-ray diffraction study of perovskite and postperovskite NaZnF{sub 3} to the third-order Birch-Murnaghan equation of state (solid line). Open and closed symbols represent experimental data corresponding to compression and decompression, respectively. Bulk moduli, K{sub 0,P}, of perovskite and postperovskite phases are 64.98+-2.67 and 69.88+-3.69 GPa.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Incremental Tensor Train Decomposition Algorithm

We present a new algorithm for incrementally updating the tensor train decomposition of a stream of tensor data. This new algorithm, called the tensor train incremental core expansion (TT-ICE) improves upon the current state-of-the-art algorithms for compressing in tensor train format by developing a new adaptive approach that incurs significantly slower rank growth and guarantees compression accuracy. This capability is achieved by limiting the number of new vectors appended to the TT-cores of an existing accumulation tensor after each data increment. These vectors represent directions orthogonal to the span of existing cores and are limited to those needed to represent a newly arrived tensor to a target accuracy. We provide two versions of the algorithm: TT-ICE and TT-ICE accelerated with heuristics (TT-ICE*). Here, we provide a proof of correctness for TT-ICE and empirically demonstrate the performance of the algorithms in compressing large-scale video and scientific simulation datasets. Compared to existing approaches that also use rank adaptation, TT-ICE* achieves 57× higher compression and up to 95% reduction in computational time.

97 MATHEMATICS AND COMPUTING↗