Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Melting and density of MgSiO 3 determined by shock compression of bridgmanite to 1254GPa

The essential data for interior and thermal evolution models of the Earth and super-Earths are the density and melting of mantle silicate under extreme conditions. Here, we report an unprecedently high melting temperature of MgSiO 3 at 500 GPa by direct shockwave loading of pre-synthesized dense MgSiO3 (bridgmanite) using the Z Pulsed Power Facility. We also present the first high-precision density data of crystalline MgSiO 3 to 422 GPa and 7200 K and of silicate melt to 1254 GPa. The experimental density measurements support our density functional theory based molecular dynamics calculations, providing benchmarks for theoretical calculations under extreme conditions. The excellent agreement between experiment and theory provides a reliable reference density profile for super-Earth mantles. Furthermore, the observed upper bound of melting temperature, 9430 K at 500 GPa, provides a critical constraint on the accretion energy required to melt the mantle and the prospect of driving a dynamo in massive rocky planets.

58 GEOSCIENCES↗
DOE OSTI2024

Data for: Time to anoxia: Observations and predictions of oxygen drawdown following coastal flood events

This dataset contains data and code associated with the paper Patel et al. "Time to anoxia: Observations and predictions of oxygen drawdown following coastal flood events".The coastal terrestrial-aquatic interface (TAI) is a highly dynamic system characterized by strong physical, chemical, and biological gradients. In particular, shifting soil redox conditions and consumption of terminal electron acceptors, due in part to dynamic hydrologic conditions, is a strong driver of carbon availability and transformations across TAIs. However, while redox dynamics are well described, our ability to quantitatively forecast rates of oxic to anoxic shifts in soils with different characteristics and inundation regimes is limited. We integrated field measurements, laboratory incubations, and model simulations to improve mechanistic understanding of oxygen consumption dynamics in coastal soils. Continuous in situ monitoring unexpectedly revealed that flooding caused temporary spikes in subsurface dissolved oxygen followed by rapid consumption in the wetlands. To further investigate these mechanisms in a controlled setting, we performed laboratory incubations using surface and subsurface soils from a TAI gradient (defined here as upland forest to transitional forest to wetland) in Western Lake Erie to measure oxygen consumption rates in TAI soils during flood events. In our experiments, wetland soils reached anoxia the fastest, in ∼ 9 h on average, whereas upland soils turned anoxic in ∼ 18 h. Subsurface upland soils did not turn anoxic even after two weeks of saturation in the lab, and their oxygen consumption patterns suggested carbon and/or nutrient limitation. These results are consistent with in-situ groundwater redox and oxygen measurements in the field, where wetland soils exhibited the highest rates of oxygen consumption along the TAI. Model simulations of oxygen consumption suggested that oxygen consumption had stronger abiotic controls in wetland soils but stronger biotic controls in upland soils, providing a useful framework for future incubation experiments. Microbial activity is a strong driver of oxygen consumption in TAI soils, although it is constrained by the availability of dissolved carbon in subsurface soils.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/COMPASS-DOE/cmps-time_to_anoxia (DOI: 10.5281/zenodo.10815374).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Soil pore network response to freeze-thaw cycles in permafrost aggregates

This dataset contains data used for the paper "Pore network response to freeze-thaw cycles in permafrost aggregates". The Related References field will be updated with a full citation when available.Climate change in Arctic landscapes may increase freeze-thaw frequency within the active layer as well as newly thawed permafrost. A highly disruptive process, freeze-thaw can deform soil pores and alter the architecture of the soil pore network with varied impacts to water transport and retention, redox conditions, and microbial activity. Our objective was to investigate how freeze-thaw cycles impacted the pore network of newly thawed permafrost aggregates to improve understanding of what type of transformations can be expected from warming Arctic landscapes. We measured the impact of freeze-thaw on pore morphology, pore throat diameter distribution, and pore connectivity with X-ray computed tomography (XCT) using six permafrost aggregates with sizes of 2.5 cm3 from a mineral soil horizon (Bw; 28-50 cm depths) in Toolik, Alaska. Freeze-thaw cycles were performed using a laboratory incubation consisting of five freeze-thaw cycles (-10˚C to 20˚C) over five weeks. Our findings indicated decreasing spatial connectivity of the pore network across all aggregates with higher frequencies of singly connected pores following freeze-thaw. Water-filled pores that were connected to the pore network decreased in volume while the overall connected pore volumetric fraction was not affected. Shifts in the pore throat diameter distribution were mostly observed in pore throats ranges of 100 microns or less with no corresponding changes to the pore shape factor of pore throats. Responses of the pore network to freeze-thaw varied with aggregate, suggesting that initial pore morphology may play a role in driving freeze-thaw response. Our research suggests that freeze-thaw alters the microenvironment of permafrost aggregates during the incipient stage of deformation following permafrost thaw, impacting soil properties and function in Arctic landscapes undergoing transition. This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/Erin-Rooney/XCT-freezethaw (DOI: 10.5281/zenodo.5816355).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Data for "Soil carbon dynamics during drying vs. rewetting: Importance of antecedent moisture conditions"

This dataset contains data used for the paper "Soil carbon dynamics during drying vs. rewetting: importance of antecedent moisture conditions". The Related References field will be updated with a full citation when available.Soil moisture influences soil carbon dynamics, including microbial growth and respiration. The response of such ‘soil respiration’ to moisture changes is generally assumed to be linear and reversible, i.e. to depend only on the current moisture state. Current models thus do not account for antecedent soil moisture conditions when determining soil respiration or the available substrate pool. We conducted a laboratory incubation to determine how the antecedent conditions of drought and flood influenced soil organic matter (SOM) chemistry, bioavailability, and respiration. We sampled soils from an upland coastal forest, Beaver Creek, WA USA, and subjected them to drying and rewetting treatments. For the drying treatment, field moist soils were saturated and then dried to 75, 50, 35, and 5 % saturation. In the rewetting treatment, field moist soils were air-dried and then rewet to 35, 50, 75, and 100 % saturation. We measured respiration and water extractable organic carbon (WEOC) concentrations and used 1H-NMR and FT-ICR-MS to characterize the WEOC pool across the treatments. The drying vs. wetting treatment strongly influenced SOM bioavailability, as rewet soils (with antecedent drought) had greater WEOC concentrations and respiration fluxes compared to the drying soils (with antecedent flood). In addition, air-dry soils had the highest WEOC concentrations, and the NMR-resolved peaks showed a strong contribution of protein groups in these soils. Both NMR and FT-ICR-MS analyses indicated increased contribution of complex aromatic groups/molecules in the rewet soils, compared to the drying soils. We suggest that drying introduced organic matter into the WEOC pool via desorption of aromatic molecules and/or by microbial cell lysis, and this stimulated microbial mineralization rates. Our work indicates that even short-term shifts in antecedent moisture conditions can strongly influence soil C dynamics at the core scale. The predictive uncertainties in current soil models may be reduced by a more accurate representation of soil water and C persistence that includes a mechanistic and quantitative understanding of the impact of antecedent moisture conditions.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv and .txt format, which can be accessed and processed using MS Excel or R. NMR data are provided as raw output data (accessed in Bruker TopSpin or MestreNova) as well as the MestreNova-processed files. This archive can also be accessed on GitHub at https://github.com/kaizadp/hysteresis_and_soil_carbon (DOI: 10.5281/zenodo.4432885).

1H-NMR↗
DOE OSTI2021

Data for: Spatial access and resource limitations control carbon mineralization in soils

This dataset contains data and code used for the paper "Spatial access and resource limitations control carbon mineralization in soils", https://doi.org/10.1016/j.soilbio.2021.108427. Core-scale soil carbon fluxes are ultimately regulated by pore-scale dynamics of substrate availability and microbial access. These are constrained by physicochemical and biochemical phenomena (e.g. spatial access and hydrologic connectivity, physical occlusion, adsorption-desorption with mineral surfaces, nutrient and resource limitations). We conducted an experiment to determine how spatial access and resource limitations influence core-scale water-soluble soil organic matter (SOM) mineralization, and how these are regulated by antecedent moisture conditions. Intact soil cores were incubated at field-moist vs. drought conditions, after which they were saturated from above (to simulate precipitation) or below (to simulate groundwater recharge). Soluble carbon (acetate) and nitrogen (nitrate) forms were added to some cores during the rewetting process to alleviate potential nutrient limitations. Soil respiration was measured during the incubation, after which pore water was extracted from the saturated soils and analyzed for water soluble organic carbon concentrations and characterization. Our results showed that carbon (C) amendments increased the cumulative carbon dioxide (CO2) evolved from the soil cores, suggesting that the soils were C-limited. Drought and rewetting increased soil respiration, and there was a greater abundance of complex aromatic molecules in pore waters sampled from these soils. This newly available substrate appeared to alleviate nutrient limitations on respiration, because there were no further respiration increases with subsequent C and N amendments. We had hypothesized that respiration would be influenced by wetting direction, as simulated precipitation would mobilize C from the surface. However, as a main effect, this response was seen only in the C-amended soils, indicating that surface-C may not have been bioavailable. At the pore scale (pore water samples), drought and the C, N amendments caused a net loss of identified molecules when the soils were rewet from below, whereas wetting from above caused a net increase in identified molecules, suggesting that fresh inputs stimulated the C-and N-limited microbial populations present deeper in the soil profile. Our experiment highlights the complex and interactive role of antecedent moisture conditions, wetting direction, and resource limitations in driving core-scale C fluxes.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/TES_spatial_access_2021 (DOI: 10.5281/zenodo.5522938).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluation of Drilling Performance at The Geysers with Machine Learning Methods Using Geologic Data

A recent well, GDC-36, was drilled in The Geysers Geothermal Field served in a Department of Energy-industry to demonstrate improved drilling performance with polycrystalline diamond compact (PDC) bits. Both PDC and roller cone drill bits were used to drill this well. Key challenges encountered during drilling included lost circulation in the mud-drilled section, and bit damage interfacial severity in the deeper, air-drilled section. The objective of this study is to evaluate the drilling performance in relation to the local geological characteristics using machine learning methods. By applying K-clustering to the sonic log data, we were able to identify areas correlated with measured lost circulation. Also, the boundaries defined by clustering of the mineralogical and lithological data from the mud logs correlate well with interfacial severity during drilling. A random forest model was employed to build correlation between drilling data and rock strength. The confined compressive strength (CCS) of the rock in the training of the machine learning model was inferred from the dipole sonic log. The R-squared of the testing data is 0.78, and the RMSE (Root Mean Squared Error) is 0.06. The trained model was used to forecast rock strength for the section where sonic log data are not available. CCS could also be inferred from mud logs provided the relationship between mineralogy and rock strength is established through core testing data.

15 GEOTHERMAL ENERGY↗
DOE OSTI2023

Topography and canopy cover influence soil organic carbon composition and distribution across a forested hillslope in the discontinuous permafrost zone

This dataset contains data used for the paper "Topography and canopy cover influence soil organic carbon composition and distribution across a forested hillslope in the discontinuous permafrost zone". The Related References field will be updated with a full citation when available. Topography and canopy cover influence ground temperature in warming permafrost landscapes, yet soil temperature heterogeneity introduced by meso-topographic slope positions, microtopographic differences in vegetation cover, and the subsequent impact of contrasting temperature conditions to soil organic carbon (SOC) dynamics are understudied. Buffering of permafrost-affected soils against warming air temperatures in boreal forests can reflect surface soil characteristics (e.g., thickness of organic material) as well as the degree and type of canopy cover (e.g., open cover vs closed cover). Both landscape and soil properties interact to determine meso- and micro-scale heterogeneity of ground warming. We sampled a hillslope catena transect in a discontinuous permafrost zone near Fairbanks, Alaska to test the small-scale (1 to 3 meter) impacts of slope position and cover type on soil organic matter composition. Mineral active layer samples were collected from backslope, low backslope, and footslope positions at depths spanning 19 to 60 cm. We examined soil mineralogical composition, soil moisture, total carbon and nitrogen content, and organic mat thickness in conjunction with an assessment of SOC composition using Fourier-transform ion Cyclotron Resonance Mass Spectrometry (FT-ICR-MS). Soils in the footslope position had a higher relative contribution of lignin-like compounds while backslope soils had more aliphatic and condensed aromatic compounds as determined by FT-ICR-MS. The effect of open versus closed tree canopy cover varied with slope position. On the backslope, we found higher oxidation of molecules under open cover compared with closed cover, indicating an effect of warmer soil temperature on decomposition. Little to no effect of canopy was observed for soils at the footslope position, which we attributed, in part, to the strong impact of soil moisture content in SOC dynamics in the water-gathering footslope position. The thin organic mat under open cover on the backslope position may have contributed to differences in soil temperature and thus SOC oxidation under open and closed canopy. Here, the thinner organic mat did not appear to buffer the underlying soil against warm season air temperatures and thus increased SOC decomposition as indicated by higher oxidation of SOC molecules and a lower contribution of simple molecules under open cover compared with the closed canopy sites. Our findings suggest that the role of canopy cover in SOC dynamics varies as a function of landscape position and soil properties, namely organic mat thickness and soil moisture. Condition-specific heterogeneity of SOC composition under open and closed canopy cover highlights the protective effect of canopy cover for soils on backslope positions. This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/Erin-Rooney/Y1_fairbanks (DOI: 10.5281/zenodo.8071247).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Compression–tension cell with sample manipulator for in situ X‐ray nanotomography experiments

In situ X-ray nanotomography experiments where tensile or compressive force is applied on the sample require specialized equipment. A compression-tension device with fluid flow-through capability has been designed for X-ray nanotomography beamlines. The compression-tension cell is equipped with a triaxial stage for sample alignment and a high sensitivity loadcell for measurement of applied force. To handle the <100 µm samples used for X-ray nanotomography imaging and for loading samples on the compression-tension cell a sample manipulator has been built. The sample manipulator is capable of selecting a single <100 µm particle for nanotomography scanning while viewing multiple samples under an optical microscope. To test the functionality of these two devices an initial compression experiment involving two glass beads was performed. To demonstrate instrument stability two spherical glass beads were compressed from a no load condition until one of the beads fractured. Nanotomography data were collected at each step of increasing compressive force. The experimentally observed contact area of the spherical glass beads was compared with the theoretical estimate using the Hertz analysis. To demonstrate the fluid flow capability, two calcite grains were compressed against each other under a calcite saturated solution. Surface topological changes were observed for the stressed grain contact area.

X-ray tomography↗
DOE OSTI2022

Physics-informed graph neural networks for predicting cetane number with systematic data quality analysis

Designing alternative fuels for advanced compression ignition engines necessitates a predictive model for cetane number (CN). In this study, the physics-informed graph neural networks are introduced for a reliable CN prediction by considering molecular features pertinent to the physical properties of molecules that affect CN. The reliability of measured data is another key factor to consider for improving the predictive model. Various experimental instruments for measuring CN exist, including standard and non-standard methods. In this regard, a systematic data quality analysis was carried out for the total 630 CNs collected from literature and new measurements in this study using Advanced Fuel Ignition Delay Analyzer (AFIDA). The results from this data curation process were reflected in the model by imposing lower sample weights on the data coming from less reliable measurement techniques. This approach effectively maximized the prediction accuracy while incorporating data from all available sources. Using the sample weights decreased the mean absolute error (MAE) up to 0.8 CN units. The accuracy was also improved by introducing the CN-related physical properties (the number of hydrogen bond donors and acceptors); the test set MAE is 5.74 and 7.01 for the model with and without such properties, respectively. Investigating molecular structural effects on CN was also carried out to gain chemical insights into factors used to design new fuel candidates. The dimensionality reduction analysis of feature vectors showed a clear clustering in terms of functional groups and CN and the structural effect derived from the model was consistent with the physicochemical insights. Finally, this physics-informed model and data curation would be helpful for accurate CN prediction and inform rational fuel design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Anelasticity and Phase Transition During Ramp-Release in Tin

This study examines the qualitative features of an anelasticity model associated with the bowing of dislocations in the presence of phase transition. A simple physically plausible mechanism is introduced to describe the interaction of anelasticity and the transformation. Varying the anelastic parameters results in strong differences in the deviatoric stress response. The model is applied to study the behavior of tin (Sn) and compared to data from ramp driven compression-release experiments. Tin exhibits a complex phase diagram within a relatively accessible range of temperature and pressures and the characterization of its phases is considered an open problem with significant scientific merit. The coupling between anelasticity, plasticity, and phase transformation contributes to release wave features traditionally associated with the phase transition effect alone suggesting the importance of accounting for the effects jointly. Posterior distributions of the plastic and anelastic parameters are computed using Bayesian-inference-based methods, further highlighting the importance of anelasticity in this regime.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Direct observation of diamond formation in a shock-compressed high explosive

Understanding the formation timescale and structure of carbonaceous reaction products is critical for modeling the high-pressure equation-of-state of organic materials. We use the National Ignition Facility to shock-compress polycrystalline TATB (C 6 H 6 N 6 O 6 ) samples to ~70–130 GPa and ~4000–5500 K, employing in situ nanosecond X-ray diffraction to probe reaction products and velocimetry to measure transmitted compression wave profiles. Our diffraction data is consistent with the formation of diamond over timescales less than ~60 ns. This represents carbon condensation from a molecular explosive on timescales three times faster than previously reported and the earliest observation of diamond produced from reacting TATB. Reactive flow simulations with explicit chemistry reproduce the observed temporal structure within wave profiles to inform the distribution of P-T states. These findings provide direct evidence of ultrafast diamond formation in a reactive system at extreme conditions and provide new constraints for models of shock and detonation chemistry.

Clarke, Samantha M. [Lawrence Livermore National L↗
DOE OSTI2023

BEYONDPLANCK III. Commander3

We describe the computational infrastructure for end-to-end Bayesian cosmic microwave background (CMB) analysis implemented by the BeyondPlanck Collaboration. The code is called Commander3. It provides a statistically consistent framework for global analysis of CMB and microwave observations and may be useful for a wide range of legacy, current, and future experiments. The paper has three main goals. Firstly, we provide a high-level overview of the existing code base, aiming to guide readers who wish to extend and adapt the code according to their own needs or re-implement it from scratch in a different programming language. Secondly, we discuss some critical computational challenges that arise within any global CMB analysis framework, for instance in-memory compression of time-ordered data, fast Fourier transform optimization, and parallelization and load-balancing. Thirdly, we quantify the CPU and RAM requirements for the current BEYONDPLANCK analysis, finding that a total of 1.5 TB of RAM is required for efficient analysis and that the total cost of a full Gibbs sample for LFI is 170 CPU-hrs, including both low-level processing and high-level component separation, which is well within the capabilities of current low-cost computing facilities. The existing code base is made publicly available under a GNU General Public Library (GPL) license.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Integration of RNTuple in ATLAS Athena

After using ROOT’s TTree I/O subsystem for over two decades and storing more than an exabyte of compressed High Energy Physics (HEP) data, advances in technology have motivated a complete redesign, RNTuple, which breaks backward-compatibility to take better advantage of these storage options. The RNTuple I/O subsystem has been designed to address performance bottlenecks and other shortcomings of TTree. Specifically, RNTuple comes with an updated, more compact binary data format that can be stored both in ROOT files and natively in object stores. It is designed for modern storage hardware (e.g. high-throughput low-latency NVMe SSDs), and provides robust and easy to use interfaces. The binary format of RNTuple is scheduled to become production grade in 2024, and recently has become mature enough to start exploring the integration into software used by HEP experiments. In this contribution, we discuss the developments to support the features as required by the ATLAS analysis Event Data Model (EDM) in RNTuple, which will enable its integration into the Athena software framework. With these developments in place, we evaluate the performance of the current most recent versions of RNTuple-based ATLAS data sets and compare this to that of TTree.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Automated Fitting of a Semi-empirical Multiphase Equation of State for Carbon

The equation of state (EOS) of carbon is important in high explosive, geophysical, and inertial confinement fusion applications. Within the semi-empirical Sesame framework, the EOS of each phase is represented by a sum of cold, vibrational, and thermal electronic Helmholtz free energy contributions. Each phase has ~5-10 independent parameters that are adjusted to reproduce single-phase data (e.g., thermal expansion, isothermal compression) as well as experimentally- and computationally- derived phase boundaries. Manual calibration of the full multiphase EOS is arduous. We present our progress in development of automated EOS parameterization based on minimization of an objective function. Here, this function encodes deviation of model EOS results from experimental/computational benchmarks. Optimization is implemented as a combination of global (particle swarm) and local optimization techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

CMB distance priors revisited: effects of dark energy dynamics, spatial curvature, primordial power spectrum, and neutrino parameters

As a physical and sufficient compression of the full CMB data, the CMB distance priors, or shift parameters, have been widely used and provide a convenient way to include CMB data when obtaining cosmological constraints. In this paper, we revisit this data vector and examine its stability under different cosmological models. We find that the CMB distance priors are an accurate substitute for the full CMB data when probing dark energy dynamics. This is true when the primordial power spectrum model is directly generalized from the power spectrum of the model used in the derivation of the distance priors from the CMB data. We discover a difference when a non-flat model with the untilted primordial inflation power spectrum is used to measure the distance priors. This power spectrum is a radical change from the more conventional tilted primordial power spectrum and violates fundamental assumptions for the reliability of the CMB shift parameters. We also investigate the performance of CMB distance priors when the sum of neutrino masses Σm ν and the effective number of relativistic species N eff are allowed to vary. Our findings are consistent with earlier results: the neutrino parameters can change the measurement of the sound horizon from CMB data, and thus the CMB distance priors. We find that when the neutrino model is allowed to vary, the cold dark matter density ω c and N eff need to be included in the set of parameters that summarize CMB data, in order to reproduce the constraints from the full CMB data. As a result, we present an updated and expanded set of CMB distance priors which can reproduce constraints from the full CMB data within 1σ, and are applicable to models with massive neutrinos, as well as non-standard cosmologies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Accelerating Ultrafast Spectroscopy with Compressive Sensing

We report ultrafast spectroscopy is an important tool for studying photoinduced dynamical processes in atoms, molecules, and nanostructures. Typically, the time to perform these experiments ranges from several minutes to hours depending on the choice of spectroscopic method. It is desirable to reduce this time overhead not only to shorten time and laboratory resources, but also to make it possible to examine fragile specimens that quickly degrade during long experiments. In this article, we motivate using compressive sensing to significantly shorten data acquisition time by reducing the total number of measurements in ultrafast spectroscopy. We apply this technique to experimental data from ultrafast transient absorption spectroscopy and ultrafast terahertz spectroscopy and show that good estimates can be obtained with as low as 15% of the total measurements, implying a sixfold reduction in the data acquisition time.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

BCSR on GPU: A Way Forward Extreme-scale Graph Processing on Accelerator-enabled Frontier Supercomputer

Handling large graphs in a distributed environment requires effective partitioning across processors and efficient management of local partitions. In 2D partitioning, local graphs often become too sparse, making memory-efficient data structures crucial. Using the Compressed Sparse Row (CSR) format wastes space, especially for > 83% of vertices with empty edges for the sparse graphs. This study explores bit-CSR (BCSR), a modified CSR representation, on GPUs to reduce memory usage in graph computations. We achieved 16.67% memory savings on a sparse rmat dataset with 268 million vertices and 357 million edges, without performance degradation, supported by both theoretical and experimental storage savings of 33%. However, we observed a 1.7× slowdown in degree lookup times due to bitwise operations on AMD CPUs. This analysis highlights the potential of BCSR on GPUs for improving Graph500 benchmark performance on GPU-accelerated systems, such as the Frontier supercomputer.

Sattar, Naw Safrin↗
DOE OSTI2023

Accelerating Random Forest Classification on GPU and FPGA

Random Forests (RFs) are a commonly used machine learning method for classification and regression tasks spanning a variety of application domains, including bioinformatics, business analytics, and software optimization. While prior work has focused primarily on improving performance of the training of RFs, many applications, such as malware identification, cancer prediction, and banking fraud detection, require fast RF classification. In this work, we accelerate RF classification on GPU and FPGA. In order to provide efficient support for large datasets, we propose a hierarchical memory layout suitable to the GPU/FPGA memory hierarchy. We design three RF classification code variants based on that layout, and we investigate GPU- and FPGA-specific considerations for these kernels. Our experimental evaluation, performed on an Nvidia Xp GPU and on a Xilinx Alveo U250 FPGA accelerator card using publicly available datasets on the scale of millions of samples and tens of features, covers various aspects. First, we evaluate the performance benefits of our hierarchical data structure over the standard compressed sparse row (CSR) format. Second, we compare our GPU implementation with cuML, a machine learning library targeting Nvidia GPUs. Third, we explore the performance/accuracy tradeoff resulting from the use of different tree depths in the RF. Finally, we perform a comparative performance analysis of our GPU and FPGA implementations. Our evaluation shows that for high accuracy targets, our GPU implementation yields 5-9x speedup over CSR, and up to a 2x speedup over cuML.

FPGA, Xilinx FPGA, GPU, Random Forest classificati↗