Search NASA⌕ Search

SEARCH · Search NASA

Results for “algorithm selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

The Origins of Matter on Near-Exascale Supercomputing

This LDRD addressed one of the central questions in physics today: the lack of antimatter relative to matter in the universe. If antimatter and matter existed in equal amounts they would have annihilated into radiation and we would not exist today. DOE is funding experiments to investigate processes that could lead to lepton number violation and the resulting neutrino-less double beta decay (0nbb) signal that may be observed (lepton number is a property of elementary particles similar to electric charge and lepton number violation would explain the matter-antimatter imbalance). However, even if the 0nbb decay is detected in these experiments, the physics mechanism that violates lepton number would not be known, as there are several candidates. Determining the appropriate mechanism from the experimental data requires theoretical calculations. Theoretical effort in the field has focused on long-range 0nbb decay mechanisms associated with the exchange of light neutrinos between two nucleons. An equally important set of mechanisms are associated with the exchange of heavy particles and short-range physics, including the exchange of massive Majorana neutrinos. Calculating the event rate for 0nbb decays for candidate theories involving heavy particle exchange requires large-scale Lattice simulations of the underlying fundamental theory of Quantum Chromodynamics (QCD). We have performed these simulations on the LLNL supercomputers and have calculated the necessary matrix elements of short-range operators that arise from the exchange of heavy mediators that contribute to 0nbb decay via the leading pion exchange diagrams. Our published results can now be used as input to effective field theory calculations to calculate the 0nbb decay rate for the nuclei involved in the various experimental detectors. In the process of this work we entered the 2018 Gordon Bell Prize competition (the highest prize in scientific supercomputing) with our innovative and highly optimized code and methods and were selected as one of the six international finalists. During this effort we helped with the bring-up of the new LLNL Sierra and Lassen supercomputers by identifying hardware and software problems. Aiming towards the next step of this research, involving the sub-leading nucleon-nucleon direct vertex, we have developed algorithms and codes that will play a significant role in future Lattice QCD calculations involving nucleon-nucleon interactions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Integrated End-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows

This report details recent progress for the ASCR funded project “Integrated End-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows”. We refer to the project as IPPD/2, reflecting the 2017 renewal under expanded scope and partners In IPPD/2, we increased our research scope to include data motion. We are focusing on three major aspects: a) observe how data is generated, distributed, and used; b) analyze how data is (repeatedly) consumed with a focus both on repeated patterns and anomalies; and c) explore how to optimize data motion. This new work on data motion will augment and complement IPPD/2’s research that focused on the computational aspects of tasks. We leverage and extend our existing tools and demonstrate our work on the Belle II workflow suite as well as on workflows from NSLS-II. The highlights of our work are as follows: Provenance for Workflows: Provenance is used to provide information enabling quality control, re-run computational workflows, and reproduce results. IPPD/2 has been building a scalable provenance management system that enables the capture of provenance from the high-level workflow through all relevant system levels in one integrated environment. Leveraging this work, our recent efforts have included using provenance as an enabling technique. Workload characterization: Leveraging provenance and analysis, we characterize data movement within network, storage, and memory over a variety of workloads. This characterization enables an understanding by performance analysts and application developers of the range of behaviors that could be expected. Performance Prediction for Workflows: The goal of modeling distributed workflows is to understand performance bottlenecks and enable more intelligent task scheduling to optimize selected metrics of interest (e.g., task throughput or output data rate). IPPD/2 has utilized both analytical and AI/ML modeling methodologies for performance modeling. Advanced Scheduling and Fault Modeling for Workflows: Scheduling of large-scale scientific workflows on geographically distributed resources is a challenging problem. To improve workflow throughput, we combined novel scheduling algorithms with task predictions from performance modeling and fault modeling. Dynamically Alleviating Bottlenecks in Workflows: Exploiting our provenance, analysis, and modeling efforts, we have explored and developed several techniques for dynamically detecting and alleviating bottlenecks in data movement. In particular, we have spent considerable effort demonstrating our techniques on production-like workflow configurations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Chaconne: A Statistical Approach to Nonlocal Compression for Supervised Learning, Semi-Supervised Learning, and Anomaly Detection

This project developed a novel statistical understanding of compression analytics (CA), which has challenged and clarified some core assumptions about CA, and enabled the development of novel techniques that address vital challenges of national security. Specifically, this project has yielded the development of novel capabilities including 1. Principled metrics for model selection in CA, 2. Techniques for deriving/applying optimal classification rules and decision theory to supervised CA, including how to properly handle class imbalance and differing costs of misclassification, 3. Two techniques for handling nonlocal information in CA, 4. A novel technique for unsupervised CA that is agnostic with regard to the underlying compression algorithm, 5. A framework for semisupervised CA when a small number of labels are known in an otherwise large unlabeled dataset. 6. The academic alliance component of this project has focused on the development of a novel exemplar-based Bayesian technique for estimating variable length Markov models (closely related to PPM [prediction by partial matching] compression techniques). We have developed examples illustrating the application of our work to text, video, genetic sequences, and unstructured cybersecurity log files.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2019

Convolutional Neural Networks for Hydrometeor Classification using Dual Polarization Doppler Radars

Traditional fuzzy logic hydrometeor classification algorithm is a common way to classify precipitation type from dual polarization doppler radar. We propose a deep learning-based method to estimate hydrometeors efficiently using observed radar variables such as horizontal reflectivity (Z H ), differential reflectivity (Z DR ), correlation coefficient (ρ HV ) and specific differential phase (K DP ) from National Weather Service NEXRAD collected at Vance AFB facility at the first elevation angle from January 1st, 2015 to July 31th, 2019. We stack matrices of values from these four polarimetric variables as one 3D array. Samples are preprocessed and divided into training, validation and test set with four target hydrometeor categories (Ice Crystals (IC), Dry Snow (DS), Light and/or Moderate Rain (RA) and Big Drops (rain) (BD)). We developed and optimized five Convolutional Neural Networks (CNNs) architectures and achieved an accuracy of 87.23% and 93.736% respectively using modified ResNet with two different input data selection strategies for hydrometeor classification. Training data selection strategies were important to ensure use of available samples in training for robust performance evaluated by applying the models to novel time period beyond what was use to train the model. Seasonal variation in atmospheric conditions lead to seasonal patterns of liquid vs solid forms of precipitation, that poses challenge for classifier and offer insights into domain specific approaches required for problem of hydrometeor identification. Computationally efficient and scalable approach for classification of hydrometeors offer opportunties to effectively use the large volumes of rich time series of radar observations that are becoming increasingly available.

Lu, Yuping↗
DOE OSTI2018

Geologic CO 2 sequestration monitoring design: A machine learning and uncertainty quantification based approach

Monitoring is a crucial aspect of geologic carbon dioxide (CO 2 ) sequestration risk management. Effective monitoring is critical to ensure CO 2 is safely and permanently stored throughout the life-cycle of a geologic CO 2 sequestration project. Effective monitoring involves deciding: (i) where is the optimal location to place the monitoring well(s), and (ii) what type of data (pressure, temperature, CO 2 saturation, etc.) should be measured taking into consideration the uncertainties at geologic sequestration sites. We have developed a filtering-based data assimilation procedure to design effective monitoring approaches. To reduce the computational cost of the filtering-based data assimilation process, a machine-learning algorithm: Multivariate Adaptive Regression Splines is used to derive computationally effcient reduced order models from results of full-physics numerical simulations of CO 2 injection in saline aquifer and subsequent multi-phase fluid flow. We use example scenarios of CO 2 leakage through legacy wellbore and demonstrate a monitoring strategy can be selected with the aim of reducing uncertainty in metrics related to CO 2 leakage. We demonstrate the proposed framework with two synthetic examples: a simple validation case and a more complicated case including multiple monitoring wells. The examples demonstrate that the proposed approach can be effective in developing monitoring approaches that take into consideration uncertainties.

58 GEOSCIENCES↗
DOE OSTI2025

Sorting rare earth magnets motors for recycling without opening the motors

Abstract A novel approach for sorting electric motors without dismantling them is reported in this article. This approach increases the likelihood that a motor selected from a mixture for recycling would contain rare earth elements (REEs), which are pivotal for numerous advanced green technologies. The challenge of inadvertently dismantling motors without REEs during recycling is addressed by this proposed innovative method. It relies on cogging interactions and power density for sorting motors with REEs. The process uses an algorithm introduced in this work to sort motors in two steps by (a) distinguishing induction motors from permanent magnet motors, and (b) distinguishing motors with critical REEs (e.g., Nd, Pr, Dy, Tb) from ferrite-based motors, all without opening the motors. The former was accomplished with 100% accuracy while the latter was accomplished with ~ 78% accuracy. Such high accuracy improves the recycling efficiency of critical REEs from motors, alleviating concern about supply disruption and supporting resource conservation and sustainability.

36 MATERIALS SCIENCE↗
DOE OSTI2016

A radiation closure study of Arctic stratus cloud microphysical properties using the collocated satellite-surface data and Fu-Liou radiative transfer model

Retrievals of cloud microphysical properties based on passive satellite imagery are especially difficult over snow-covered surfaces because of the bright and cold surface. To help quantify their uncertainties, single-layered overcast liquid-phase Arctic stratus cloud microphysical properties retrieved by using the Clouds and the Earth's Radiant Energy System Edition 2 and Edition 4 (CERES Ed2 and Ed4) algorithms are compared with ground-based retrievals at the Atmospheric Radiation Measurement North Slope of Alaska (ARM NSA) site at Barrow, AK, during the period from March 2000 to December 2006. A total of 206 and 140 snow-free cases (Rsfc ≤ 0.3), and 108 and 106 snow cases (R sfc > 0.3), respectively, were selected from Terra and Aqua satellite passes over the ARM NSA site. The CERES Ed4 and Ed2 optical depth (τ) and liquid water path (LWP) retrievals from both Terra and Aqua are almost identical and have excellent agreement with ARM retrievals under snow-free and snow conditions. In order to reach a radiation closure study for both the surface and top of atmosphere (TOA) radiation budgets, the ARM precision spectral pyranometer-measured surface albedos were adjusted (63.6% and 80% of the ARM surface albedos for snow-free and snow cases, respectively) to account for the water and land components of the domain of 30 km × 30 km. Most of the radiative transfer model calculated SW↓ sfc and SW↑ TOA fluxes by using ARM and CERES cloud retrievals and the domain mean albedos as input agree with the ARM and CERES flux observations within 10 W m -2 for both snow-free and snow conditions. Sensitivity studies show that the ARM LWP and r e retrievals are less dependent on solar zenith angle (SZA), but all retrieved optical depths increase with SZA.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Detection of surface water temperature variations of Mongolian lakes benefiting from the spatially and temporally gap-filled MODIS data

Lakes provide critical water resources for human activities and ecosystems, particularly in the Mongolian Plateau (MP), which is characterized by a dry climate and a harsh environment. As a region that is sensitive to anthropogenic warming, tracking lake surface water temperature (LSWT) changes in Mongolian lakes is crucial for understanding the consequences of a warming climate on lake ecosystems. However, the long-term monitoring of LSWT is restricted by the spatiotemporal gaps in the raw imagery of remote sensing-based land surface temperature (LST), e.g., the commonly used Moderate Resolution Imaging Spectroradiometer (MODIS) LST products. This study applied an improved gap-filling method by utilizing the discrete cosine transform-based penalized least squares (DCT-PLS) strategy in the spatial domain combined with the linear interpolation (LI) algorithm in the temporal domain. The method was applied to fill gaps in the LSWT imagery of 12 representative lakes across MP. The randomly sampled high-quality MODIS LSWT values in the spatial and temporal domains were excavated as false data gaps and considered “virtual true” validation datasets. The spatial validation results showed that the estimated LSWT for all the lake cases were comparable with the “virtual true” LSWT values, with the average values of the coefficient of determination, mean absolute error, mean square error, and root mean square error being 0.98, 0.38 °C, 0.45 °C, and 0.59 °C, respectively. Meanwhile, the error of nighttime LSWT results was relatively lower than that of daytime LSWT. For temporal interpolation validation, the LI algorithm exhibited relatively better performance and could more objectively indicate the variation in LSWT. Benefiting from the spatially and temporally well-constrained data, we analyzed the interannual and intra-annual change characteristics of the LSWTs of the 12 lakes. The long-term variations of annual and seasonal mean LSWTs in the 12 selected lakes exhibited no evident trends in 2000–2020, while presented apparent interannual fluctuations. The slight changes in the average LSWTs of the 12 selected lakes were in excellent synchronization with the surrounding LST derived from the reanalysis datasets, confirming the widely reported phenomenon of “global warming hiatus” that occurred in the early 21st century. This study improves the understanding of the LSWT variations in Mongolian lakes in response to global climate change. It has the potential to provide an effective approach for monitoring LSWT changes in other large-scale studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Reaction paths of methane activation and oxidation of surface intermediates over NiO on Ceria-Zirconia catalysts studied by In-situ FTIR spectroscopy

Methane activation over NiO/Ce 0.82 Zr 0.18 O 2 catalysts synthesized by combustion synthesis is studied by in-situ IR spectroscopy and correlated to the properties and oxygen speciation of the catalyst. Through XRD, H 2 -TPR, and pyridine adsorption followed by FTIR spectroscopy, the reducibility and Lewis acidity of the catalysts are assessed. In-situ FTIR spectroscopy is used to monitor the methane activation on catalyst surfaces. Complex IR features of methane-derived surface species are observed and are attributed to the formation of surface alkyl/alkoxy, aldehyde, formate/carbonate, and aromatic species. A data analysis algorithm is developed to evaluate the evolution of different surface species over time. The formation of formate and carbonate species is driven by adsorbed surface oxygen, while less reactive oxygen species associated with NiO allow for the production of aromatics and alkoxy intermediates. Finally, by tuning the reducibility and Lewis acidity of the catalyst, the selectivity to alkoxy intermediates can be improved.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

SAIL Field Campaign X-Band Precipitation Radar Seasonal Surface Hydrometeor Phase Classification Value-Added Product Report

The Surface Atmosphere Integrated Field Laboratory (SAIL) campaign generated an unprecedented, multisensory record of cold-season precipitation in the Upper Colorado River Basin (UCRB). To complement the Surface Quantitative Precipitation Estimation (SQUIRE) snow water equivalent (SWE) product derived from the Colorado State University (CSU) X-band radar, a hydrometeor phase classification data set was developed to systematically identify phase of the near-surface precipitation. The algorithm uses Corrected Moments in Antenna Coordinates (CMAC) fields with semi-supervised classification (SSC) and fuzzy-logic hydrometeor classification (FHC) methods and maps hydrometeor classes to a compact set of phase classes suitable for Quantitative Precipitation Estimation (QPE) and hydrologic applications. We used SQUIRE grid projections to mitigate beam-blockage issues by selecting the near-surface gates for each beam as well as to make it directly usable for the QPE products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Velocity reconstruction in the era of DESI and Rubin/LSST. II. Realistic samples on the light cone

Reconstructing the galaxy peculiar velocity field from the distribution of large-scale structure plays an important role in cosmology. On one hand, it gives us an insight into structure formation and gravity; on the other, it allows us to selectively extract the kinetic Sunyaev-Zel’dovich (kSZ) effect from cosmic microwave background maps. In this work, we employ high-accuracy synthetic galaxy catalogs on the light cone to investigate how well we can recover the velocity field when utilizing the three-dimensional spatial distribution of the galaxies in a modern large-scale structure experiment such as the Dark Energy Spectroscopic Instrument (DESI) and the Rubin Observatory Legacy Survey of Space and Time. In particular, we adopt the standard technique used in baryon acoustic oscillation analysis for reconstructing the Zel’dovich displacements of galaxies through the continuity equation, which yields a first-order approximation to their large-scale velocities. We investigate variations in the number density, bias, mask, area, redshift noise, and survey depth, as well as modifications to the settings of the standard reconstruction algorithm. Since our main goal is to provide guidance for planned kSZ analysis between DESI and the Atacama Cosmology Telescope, we apply velocity reconstruction to a faithful representation of DESI spectroscopic and photometric targets. We report the cross-correlation coefficient between the reconstructed and the true velocities along the line of sight. For the DESI Y1 spectroscopic survey, we expect the correlation coefficient to be r ≈ 0.64, while for a photometric survey with δ z /(1+z) = 0.02, as is approximately the case for the Legacy Survey used in the target selection of DESI galaxies, r shrinks by half to r ≈ 0.31. Here, we hope the results in this paper can be used to inform future kSZ stacking studies and other velocity reconstruction analyses planned with the next generation of cosmology experiments.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Measurement of transverse momentum relative to dijet systems in PbPb and $pp$ collisions at $\sqrt{s_{NN}} = 2.76$ TeV

An analysis of dijet events in PbPb and pp collisions is performed to explore the properties of energy loss by partons traveling in a quark-gluon plasma. Data are collected at a nucleon-nucleon center-of-mass energy of 2.76 TeV at the LHC. The distribution of transverse momentum (p T ) surrounding dijet systems is measured by selecting charged particles in different ranges of p T and at different angular cones of pseudorapidity and azimuth. The measurement is performed as a function of centrality of the PbPb collisions, the p T asymmetry of the jets in the dijet pair, and the distance parameter R used in the anti-k T jet clustering algorithm. In events with unbalanced dijets, PbPb collisions show an enhanced multiplicity in the hemisphere of the subleading jet, with the p T imbalance compensated by an excess of low-p T particles at large angles from the jet axes.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Machine learning-guided design, synthesis, and characterization of atomically dispersed electrocatalysts

The recent integration of machine learning into materials design has revolutionized the understanding of structure–property relationships and optimization of material properties beyond the trial-and-error paradigm. On one hand, machine learning has significantly accelerated the development of atomically dispersed metal-nitrogen-carbon (M-N-C) electrocatalysts, which traditionally heavily relied on heuristic approaches. On the other hand, the primary challenge of leveraging machine learning to expedite M-N-C materials discovery lies in the cost associated with data collection. Here, we review recent machine learning integration strategies for M-N-C catalyst development, including discussions on the typical algorithms such as symbolic regression and convolutional neural networks employed for the theoretical design, synthesis optimization via active learning, and advanced microscopy characterization. Subsequently, we provide our perspective on potential near-future directions for furthering machine learning-assisted development of new M-N-C catalysts and elucidating the complex physicochemical mechanisms governing the selectivity, activity, and durability in this class of materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Discovery of peculiar radio morphologies with ASKAP using unsupervised machine learning

Abstract We present a set of peculiar radio sources detected using an unsupervised machine learning method. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope to train a self-organizing map (SOM). The radio maps from three ASKAP surveys, Evolutionary Map of Universe pilot survey (EMU-PS), Deep Investigation of Neutral Gas Origins pilot survey (DINGO), and Survey With ASKAP of GAMA-09 + X-ray (SWAG-X), are used to search for the rarest or unknown radio morphologies. We use an extension of the SOM algorithm that implements rotation and flipping invariance on astronomical sources. The SOM is trained using the images of all ‘complex’ radio sources in the EMU-PS which we define as all sources catalogued as ‘multi-component’. The trained SOM is then used to estimate a similarity score for complex sources in all surveys. We select 0.5% of the sources that are most complex according to the similarity metric and visually examine them to find the rarest radio morphologies. Among these, we find two new odd radio circle (ORC) candidates and five other peculiar morphologies. We discuss multiwavelength properties and the optical/infrared counterparts of selected peculiar sources. In addition, we present examples of conventional radio morphologies including: diffuse emission from galaxy clusters, and resolved, bent-tailed, and FR-I and FR-II type radio galaxies. We discuss the overdense environment that may be the reason behind the circular shape of ORC candidates.

Astronomy & Astrophysics↗
DOE OSTI2025

Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data

We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation (emulator) used in the mocks. Importantly, we find a close agreement (≤ 8% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, making it particularly relevant to the broad current and future analyses of DESI data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Lowering the CUORE energy threshold

The Cryogenic Underground Observatory for Rare Events (CUORE) is a ton-scale double beta decay experiment based on TeO2 cryogenic bolometers and is currently in the last construction stage at the Gran Sasso National Laboratory (LNGS). Its primary goal is to observe neutrino-less double beta decay of 130Te, however thanks to the ultra-low background and large projected exposure it could also be suitable for other rare event searches, as the detection of solar axions, neutrinos from type II supernovae or direct detection of dark matter. The sensitivity for these searches will depend on the performance achieved at the low energy threshold. For this reason a trigger algorithm based on continuous data filtering has been developed which will allow lowering the threshold down to the few keV region. The new trigger has been tested in CUORE-0, a single-tower CUORE prototype consisting of 52 TeO2 bolometers and recently concluded, and here we present the results in terms of trigger efficiency, data selection and low-energy calibration.

Copello, S↗
DOE OSTI2016

Poster – 02: Positron Emission Tomography (PET) Imaging Reconstruction using higher order Scattered Photon Coincidences

PET images are affected by the presence of scattered photons. Incorrect scatter-correction may cause artifacts, particularly in 3D PET systems. Current scatter reconstruction methods do not distinguish between single and higher order scattered photons. A dual-scattered reconstruction method (GDS-MLEM) that is independent of the number of Compton scattering interactions and less sensitive to the need for high energy resolution detectors, is proposed. To avoid overcorrecting for scattered coincidences, the attenuation coefficient was calculated by integrating the differential Klein-Nishina cross-section over a restricted energy range, accounting only for scattered photons that were not detected. The optimum image can be selected by choosing an energy threshold which is the upper energy limit for the calculation of the cross-section and the lower limit for scattered photons in the reconstruction. Data was simulated using the GATE platform. 500,000 multiple scattered photon coincidences with perfect energy resolution were reconstructed using various methods. The GDS-MLEM algorithm had the highest confidence (98%) in locating the annihilation position and was capable of reconstructing the two largest hot regions. 100,000 photon coincidences, with a scatter fraction of 40%, were used to test the energy resolution dependence of different algorithms. With a 350–650 keV energy window and the restricted attenuation correction model, the GDS-MLEM algorithm was able to improve contrast recovery and reduce the noise by 7.56%–13.24% and 12.4%–24.03%, respectively. This approach is less sensitive to the energy resolution and shows promise if detector energy resolutions of 12% can be achieved.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

HBMax: Optimizing Memory Efficiency for Parallel Influence Maximization on Multicore Architectures

The goal of influence maximization is to select k most-influential vertices or seeds in a network, where influence is defined by a given diffusion process. The problem has a number of important applications such as viral marketing, information spread, and epidemic control. Although computing optimal seed set is NP-Hard, due to the submodular nature of the problem efficient approximation algorithms exist. However, even state-of-the-art parallel implementations are limited by a sampling step that incurs large memory footprints. This in turn limits the problem size reach and approximation quality. In this work, we study the memory footprint of the sampling process collecting reverse reachability information in the IMM algorithm over large real-world social networks. We present an adaptive and memory-efficient optimization approach for a state-of-the-art multi-threaded parallel influence maximization algorithm. Our approach,HuffMax, uses a portion of the reverse reachable (RR) sets collected by the algorithm to learn the characteristics of the graph. Then, it compresses the intermediate reverse reachability information with Huffman coding, and queries directly on the compressed data to preserve the memory savings obtained through compression. We also propose an efficient sampling strategy based on the distribution of RR sets, which can further reduce the computation time for typical social networks with long-tail distributions. Considering a NUMA architecture, we scale up our solution on 128-core CPUs and reduce the memory footprint by up to 45.7% with negligible time overhead (or even faster) and without perceivable loss of accuracy.

Chen, Xinyu↗