DOE OSTI · 3025679
Variable rate neural compression for sparse detector data
Abstract
Particle colliders produce data at extraordinary rates, posing major challenges for transmission and storage. High-throughput compression algorithms are therefore essential. In the sPHENIX experiment taking data at the Relativistic Heavy Ion Collider, a time projection chamber records three-dimensional (3D) particle trajectories that are highly sparse, making conventional learning-free lossy compression ineffective. Convolutional neural networks have surpassed traditional methods in compression ratio and accuracy. However, they fail to exploit sparsity for efficiency. To address these gaps, we present BCAE-VS, a bicephalous convolutional autoencoder with variable compression ratio for sparse data, which adapts compression to input complexity through key-point identification and sparse convolution. BCAE-VS achieves higher accuracy and compression ratios than prior neural approaches while being orders of magnitude smaller. Moreover, its throughput increases with sparsity—a property not observed in other methods. Although it was developed for collider experiments, BCAE-VS readily extends to other sparse data domains, such as light detection and ranging (LiDAR) sensing and 3D microscopy.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Huang, Yi [Brookhaven National Laboratory (BNL), Upton, NY (United States)] (ORCID:0000000270247469), Go, Yeonju [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Huang, Jin [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Li, Shuhang [Columbia Univ., New York, NY (United States)], Luo, Xihaier [Brookhaven National Laboratory (BNL), Upton, NY (United States)] (ORCID:000000027621940X), Marshall, Thomas [Univ. of California, Los Angeles, CA (United States)], Osborn, Joseph D. [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Pinkenburg, Christopher [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Ren, Yihui [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Shulga, Evgeny [Brookhaven National Laboratory (BNL), Upton, NY (United States); Stony Brook Univ., NY (United States)], Yoo, Shinjae [Brookhaven National Laboratory (BNL), Upton, NY (United States)], Yoon, Byung-Jun [Brookhaven National Laboratory (BNL), Upton, NY (United States); Texas A & M Univ., College Station, TX (United States)]. 2026-02-02. Variable rate neural compression for sparse detector data. https://doi.org/10.1016/j.patter.2025.101452
Cite the original work for its findings. Save a collection to share your selection of sources.