Search NASA⌕ Search

DOE OSTI · 1788374

Generic, Sparse Tensor Core for Neural Networks

Abstract

Sparse neural network attracts more attention for model compression, fast execution, and power reduction. The state-of-the-art designed sparse tensor core for structured and static sparsity, which did not support well for generic or dynamic sparsity. We design a sparse tensor core to support generic sparsity pruning with a novel hybrid and blocked sparse matrix storage format, HB-ELL, which saves computation and storage while keeping the most significant elements, as well as supporting dynamic sparsity for data flow in neural networks. We achieve better performance with preliminary results than the state-of- the-art on an NVIDIA GPU simulator.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Wu, Xiaolong, Yi, Yang, Tian, Dave, Li, Jiajia. 2020-10-02. Generic, Sparse Tensor Core for Neural Networks. https://searchnasa.com/record/osti%3A1788374/generic-sparse-tensor-core-for-neural-networks

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.