GrateTile: Efficient Sparse Tensor Tiling for CNN Processing

Yu-Sheng Lin, Hung Chang Lu, Yang-Bin Tsao +3

We propose GrateTile, an efficient, hardwarefriendly data storage scheme for sparse CNN feature maps (activations). It divides data into uneven-sized subtensors and, with small ind…