TensorDash: Exploiting Sparsity to Accelerate Deep Neural Network Training and Inference

Mostafa Mahmoud, Isak Edo, Ali Hadi Zadeh +4

TensorDash is a hardware level technique for enabling data-parallel MAC units to take advantage of sparsity in their input operand streams. When used to compose a hardware accelera…