80 citations · 142 across the 9 of their papers we have counts for
4 papers · 1 filter
FPRaker: A Processing Element For Accelerating Neural Network Training
Omar Mohamed Awad, Mostafa Mahmoud, Isak Edo +5
We present FPRaker, a processing element for composing training accelerators. FPRaker processes several floating-point multiply-accumulation operations concurrently and accumulates…
TensorDash: Exploiting Sparsity to Accelerate Deep Neural Network Training and Inference
Mostafa Mahmoud, Isak Edo, Ali Hadi Zadeh +4
TensorDash is a hardware level technique for enabling data-parallel MAC units to take advantage of sparsity in their input operand streams. When used to compose a hardware accelera…
GOBO: Quantizing Attention-Based NLP Models for Low Latency and Energy Efficient Inference
Ali Hadi Zadeh, Isak Edo, Omar Mohamed Awad +1
Attention-based models have demonstrated remarkable success in various natural language understanding tasks. However, efficient execution remains a challenge for these models which…
BitPruning: Learning Bitlengths for Aggressive and Accurate Quantization
Miloš Nikolić, Ghouthi Boukli Hacene, Ciaran Bannon +5
Neural networks have demonstrably achieved state-of-the art accuracy using low-bitlength integer quantization, yielding both execution time and energy benefits on existing hardware…