43 citations · 86 across the 6 of their papers we have counts for
3 papers · 1 filter
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks
Ahmed T. Elthakeb, Prannoy Pilligundla, Alex Cloninger +1
The deep layers of modern neural networks extract a rather rich set of features as an input propagates through the network. This paper sets out to harvest these rich intermediate r…
Reinforcement Learning and Adaptive Sampling for Optimized DNN Compilation
Byung Hoon Ahn, Prannoy Pilligundla, Hadi Esmaeilzadeh
Achieving faster execution with shorter compilation time can enable further diversity and innovation in neural networks. However, the current paradigm of executing neural networks…
SinReQ: Generalized Sinusoidal Regularization for Low-Bitwidth Deep Quantized Training
Ahmed T. Elthakeb, Prannoy Pilligundla, Hadi Esmaeilzadeh
Deep quantization of neural networks (below eight bits) offers significant promise in reducing their compute and storage cost. Albeit alluring, without special techniques for train…