113 citations · 143 across the 10 of their papers we have counts for
4 papers · 1 filter
A Survey of Techniques for Optimizing Transformer Inference
Krishna Teja Chitty-Venkata, Sparsh Mittal, Murali Emani +2
Recent years have seen a phenomenal rise in performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Represe…
DeepPeep: Exploiting Design Ramifications to Decipher the Architecture of Compact DNNs
Nandan Kumar Jha, Sparsh Mittal, Binod Kumar +1
The remarkable predictive performance of deep neural networks (DNNs) has led to their adoption in service domains of unprecedented scale and scope. However, the widespread adoption…
E2GC: Energy-efficient Group Convolution in Deep Neural Networks
Nandan Kumar Jha, Rajat Saini, Subhrajit Nag +1
The number of groups () in group convolution (GConv) is selected to boost the predictive performance of deep neural networks (DNNs) in a compute and parameter efficient manner.…
The Ramifications of Making Deep Neural Networks Compact
Nandan Kumar Jha, Sparsh Mittal, Govardhan Mattela
The recent trend in deep neural networks (DNNs) research is to make the networks more compact. The motivation behind designing compact DNNs is to improve energy efficiency since by…