activity
20172022
most citedULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks

113 citations · 135 across the 9 of their papers we have counts for

collaborators

11 papers

cs.CV2022

TPFNet: A Novel Text In-painting Transformer for Text Removal

Onkar Susladkar, Dhruv Makwana, Gayatri Deshmukh +3

Text erasure from an image is helpful for various tasks such as image editing and privacy preservation. In this paper, we present TPFNet, a novel one-stage (end-toend) network for…

cs.CV2020

Modeling Data Reuse in Deep Neural Networks by Taking Data-Types into Cognizance

Nandan Kumar Jha, Sparsh Mittal

In recent years, researchers have focused on reducing the model size and number of computations (measured as "multiply-accumulate" or MAC operations) of DNNs. The energy consumptio…

cs.LG20205 cited

DeepPeep: Exploiting Design Ramifications to Decipher the Architecture of Compact DNNs

Nandan Kumar Jha, Sparsh Mittal, Binod Kumar +1

The remarkable predictive performance of deep neural networks (DNNs) has led to their adoption in service domains of unprecedented scale and scope. However, the widespread adoption…

cs.CV20202 cited

On the Demystification of Knowledge Distillation: A Residual Network Perspective

Nandan Kumar Jha, Rajat Saini, Sparsh Mittal

Knowledge distillation (KD) is generally considered as a technique for performing model compression and learned-label smoothing. However, in this paper, we study and investigate th…

eess.SP2020

DRACO: Co-Optimizing Hardware Utilization, and Performance of DNNs on Systolic Accelerator

Nandan Kumar Jha, Shreyas Ravishankar, Sparsh Mittal +3

The number of processing elements (PEs) in a fixed-sized systolic accelerator is well matched for large and compute-bound DNNs; whereas, memory-bound DNNs suffer from PE underutili…

cs.CV2020113 cited

ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks

Rajat Saini, Nandan Kumar Jha, Bedanta Das +2

The capability of the self-attention mechanism to model the long-range dependencies has catapulted its deployment in vision models. Unlike convolution operators, self-attention off…