Utilizing dynamic sparsity on pretrained DETR

Reza Sedghi, Anand Subramoney, David Kappel

Efficient inference with transformer-based models remains a challenge, especially in vision tasks like object detection. We analyze the inherent sparsity in the MLP layers of DETR…