17 citations · 20 across the 2 of their papers we have counts for
2 papers
cs.CV2022★ 3 cited
It's All in the Head: Representation Knowledge Distillation through Classifier Sharing
Emanuel Ben-Baruch, Matan Karklinsky, Yossi Biton +3
Representation knowledge distillation aims at transferring rich information from one model to another. Common approaches for representation distillation mainly focus on the direct…
cs.CV2021★ 17 cited
ML-Decoder: Scalable and Versatile Classification Head
Tal Ridnik, Gilad Sharir, Avi Ben-Cohen +2
In this paper, we introduce ML-Decoder, a new attention-based classification head. ML-Decoder predicts the existence of class labels via queries, and enables better utilization of…