most citedViTKD: Practical Guidelines for ViT feature knowledge distillation

23 citations · 46 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CV2022★ 19 cited

Group DETR v2: Strong Object Detector with Encoder-Decoder Pretraining

Qiang Chen, Jian Wang, Chuchu Han +12

We present a strong object detector with encoder-decoder pretraining and finetuning. Our method, called Group DETR v2, is built upon a vision transformer encoder ViT-Huge~\cite{dos…

cs.CV2022★ 23 cited

ViTKD: Practical Guidelines for ViT feature knowledge distillation

Zhendong Yang, Zhe Li, Ailing Zeng +3

Knowledge Distillation (KD) for Convolutional Neural Network (CNN) is extensively studied as a way to boost the performance of a small model. Recently, Vision Transformer (ViT) has…

cs.CV2022★ 4 cited

G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model

Pan Xie, Qipeng Zhang, Taiyi Peng +3

The Sign Language Production (SLP) project aims to automatically translate spoken languages into sign sequences. Our approach focuses on the transformation of sign gloss sequences…

eess.IV2021

ReconfigISP: Reconfigurable Camera Image Processing Pipeline

Ke Yu, Zexian Li, Yue Peng +2

Image Signal Processor (ISP) is a crucial component in digital cameras that transforms sensor signals into images for us to perceive and understand. Existing ISP designs always ado…

cs.CL2021

MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation

Pan Xie, Zexian Li, Xiaohui Hu

Conditional masked language models (CMLM) have shown impressive progress in non-autoregressive machine translation (NAT). They learn the conditional translation model by predicting…