most citedBetter Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation

19 citations · 33 across the 5 of their papers we have counts for

collaborators

5 papers

cs.LG2023

Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators

Sikai Bai, Shuaicheng Li, Weiming Zhuang +7

Federated learning has become a popular method to learn from decentralized heterogeneous data. Federated semi-supervised learning (FSSL) emerges to train models from a small fracti…

cs.CV2022★ 1 cited

An Empirical Study of Pseudo-Labeling for Image-based 3D Object Detection

Xinzhu Ma, Yuan Meng, Yinmin Zhang +4

Image-based 3D detection is an indispensable component of the perception system for autonomous driving. However, it still suffers from the unsatisfying performance, one of the main…

cs.CV2022★ 8 cited

StyleFlow For Content-Fixed Image to Image Translation

Weichen Fan, Jinghuan Chen, Jiabin Ma +2

Image-to-image (I2I) translation is a challenging topic in computer vision. We divide this problem into three tasks: strongly constrained translation, normally constrained translat…

cs.CV2022★ 5 cited

Probing Visual-Audio Representation for Video Highlight Detection via Hard-Pairs Guided Contrastive Learning

Shuaicheng Li, Feng Zhang, Kunlin Yang +4

Video highlight detection is a crucial yet challenging problem that aims to identify the interesting moments in untrimmed videos. The key to this task lies in effective video repre…

cs.CV2022★ 19 cited

Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation

Zengyu Qiu, Xinzhu Ma, Kunlin Yang +4

Knowledge distillation (KD) has shown very promising capabilities in transferring learning representations from large models (teachers) to small models (students). However, as the…