74 citations · 186 across the 49 of their papers we have counts for
4 papers · 1 filter
Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution
Chuanguang Yang, Zhulin An, Linhang Cai +1
Knowledge distillation (KD) is an effective framework that aims to transfer meaningful information from a large teacher to a smaller student. Generally, KD often involves how to de…
A Channel-Aware Routing Protocol With Nearest Neighbor Regression For Underwater Sensor Networks
Boyu Diao, Chao Li, Qi Wang +2
The underwater acoustic channel is one of the most challenging communication channels. Due to periodical tidal and daily climatic variation, underwater noise is periodically fluctu…
Hierarchical Self-supervised Augmented Knowledge Distillation
Chuanguang Yang, Zhulin An, Linhang Cai +1
Knowledge distillation often involves how to define and transfer knowledge from teacher to student effectively. Although recent self-supervised contrastive knowledge achieves the b…
Mutual Contrastive Learning for Visual Representation Learning
Chuanguang Yang, Zhulin An, Linhang Cai +1
We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interactio…