33 citations · 41 across the 3 of their papers we have counts for
3 papers
cs.CV2023★ 7 cited
NormKD: Normalized Logits for Knowledge Distillation
Zhihao Chi, Tu Zheng, Hengjia Li +4
Logit based knowledge distillation gets less attention in recent years since feature based methods perform better in most cases. Nevertheless, we find it still has untapped potenti…
cs.LG2023★ 1 cited
Neural Collapse Inspired Federated Learning with Non-iid Data
Chenxi Huang, Liang Xie, Yibo Yang +3
One of the challenges in federated learning is the non-independent and identically distributed (non-iid) characteristics between heterogeneous devices, which cause significant diff…
cs.CV2020★ 33 cited
Towards Better Accuracy-efficiency Trade-offs: Divide and Co-training
Shuai Zhao, Liguang Zhou, Wenxiao Wang +3
The width of a neural network matters since increasing the width will necessarily increase the model capacity. However, the performance of a network does not improve linearly with…