7 citations · 8 across the 2 of their papers we have counts for
2 papers
cs.CV2023★ 7 cited
NormKD: Normalized Logits for Knowledge Distillation
Zhihao Chi, Tu Zheng, Hengjia Li +4
Logit based knowledge distillation gets less attention in recent years since feature based methods perform better in most cases. Nevertheless, we find it still has untapped potenti…
cs.LG2023★ 1 cited
Neural Collapse Inspired Federated Learning with Non-iid Data
Chenxi Huang, Liang Xie, Yibo Yang +3
One of the challenges in federated learning is the non-independent and identically distributed (non-iid) characteristics between heterogeneous devices, which cause significant diff…