44 citations · 110 across the 13 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023★ 5 cited
Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation
Rongzhi Zhang, Jiaming Shen, Tianqi Liu +4
Knowledge distillation is a popular technique to transfer knowledge from large teacher models to a small student model. Typically, the student learns to imitate the teacher by mini…
cs.LG2021★ 4 cited
Rank4Class: A Ranking Formulation for Multiclass Classification
Nan Wang, Zhen Qin, Le Yan +4
Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive…