most citedSwapped Logit Distillation via Bi-level Teacher Alignment

1 citations

researchers with a paper here

Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.

collaborating institutions

1 paper

cs.LG2025★ 1 cited

Swapped Logit Distillation via Bi-level Teacher Alignment

Stephen Ekaputra Limantoro, Jhe-Hao Lin, Chih-Yu Wang +4

Knowledge distillation (KD) compresses the network capacity by transferring knowledge from a large (teacher) network to a smaller one (student). It has been mainstream that the tea…