5 citations · 5 across the 1 of their papers we have counts for
1 paper
Rongzhi Zhang, Jiaming Shen, Tianqi Liu +4
Knowledge distillation is a popular technique to transfer knowledge from large teacher models to a small student model. Typically, the student learns to imitate the teacher by mini…