2 citations · 2 across the 5 of their papers we have counts for
1 paper · 1 filter
Ruixuan Tu, Yuyang Dong
Knowledge distillation (KD) frameworks place teacher and student on the same GPUs, so per-GPU memory limits the teachers that fit. DisaggKD separates them across nodes: teacher rep…