22 citations · 24 across the 5 of their papers we have counts for
1 paper · 2 filters
Mitchell A. Gordon, Kevin Duh
Sequence-level knowledge distillation (SLKD) is a model compression technique that leverages large, accurate teacher models to train smaller, under-parameterized student models. Wh…