Learning the Wrong Lessons: Inserting Trojans During Knowledge Distillation

Leonard Tang, Tom Shlomi, Alexander Cai

In recent years, knowledge distillation has become a cornerstone of efficiently deployed machine learning, with labs and industries using knowledge distillation to train models tha…