Model Distillation with Knowledge Transfer from Face Classification to Alignment and Verification

Chong Wang, Xipeng Lan, Yangang Zhang

Knowledge distillation is a potential solution for model compression. The idea is to make a small student network imitate the target of a large teacher network, then the student ne…