LAKD-Activation Mapping Distillation Based on Local Learning

Yaoze Zhang, Yuming Zhang, Yu Zhao +2

Knowledge distillation is widely applied in various fundamental vision models to enhance the performance of compact models. Existing knowledge distillation methods focus on designi…