Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates

Shirley Kokane, Mostofa Rafid Uddin, Min Xu

Transfer learning methods start performing poorly when the complexity of the learning task is increased. Most of these methods calculate the cumulative differences of all the match…