Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Framework

Maolin Wang, Jun Chu, Sicong Xie +4

In the era of mobile computing, deploying efficient Natural Language Processing (NLP) models in resource-restricted edge settings presents significant challenges, particularly in e…