Self-Knowledge Distillation in Natural Language Processing

Sangchul Hahn, Heeyoul Choi

Since deep learning became a key player in natural language processing (NLP), many deep learning models have been showing remarkable performances in a variety of NLP tasks, and in…