Self-Knowledge Distillation for Learning Ambiguity

Hancheol Park, Soyeong Jeong, Sukmin Cho +1

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that c…