Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models

Guande He, Jianfei Chen, Jun Zhu

Large pre-trained language models (PLMs) have demonstrated strong performance on natural language understanding (NLU) tasks through fine-tuning. However, fine-tuned models still su…