Accurate, yet inconsistent? Consistency Analysis on Language Understanding Models
arXiv:2108.06665
Abstract
Consistency, which refers to the capability of generating the same predictions for semantically similar contexts, is a highly desirable property for a sound language understanding model. Although recent pretrained language models (PLMs) deliver outstanding performance in various downstream tasks, they should exhibit consistent behaviour provided the models truly understand language. In this paper, we propose a simple framework named consistency analysis on language understanding models (CALUM)} to evaluate the model's lower-bound consistency ability. Through experiments, we confirmed that current PLMs are prone to generate inconsistent predictions even for semantically identical inputs. We also observed that multi-task training with paraphrase identification tasks is of benefit to improve consistency, increasing the consistency by 13% on average.
References in corpus (5)
- Language Models are Few-Shot Learners
- Prefix-Tuning: Optimizing Continuous Prompts for Generation
- Neural Text Generation with Unlikelihood Training
- AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts
- Does He Wink or Does He Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models