Improving and Simplifying Pattern Exploiting Training

Derek Tam, Rakesh R Menon, Mohit Bansal +2

Recently, pre-trained language models (LMs) have achieved strong performance when fine-tuned on difficult benchmarks like SuperGLUE. However, performance can suffer when there are…