Do Fine-tuned Commonsense Language Models Really Generalize?

Mayank Kejriwal, Ke Shen

Recently, transformer-based methods such as RoBERTa and GPT-3 have led to significant experimental advances in natural language processing tasks such as question answering and comm…