A Simple yet Effective Self-Debiasing Framework for Transformer Models

Xiaoyue Wang, Lijie Wang, Xin Liu +3

Current Transformer-based natural language understanding (NLU) models heavily rely on dataset biases, while failing to handle real-world out-of-distribution (OOD) instances. Many m…