SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases

Yanchen Liu, Jing Yan, Yan Chen +2

Recent studies reveal that various biases exist in different NLP tasks, and over-reliance on biases results in models' poor generalization ability and low adversarial robustness. T…