Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding

Songyang Gao, Shihan Dou, Qi Zhang +1

Dataset bias has attracted increasing attention recently for its detrimental effect on the generalization ability of fine-tuned models. The current mainstream solution is designing…