Collapsed Language Models Promote Fairness

Jingxuan Xu, Wuyang Chen, Linyi Li +2

To mitigate societal biases implicitly encoded in recent successful pretrained language models, a diverse array of approaches have been proposed to encourage model fairness, focusi…