Parameter-efficient Modularised Bias Mitigation via AdapterFusion

Deepak Kumar, Oleg Lesota, George Zerveas +4

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial train…