Societal Biases in Language Generation: Progress and Challenges

Abstract

Technology for language generation has advanced rapidly, spurred by advancements in pre-training large models on massive amounts of data and the need for intelligent agents to communicate in a natural manner. While techniques can effectively generate fluent text, they can also produce undesirable societal biases that can have a disproportionately negative impact on marginalized populations. Language generation presents unique challenges for biases in terms of direct user interaction and the structure of decoding techniques. To better understand these challenges, we present a survey on societal biases in language generation, focusing on how data and techniques contribute to biases and progress towards reducing biases. Motivated by a lack of studies on biases from decoding techniques, we also conduct experiments to quantify the effects of these techniques. By further discussing general trends and open challenges, we call to attention promising directions for research and the importance of fairness and inclusivity considerations for language generation applications.

ACL 2021 camera-ready (v2), updated references (v3)

References in corpus (9)

• Language Models are Few-Shot Learners
• Equality of Opportunity in Supervised Learning
• Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models
• They, Them, Theirs: Rewriting with Gender-Neutral English
• Decoding and Diversity in Machine Translation
• Investigating Failures of Automatic Translation in the Case of Unambiguous Gender
• Improving Gender Translation Accuracy with Filtered Self-Training
• Gender Bias in Multilingual Neural Machine Translation: The Architecture Matters
• Discovering and Categorising Language Biases in Reddit