Counteracts: Testing Stereotypical Representation in Pre-trained Language Models

Damin Zhang, Julia Rayz, Romila Pradhan

Recently, language models have demonstrated strong performance on various natural language understanding tasks. Language models trained on large human-generated corpus encode not o…