An investigation of structures responsible for gender bias in BERT and DistilBERT

Thibaud Leteno, Antoine Gourru, Charlotte Laclau +1

In recent years, large Transformer-based Pre-trained Language Models (PLM) have changed the Natural Language Processing (NLP) landscape, by pushing the performance boundaries of th…