Linguistic Interpretability of Transformer-based Language Models: a systematic review

Miguel López-Otal, Jorge Gracia, Jordi Bernad +3

Language models based on the Transformer architecture achieve excellent results in many language-related tasks, such as text classification or sentiment analysis. However, despite…