Investigating the Encoding of Words in BERT's Neurons using Feature Textualization

Tanja Baeumel, Soniya Vijayakumar, Josef van Genabith +2

Pretrained language models (PLMs) form the basis of most state-of-the-art NLP technologies. Nevertheless, they are essentially black boxes: Humans do not have a clear understanding…