Do Transformers know symbolic rules, and would we know if they did?

Tommi Gröndahl, Yujia Guo, N. Asokan

To improve the explainability of leading Transformer networks used in NLP, it is important to tease apart genuine symbolic rules from merely associative input-output patterns. Howe…