Variational Language Concepts for Interpreting Foundation Language Models

Hengyi Wang, Shiwei Tan, Zhiqing Hong +2

Foundation Language Models (FLMs) such as BERT and its variants have achieved remarkable success in natural language processing. To date, the interpretability of FLMs has primarily…