DecompX: Explaining Transformers Decisions by Propagating Token Decomposition

Ali Modarressi, Mohsen Fayyaz, Ehsan Aghazadeh +2

An emerging solution for explaining Transformer-based models is to use vector-based analysis on how the representations are formed. However, providing a faithful vector-based expla…