Integrating attention into explanation frameworks for language and vision transformers

Marte Eggen, Jacob Lysnæs-Larsen, Inga Strümke

The attention mechanism lies at the core of the transformer architecture, providing an interpretable model-internal signal that has motivated a growing interest in attention-based…