Masked Attention as a Mechanism for Improving Interpretability of Vision Transformers

Clément Grisi, Geert Litjens, Jeroen van der Laak

Vision Transformers are at the heart of the current surge of interest in foundation models for histopathology. They process images by breaking them into smaller patches following a…