Interpreting vision transformers via residual replacement model

Jinyeong Kim, Junhyeok Kim, Yumin Shim +3

How do vision transformers (ViTs) represent and process the world? This paper addresses this long-standing question through the first systematic analysis of 6.6K features across al…