Artifacts and Attention Sinks: Structured Approximations for Efficient Vision Transformers

Andrew Lu, Wentinn Liao, Liuhui Wang +2

Vision transformers have emerged as a powerful tool across a wide range of applications, yet their inner workings remain only partially understood. In this work, we examine the phe…