Sparse Double Descent in Vision Transformers: real or phantom threat?

Victor Quétu, Marta Milovanovic, Enzo Tartaglione

Vision transformers (ViT) have been of broad interest in recent theoretical and empirical works. They are state-of-the-art thanks to their attention-based approach, which boosts th…