2 papers
cs.CV2026
RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers
Timing Yang, Predrag Neskovic, Jansen Seheult +4
When humans see a bird, they recognize far more than just "bird" -- they see a head, wings, and talons, a structured assembly of reusable parts that can be identified across every…
cs.CV2026
ViT-5: Vision Transformers for The Mid-2020s
Feng Wang, Sucheng Ren, Tiezheng Zhang +4
This work presents a systematic investigation into modernizing Vision Transformer backbones by leveraging architectural advancements from the past five years. While preserving the…