15 citations · 17 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CV2023
MSViT: Dynamic Mixed-Scale Tokenization for Vision Transformers
Jakob Drachmann Havtorn, Amelie Royer, Tijmen Blankevoort +1
The input tokens to Vision Transformers carry little semantic meaning as they are defined as regular equal-sized patches of the input image, regardless of its content. However, pro…
cs.CV2023
Revisiting Single-gated Mixtures of Experts
Amelie Royer, Ilia Karmanov, Andrii Skliar +2
Mixture of Experts (MoE) are rising in popularity as a means to train extremely large-scale models, yet allowing for a reasonable computational cost at inference time. Recent state…