activity
20232025
most citedMobile V-MoEs: Scaling Down Vision Transformers via Sparse Mixture-of-Experts

3 citations · 5 across the 3 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.CV2024★ 2 cited

Multimodal Autoregressive Pre-training of Large Vision Encoders

Enrico Fini, Mustafa Shukor, Xiujun Li +13

We introduce a novel method for pre-training of large-scale vision encoders. Building on recent advancements in autoregressive pre-training of vision models, we extend this framewo…