84 citations · 161 across the 14 of their papers we have counts for
Showing cs.CVShow all
3 papers · 1 filter
cs.CV2022
Spatial Entropy as an Inductive Bias for Vision Transformers
Elia Peruzzo, Enver Sangineto, Yahui Liu +4
Recent work on Vision Transformers (VTs) showed that introducing a local inductive bias in the VT architecture helps reducing the number of samples necessary for training. However,…
cs.CV2022
Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers
Bin Ren, Yahui Liu, Yue Song +4
Position Embeddings (PEs), an arguably indispensable component in Vision Transformers (ViTs), have been shown to improve the performance of ViTs on many vision tasks. However, PEs…
cs.CV2021★ 84 cited
Efficient Training of Visual Transformers with Small Datasets
Yahui Liu, Enver Sangineto, Wei Bi +3
Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between im…