84 citations · 161 across the 14 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022
Spatial Entropy as an Inductive Bias for Vision Transformers
Elia Peruzzo, Enver Sangineto, Yahui Liu +4
Recent work on Vision Transformers (VTs) showed that introducing a local inductive bias in the VT architecture helps reducing the number of samples necessary for training. However,…
cs.CV2022
Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers
Bin Ren, Yahui Liu, Yue Song +4
Position Embeddings (PEs), an arguably indispensable component in Vision Transformers (ViTs), have been shown to improve the performance of ViTs on many vision tasks. However, PEs…