204 citations · 294 across the 6 of their papers we have counts for
Showing cs.CVShow all
2 papers · 1 filter
cs.CV2022
Curved Representation Space of Vision Transformers
Juyeop Kim, Junha Park, Songkuk Kim +1
Neural networks with self-attention (a.k.a. Transformers) like ViT and Swin have emerged as a better alternative to traditional convolutional neural networks (CNNs). However, our u…
cs.CV2022★ 204 cited
How Do Vision Transformers Work?
Namuk Park, Songkuk Kim
The success of multi-head self-attentions (MSAs) for computer vision is now indisputable. However, little is known about how MSAs work. We present fundamental explanations to help…