562 citations · 1.7k across the 17 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CV2021★ 353 cited
Early Convolutions Help Transformers See Better
Tete Xiao, Mannat Singh, Eric Mintun +3
Vision transformer (ViT) models exhibit substandard optimizability. In particular, they are sensitive to the choice of optimizer (AdamW vs. SGD), optimizer hyperparameters, and tra…
cs.CV2021
Region Similarity Representation Learning
Tete Xiao, Colorado J Reed, Xiaolong Wang +2
We present Region Similarity Representation Learning (ReSim), a new approach to self-supervised representation learning for localization-based tasks such as object detection and se…