297 citations · 872 across the 14 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CV2022★ 297 cited
MetaFormer Baselines for Vision
Weihao Yu, Chenyang Si, Pan Zhou +5
MetaFormer, the abstracted architecture of Transformer, has been found to play a significant role in achieving competitive performance. In this paper, we further explore the capaci…
cs.CV2022
Inception Transformer
Chenyang Si, Weihao Yu, Pan Zhou +3
Recent studies show that Transformer has strong capability of building long-range dependencies, yet is incompetent in capturing high frequencies that predominantly convey local inf…
cs.CV2022★ 20 cited
Mugs: A Multi-Granular Self-Supervised Learning Framework
Pan Zhou, Yichen Zhou, Chenyang Si +3
In self-supervised learning, multi-granular features are heavily desired though rarely investigated, as different downstream tasks (e.g., general and fine-grained classification) o…