FocusFormer: Focusing on What We Need via Architecture Sampler

Jing Liu, Jianfei Cai, Bohan Zhuang

Vision Transformers (ViTs) have underpinned the recent breakthroughs in computer vision. However, designing the architectures of ViTs is laborious and heavily relies on expert know…