RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality?

Yuki Tatsunami, Masato Taki

For the past ten years, CNN has reigned supreme in the world of computer vision, but recently, Transformer has been on the rise. However, the quadratic computational cost of self-a…