REOrdering Patches Improves Vision Models

Declan Kutscher, David M. Chan, Yutong Bai +2

Sequence models such as transformers require inputs to be represented as one-dimensional sequences. In vision, this typically involves flattening images using a fixed row-major (ra…