How to augment your ViTs? Consistency loss and StyleAug, a random style transfer augmentation

Akash Umakantha, Joao D. Semedo, S. Alireza Golestaneh +1

The Vision Transformer (ViT) architecture has recently achieved competitive performance across a variety of computer vision tasks. One of the motivations behind ViTs is weaker indu…