Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Saghar Irandoust, Thibaut Durand, Yunduz Rakhmangulova +2

Transformers have become central to recent advances in computer vision. However, training a vision Transformer (ViT) model from scratch can be resource intensive and time consuming…