UFO-ViT: High Performance Linear Vision Transformer without Softmax

Jeong-geun Song

Vision transformers have become one of the most important models for computer vision tasks. Although they outperform prior works, they require heavy computational resources on a sc…