Sparse then Prune: Toward Efficient Vision Transformers

Yogi Prasetyo, Novanto Yudistira, Agus Wahyu Widodo

The Vision Transformer architecture is a deep learning model inspired by the success of the Transformer model in Natural Language Processing. However, the self-attention mechanism,…