MABViT -- Modified Attention Block Enhances Vision Transformers

Mahesh Ramesh, Aswinkumar Ramkumar

Recent studies have demonstrated the effectiveness of Gated Linear Units (GLU) in enhancing transformer models, particularly in Large Language Models (LLMs). Additionally, utilizin…