Large Vision-Language Models Get Lost in Attention

Gongli Xi, Ye Tian, Mengyu Yang +5

Despite the rapid evolution of training paradigms, the decoder backbone of large vision--language models (LVLMs) remains fundamentally rooted in the residual-connection Transformer…