Vision as LoRA

Han Wang, Yongjie Ye, Bingru Li +5

We introduce Vision as LoRA (VoRA), a novel paradigm for transforming an LLM into an MLLM. Unlike prevalent MLLM architectures that rely on external vision modules for vision encod…