Decoupled Visual Processing: Efficient Multimodal Adaptation via Modality-Specific Transformer Substitution

Mingkuan Feng, Zhengqi Wen, Jianhua Tao

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities by integrating visual and textual understanding within a unified transformer architecture. Howeve…