305 citations · 822 across the 79 of their papers we have counts for
Showing cs.MMShow all
2 papers · 1 filter
cs.MM2024
Routing Experts: Learning to Route Dynamic Experts in Multi-modal Large Language Models
Qiong Wu, Zhaoxi Ke, Yiyi Zhou +2
Recently, mixture of experts (MoE) has become a popular paradigm for achieving the trade-off between modal capacity and efficiency of multi-modal large language models (MLLMs). Dif…
cs.MM2024
Not All Attention is Needed: Parameter and Computation Efficient Transfer Learning for Multi-modal Large Language Models
Qiong Wu, Weihao Ye, Yiyi Zhou +2
In this paper, we propose a novel parameter and computation efficient tuning method for Multi-modal Large Language Models (MLLMs), termed Efficient Attention Skipping (EAS). Concre…