1 paper · 1 filter
Kunxiong Zhu, Zhihao Shu, Hangyu Zheng +4
Disaggregating the two stages, Prefill and Decode, onto separate GPU pools is now a standard optimization for (text-only) LLM serving. However, multimodal LLMs (MLLMs), which add a…