EdgeCoInfer: Hierarchical Collaborative Inference for On-Device Multimodal Large Models

Lin Tan, Songtao Guo, Mingyan Li +1

To deliver ubiquitous intelligence, modern mobile applications increasingly execute concurrent Multimodal Large Language Models (MLLMs) on edge devices, presenting severe challenge…