EdgeCoInfer: Hierarchical Collaborative Inference for On-Device Multimodal Large Models

Lin Tan, David K. Y. Yau, Songtao Guo +1

To deliver ubiquitous intelligence, modern mobile applications increasingly execute concurrent Multimodal Large Language Models (MLLMs) on edge devices, presenting severe challenge…