Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference

Luning Pang, Cheng Yuan, Jiawei Shao +2

Large multimodal models (LMMs) support diverse visual understanding and reasoning tasks but are often impractical to run entirely on resource-constrained devices. Device-edge co-in…