INAR-VL: Input-Aware Routing for Edge-Cloud Vision-Language Inference

Ahmed Šabanović, Paul Joe Maliakel, Ivona Brandić

Edge deployment of Vision-Language Models (VLMs) faces a tradeoff between latency and accuracy: cloud execution provides high-quality predictions but incurs communication delay and…