Budget-Adaptive Routing: Skipping the Weak When the Strong Answers Anyway

Wei Geng, Nitinder Mohan, Jörg Ott

Edge-cloud inference collaborations are often designed with a routing estimator that decides whether to offload each frame from weak models at the edge to stronger models in the cl…