Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines

Jhonatan Tavori, Gur-Eyal Sela, Ion Stoica +1

Inference systems increasingly combine a fast path that returns predictions within the application's latency deadline together with a higher-accuracy slow path that runs higher-com…