3 papers
cs.NI2026
Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines
Jhonatan Tavori, Gur-Eyal Sela, Ion Stoica +1
Inference systems increasingly combine a fast path that returns predictions within the application's latency deadline together with a higher-accuracy slow path that runs higher-com…
cs.CV2025
RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics
Gur-Eyal Sela, Kumar Krishna Agrawal, Bharathan Balaji +2
Live video analytics (LVA) runs continuously across massive camera fleets, but inference cost with modern vision models remains high. To address this, dynamic model size selection…
cs.OS2025
Towards Efficient and Practical GPU Multitasking in the Era of LLM
Jiarong Xing, Yifan Qiao, Simon Mo +5
GPU singletasking is becoming increasingly inefficient and unsustainable as hardware capabilities grow and workloads diversify. We are now at an inflection point where GPUs must em…