3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.LG2026
Strait: Perceiving Priority and Interference in ML Inference Serving
Haidong Zhao, Nikolaos Georgantas
Machine learning (ML) inference serving systems host deep neural network (DNN) models and schedule incoming inference requests across deployed GPUs. However, limited support for ta…
cs.LG2025★ 3 cited
ML Inference Scheduling with Predictable Latency
Haidong Zhao, Nikolaos Georgantas
Machine learning (ML) inference serving systems can schedule requests to improve GPU utilization and to meet service level objectives (SLOs) or deadlines. However, improving GPU ut…