1 citations · 1 across the 4 of their papers we have counts for
1 paper · 1 filter
Dimitris Christou, Jiayi Chen, Nihal Sharma +3
Modern inference systems rely on batching to exploit parallel execution and amortize serial execution overheads, but batching creates a fundamental online scheduling tradeoff: serv…