183 citations · 184 across the 3 of their papers we have counts for
1 paper · 1 filter
Peifeng Yu, Yuqing Qiu, Xin Jin +1
Existing DNN serving solutions can provide tight latency SLOs while maintaining high throughput via careful scheduling of incoming requests, whose execution times are assumed to be…