Harpagon: Minimizing DNN Serving Cost via Efficient Dispatching, Scheduling and Splitting

Zhixin Zhao, Yitao Hu, Ziqi Gong +5

Advances in deep neural networks (DNNs) have significantly contributed to the development of real-time video processing applications. Efficient scheduling of DNN workloads in cloud…