2 papers
cs.DC2024
Opara: Exploiting Operator Parallelism for Expediting DNN Inference on GPUs
Aodong Chen, Fei Xu, Li Han +4
GPUs have become the \emph{defacto} hardware devices for accelerating Deep Neural Network (DNN) inference workloads. However, the conventional \emph{sequential execution mode of DN…
cs.DC2024
HarmonyBatch: Batching multi-SLO DNN Inference with Heterogeneous Serverless Functions
Jiabin Chen, Fei Xu, Yikun Gu +3
Deep Neural Network (DNN) inference on serverless functions is gaining prominence due to its potential for substantial budget savings. Existing works on serverless DNN inference so…