Accelerating End-Cloud Collaborative Inference via Near Bubble-free Pipeline Optimization

Luyao Gao, Jianchun Liu, Hongli Xu +3

End-cloud collaboration offers a promising strategy to enhance the Quality of Service (QoS) in DNN inference by offloading portions of the inference workload from end devices to cl…