PartialLoading: User Scheduling and Bandwidth Allocation for Parameter-sharing Edge Inference

Guanqiao Qu, Qian Chen, Xianhao Chen +2

By provisioning inference offloading services, edge inference drives the rapid growth of AI applications at network edge. However, how to reduce the inference latency remains a sig…