Resource Allocation for Multiuser Edge Inference with Batching and Early Exiting (Extended Version)

Zhiyan Liu, Qiao Lan, Kaibin Huang

The deployment of inference services at the network edge, called edge inference, offloads computation-intensive inference tasks from mobile devices to edge servers, thereby enhanci…