EdgeServing: Deadline-Aware Multi-DNN Serving at the Edge

Jiahe Cao, Xiaomeng Li, Qiang Liu +3

As edge computing expands, serving multiple deep neural network (DNN) models on a single shared GPU has become a common yet challenging scenario, where each scheduling decision aff…