Moirai: Towards Optimal Placement for Distributed Inference on Heterogeneous Devices

Beibei Zhang, Hongwei Zhu, Feng Gao +2

The escalating size of Deep Neural Networks (DNNs) has spurred a growing research interest in hosting and serving DNN models across multiple devices. A number of studies have been…