C-NMT: A Collaborative Inference Framework for Neural Machine Translation

Yukai Chen, Roberta Chiaro, Enrico Macii +2

Collaborative Inference (CI) optimizes the latency and energy consumption of deep learning inference through the inter-operation of edge and cloud devices. Albeit beneficial for ot…