No DNN Left Behind: Improving Inference in the Cloud with Multi-Tenancy

Amit Samanta, Suhas Shrinivasan, Antoine Kaufmann +1

With the rise of machine learning, inference on deep neural networks (DNNs) has become a core building block on the critical path for many cloud applications. Applications today re…