Serving DNNs like Clockwork: Performance Predictability from the Bottom Up

Arpan Gujarati, Reza Karimi, Safya Alzayat +4

Machine learning inference is becoming a core building block for interactive web applications. As a result, the underlying model serving systems on which these applications depend…