SneakPeek: Data-Aware Model Selection and Scheduling for Inference Serving on the Edge

Joel Wolfrath, Daniel Frink, Abhishek Chandra

Modern applications increasingly rely on inference serving systems to provide low-latency insights with a diverse set of machine learning models. Existing systems often utilize res…