Dynamic Network Adaptation at Inference

Daniel Mendoza, Caroline Trippel

Machine learning (ML) inference is a real-time workload that must comply with strict Service Level Objectives (SLOs), including latency and accuracy targets. Unfortunately, ensurin…