SERFLOW: A Cross-Service Cost Optimization Framework for SLO-Aware Dynamic ML Inference

Zongshun Zhang, Ibrahim Matta

Dynamic offloading of Machine Learning (ML) model partitions across different resource orchestration services, such as Function-as-a-Service (FaaS) and Infrastructure-as-a-Service…