Cicada: A Pipeline-Efficient Approach to Serverless Inference with Decoupled Management

Z. Wu, Y. Deng, J. Hu +4

Serverless computing has emerged as a pivotal paradigm for deploying Deep Learning (DL) models, offering automatic scaling and cost efficiency. However, the inherent cold start pro…