ModelCI-e: Enabling Continual Learning in Deep Learning Serving Systems

Yizheng Huang, Huaizheng Zhang, Yonggang Wen +2

MLOps is about taking experimental ML models to production, i.e., serving the models to actual users. Unfortunately, existing ML serving systems do not adequately handle the dynami…