2 papers
cs.DC2024
A House United Within Itself: SLO-Awareness for On-Premises Containerized ML Inference Clusters via Faro
Beomyeol Jeon, Chen Wang, Diana Arroyo +2
This paper tackles the challenge of running multiple ML inference jobs (models) under time-varying workloads, on a constrained on-premises production cluster. Our system Faro takes…
cs.DC2023
Optimizing simultaneous autoscaling for serverless cloud computing
Harold Ship, Evgeny Shindin, Chen Wang +2
This paper explores resource allocation in serverless cloud computing platforms and proposes an optimization approach for autoscaling systems. Serverless computing relieves users f…