SkyServe: Serving AI Models across Regions and Clouds with Spot Instances

Ziming Mao, Tian Xia, Zhanghao Wu +6

Recent years have witnessed an explosive growth of AI models. The high cost of hosting AI services on GPUs and their demanding service requirements, make it timely and challenging…