21 citations · 38 across the 3 of their papers we have counts for
3 papers · 1 filter
SkyServe: Serving AI Models across Regions and Clouds with Spot Instances
Ziming Mao, Tian Xia, Zhanghao Wu +6
Recent years have witnessed an explosive growth of AI models. The high cost of hosting AI services on GPUs and their demanding service requirements, make it timely and challenging…
Ekya: Continuous Learning of Video Analytics Models on Edge Compute Servers
Romil Bhardwaj, Zhengxu Xia, Ganesh Ananthanarayanan +6
Video analytics applications use edge compute servers for the analytics of the videos (for bandwidth and privacy). Compressed models that are deployed on the edge servers for infer…
HyperSched: Dynamic Resource Reallocation for Model Development on a Deadline
Richard Liaw, Romil Bhardwaj, Lisa Dunlap +4
Prior research in resource scheduling for machine learning training workloads has largely focused on minimizing job completion times. Commonly, these model training workloads colle…