Hummingbird: SLO-Oriented GPU Preemption at Microsecond-scale

Tiancheng Hu, Chenxi Wang, Ting Cao +9

Existing GPU-sharing techniques, including spatial and temporal sharing, aim to improve utilization but face challenges in simultaneously ensuring SLO adherence and maximizing effi…