Mosaic: GPU Sharing with Latency Guarantees through Kernel-Level Interference Prediction

Foteini Strati, Ethan Graham, Leo Stephan +2

GPUs are increasingly in demand for AI workloads, yet often remain substantially underutilized, motivating workload colocation. However, colocation introduces interference that can…