Performance Isolation for Inference Processes in Edge GPU Systems

Juan José Martín, José Flich, Carles Hernández

This work analyzes the main isolation mechanisms available in modern NVIDIA GPUs: MPS, MIG, and the recent Green Contexts, to ensure predictable inference time in safety-critical a…