SMART-MIG: A Learning Framework for Scalable and Energy-Efficient GPU Scheduling

Wenqing Yu, Neel Karia, Tanvi Hisaria +3

The emergence of Multi-Instance GPU (MIG) technology enables us to run smaller machine learning models on partitions of a GPU rather than the entire device, thus improving utilizat…