Managing Multi Instance GPUs for High Throughput and Energy Savings

Abhijeet Saraha, Yuanbo Li, Chris Porter +1

Modern GPUs such as the Ampere series (A30, A100) as well as the Hopper series (H100, H200) offer performance as well as security isolation features. They also support a good amoun…