FinGraV: Methodology for Fine-Grain GPU Power Visibility and Insights

Varsha Singhania, Shaizeen Aga, Mohamed Assem Ibrahim

Ubiquity of AI makes optimizing GPU power a priority as large GPU-based clusters are often employed to train and serve AI models. An important first step in optimizing GPU power co…