Reducing Compute Waste in LLMs through Kernel-Level DVFS

Jeffrey Spaan, Kuan-Hsun Chen, Ana-Lucia Varbanescu

The rapid growth of AI has fueled the expansion of accelerator- or GPU-based data centers. However, the rising operational energy consumption has emerged as a critical bottleneck a…