DVFS for Small Language Model Inference on Mobile Edge Devices

Jiesong Chen, Lixiang Han, Jiani Cao +2

This paper presents DVFSLM, a new dynamic voltage and frequency scaling (DVFS) design for energy-efficient inference of small language models (SLMs) on mobile edge devices. The gro…