Brevity is the soul of sustainability: Characterizing LLM response lengths

Soham Poddar, Paramita Koley, Janardan Misra +4

A significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is cruci…