Energy-Conscious LLM Decoding: Impact of Text Generation Strategies on GPU Energy Consumption

Alireza Nik, Michael A. Riegler, PÃ¥l Halvorsen

Decoding strategies significantly influence the quality and diversity of the generated text in Large Language Models (LLMs), yet their impact on computational resources, particular…