Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models

Soham Poddar, Paramita Koley, Janardan Misra +3

Large language models (LLMs) are increasingly recognized for their exceptional generative capabilities and versatility across various tasks. However, the high inference costs assoc…