Comparing energy consumption and accuracy in text classification inference

Johannes Zschache, Tilman Hartwig

The increasing deployment of large language models (LLMs) in natural language processing (NLP) tasks raises concerns about energy efficiency and sustainability. While prior researc…