Benchmarking Energy Efficiency of Large Language Models Using vLLM

K. Pronk, Q. Zhao

The prevalence of Large Language Models (LLMs) is having an growing impact on the climate due to the substantial energy required for their deployment and use. To create awareness f…