Quantifying the Energy Consumption and Carbon Emissions of LLM Inference via Simulations

Miray Özcan, Philipp Wiesner, Philipp Weiß +1

The environmental impact of Large Language Models (LLMs) is rising significantly, with inference now accounting for more than half of their total lifecycle carbon emissions. Howeve…