Emissions and Performance Trade-off Between Small and Large Language Models

Anandita Garg, Uma Gaba, Deepan Muthirayan +1

The advent of Large Language Models (LLMs) has raised concerns about their enormous carbon footprint, starting with energy-intensive training and continuing through repeated infere…