Towards Sustainable Large Language Model Serving

Sophia Nguyen, Beihao Zhou, Yi Ding +1

In this work, we study LLMs from a carbon emission perspective, addressing both operational and embodied emissions, and paving the way for sustainable LLM serving. We characterize…