2 papers
cs.LG2024
Towards Sustainable Large Language Model Serving
Sophia Nguyen, Beihao Zhou, Yi Ding +1
In this work, we study LLMs from a carbon emission perspective, addressing both operational and embodied emissions, and paving the way for sustainable LLM serving. We characterize…
cs.AR2024
GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissions
Tianyao Shi, Yanran Wu, Sihang Liu +1
LLMs have been widely adopted across many real-world applications. However, their widespread use comes with significant environmental costs due to their high computational intensit…