3 papers
cs.DC2026
Cache Your Prompt When It's Green: Carbon-Aware Caching for Large Language Model Serving
Yuyang Tian, Desen Sun, Yi Ding +1
As large language models (LLMs) become widely used, their environmental impact, especially carbon emission, has attracted more attention. Prior studies focus on compute-related car…
cs.LG2025
EnsembleCI: Ensemble Learning for Carbon Intensity Forecasting
Leyi Yan, Linda Wang, Sihang Liu +1
Carbon intensity (CI) measures the average carbon emissions generated per unit of electricity, making it a crucial metric for quantifying and managing the environmental impact. Acc…
cs.LG2024
Towards Sustainable Large Language Model Serving
Sophia Nguyen, Beihao Zhou, Yi Ding +1
In this work, we study LLMs from a carbon emission perspective, addressing both operational and embodied emissions, and paving the way for sustainable LLM serving. We characterize…