9 citations · 10 across the 9 of their papers we have counts for
4 papers · 1 filter
Towards Sustainable Large Language Model Serving
Sophia Nguyen, Beihao Zhou, Yi Ding +1
In this work, we study LLMs from a carbon emission perspective, addressing both operational and embodied emissions, and paving the way for sustainable LLM serving. We characterize…
GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissions
Tianyao Shi, Yanran Wu, Sihang Liu +1
LLMs have been widely adopted across many real-world applications. However, their widespread use comes with significant environmental costs due to their high computational intensit…
FlexCache: Flexible Approximate Cache System for Video Diffusion
Desen Sun, Henry Tian, Tim Lu +1
Text-to-Video applications receive increasing attention from the public. Among these, diffusion models have emerged as the most prominent approach, offering impressive quality in v…
Uncertainty-Aware Decarbonization for Datacenters
Amy Li, Sihang Liu, Yi Ding
This paper represents the first effort to quantify uncertainty in carbon intensity forecasting for datacenter decarbonization. We identify and analyze two types of uncertainty -- t…