4 papers
BIRDS: Characterizing and Understanding Biodiversity Impact of Large Language Model Serving
Tianyao Shi, Yi Ding
Large language model (LLM) serving creates environmental impacts beyond carbon and water, including ecosystem damage through biodiversity-related pathways. We present BIRDS, a fram…
Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective
Tianyao Shi, Yi Ding
Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains, but their heavy resource demands make quantization-reducing precision to lower-bit fo…
When Servers Meet Species: A Fab-to-Grave Lens on Computing's Biodiversity Impact
Tianyao Shi, Ritbik Kumar, Inez Hua +1
Biodiversity loss is a critical planetary boundary, yet its connection to computing remains largely unexamined. Prior sustainability efforts in computing have focused on carbon and…
GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissions
Tianyao Shi, Yanran Wu, Sihang Liu +1
LLMs have been widely adopted across many real-world applications. However, their widespread use comes with significant environmental costs due to their high computational intensit…