72 citations · 351 across the 14 of their papers we have counts for
3 papers · 1 filter
From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference
Siddharth Samsi, Dan Zhao, Joseph McDonald +7
Large language models (LLMs) have exploded in popularity due to their new generative capabilities that go far beyond prior state-of-the-art. These technologies are increasingly bei…
Toward Sustainable HPC: Carbon Footprint Estimation and Environmental Implications of HPC Systems
Baolin Li, Rohan Basu Roy, Daniel Wang +3
The rapid growth in demand for HPC systems has led to a rise in carbon footprint, which requires urgent intervention. In this work, we present a comprehensive analysis of the carbo…
Clover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Service
Baolin Li, Siddharth Samsi, Vijay Gadepally +1
This paper presents a solution to the challenge of mitigating carbon emissions from hosting large-scale machine learning (ML) inference services. ML inference is critical to modern…