32 citations · 62 across the 11 of their papers we have counts for
12 papers
FissionReady: Joint Workload and Power Scheduling for Data Centers Powered by Small Modular Reactors
Raghavendra Kanakagiri, Rohan Basu Roy, Yankai Jiang +2
Data centers are increasingly exploring small modular nuclear reactors (SMRs) as a carbon-free power source, but variable datacenter demand and negative grid prices require the SMR…
ThirstyFLOPS: Water Footprint Modeling and Analysis Toward Sustainable HPC Systems
Yankai Jiang, Raghavendra Kanakagiri, Rohan Basu Roy +1
High-performance computing (HPC) systems are becoming increasingly water-intensive due to their reliance on water-based cooling and the energy used in power generation. However, th…
DarwinGame: Playing Tournaments for Tuning Applications in Noisy Cloud Environments
Rohan Basu Roy, Vijay Gadepally, Devesh Tiwari
This work introduces a new subarea of performance tuning -- performance tuning in a shared interference-prone computing environment. We demonstrate that existing tuners are signifi…
ForgetMeNot: Understanding and Modeling the Impact of Forever Chemicals Toward Sustainable Large-Scale Computing
Rohan Basu Roy, Raghavendra Kanakagiri, Yankai Jiang +1
Fluorinated compounds, often referred to as forever chemicals, are critical in various steps of semiconductor fabrication like lithography, etching, chamber cleaning, and others. F…
WaterWise: Co-optimizing Carbon- and Water-Footprint Toward Environmentally Sustainable Cloud Computing
Yankai Jiang, Rohan Basu Roy, Raghavendra Kanakagiri +1
The carbon and water footprint of large-scale computing systems poses serious environmental sustainability risks. In this study, we discover that, unfortunately, carbon and water s…
EcoLife: Carbon-Aware Serverless Function Scheduling for Sustainable Computing
Yankai Jiang, Rohan Basu Roy, Baolin Li +1
This work introduces ECOLIFE, the first carbon-aware serverless function scheduler to co-optimize carbon footprint and performance. ECOLIFE builds on the key insight of intelligent…
HotSwap: Enabling Live Dependency Sharing in Serverless Computing
Rui Li, Devesh Tiwari, Gene Cooperman
This work presents HotSwap, a novel provider-side cold-start optimization for serverless computing. This optimization reduces cold-start time when booting and loading dependencies…
LLM Inference Serving: Survey of Recent Advances and Opportunities
Baolin Li, Yankai Jiang, Vijay Gadepally +1
This survey offers a comprehensive overview of recent advancements in Large Language Model (LLM) serving systems, focusing on research since the year 2023. We specifically examine…
Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference
Baolin Li, Yankai Jiang, Vijay Gadepally +1
The rapid advancement of Generative Artificial Intelligence (GenAI) across diverse sectors raises significant environmental concerns, notably the carbon emissions from their cloud…
Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale
Dan Zhao, Siddharth Samsi, Joseph McDonald +5
As research and deployment of AI grows, the computational burden to support and sustain its progress inevitably does too. To train or fine-tune state-of-the-art models in NLP, comp…
Autonomy Loops for Monitoring, Operational Data Analytics, Feedback, and Response in HPC Operations
Francieli Boito, Jim Brandt, Valeria Cardellini +24
Many High Performance Computing (HPC) facilities have developed and deployed frameworks in support of continuous monitoring and operational data analytics (MODA) to help improve ef…
From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference
Siddharth Samsi, Dan Zhao, Joseph McDonald +7
Large language models (LLMs) have exploded in popularity due to their new generative capabilities that go far beyond prior state-of-the-art. These technologies are increasingly bei…