5 citations · 6 across the 5 of their papers we have counts for
3 papers · 1 filter
Energy-Aware Scheduling for Serverless LLM Serving on Shared GPUs
Tianyu Wang, Gourav Rattihalli, Aditya Dhakal +2
As LLM inference becomes a major cloud workload, its growing energy footprint makes cluster-wide energy optimization increasingly important. Serverless LLM serving helps platforms…
GreenFaaS: Maximizing Energy Efficiency of HPC Workloads with FaaS
Alok Kamatar, Valerie Hayot-Sasson, Yadu Babuji +6
Application energy efficiency can be improved by executing each application component on the compute element that consumes the least energy while also satisfying time constraints.…
Two stage cluster for resource optimization with Apache Mesos
Gourav Rattihalli, Pankaj Saha, Madhusudhan Govindaraju +1
As resource estimation for jobs is difficult, users often overestimate their requirements. Both commercial clouds and academic campus clusters suffer from low resource utilization…