EconoServe: Maximizing Multi-Resource Utilization with SLO Guarantees in LLM Serving

Haiying Shen, Tanmoy Sen

As Large Language Models (LLMs) continue to grow, reducing costs and alleviating GPU demands has become increasingly critical. However, existing schedulers primarily target either…