activity
20232026
most citedLLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization

3 citations · 6 across the 9 of their papers we have counts for

collaborators
Showing 2025 · cs.AIShow all

1 paper · 2 filters

cs.AI2025

Efficient LLM Serving on Hybrid Real-time and Best-effort Requests

Wan Borui, Zhao Juntao, Jiang Chenyu +2

Recent breakthroughs in large Language Models (LLMs) have enabled various generative tasks on a single model. Real-world services (e.g., OpenAI's ChatGPT [27]) powered by an LLM of…