2 papers
cs.LG2025
Robust LLM Training Infrastructure at ByteDance
Borui Wan, Gaohong Liu, Zuquan Song +32
The training scale of large language models (LLMs) has reached tens of thousands of GPUs and is still continuously expanding, enabling faster learning of larger models. Accompanyin…
cs.AI2025
Efficient LLM Serving on Hybrid Real-time and Best-effort Requests
Wan Borui, Zhao Juntao, Jiang Chenyu +2
Recent breakthroughs in large Language Models (LLMs) have enabled various generative tasks on a single model. Real-world services (e.g., OpenAI's ChatGPT [27]) powered by an LLM of…