Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
Efficient LLM Serving on Hybrid Real-time and Best-effort Requests
Wan Borui, Zhao Juntao, Jiang Chenyu +2
Recent breakthroughs in large Language Models (LLMs) have enabled various generative tasks on a single model. Real-world services (e.g., OpenAI's ChatGPT [27]) powered by an LLM of…
cs.AI2025
ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development
Borui Wan, Mingji Han, Yiyao Sheng +9
Checkpointing to preserve training states is crucial during the development of Large Foundation Models (LFMs), for training resumption upon various failures or changes in GPU resou…