2 papers
cs.AI2025
Dynamic Speculative Agent Planning
Yilin Guan, Qingfeng Lan, Sun Fei +5
Despite their remarkable success in complex tasks propelling widespread adoption, large language-model-based agents still face critical deployment challenges due to prohibitive lat…
cs.LG2025
Semantic Scheduling for LLM Inference
Wenyue Hua, Dujian Ding, Yile Gu +4
Conventional operating system scheduling algorithms are largely content-ignorant, making decisions based on factors such as latency or fairness without considering the actual inten…