Showing cs.PFShow all
2 papers · 1 filter
cs.PF2026
Multi-Turn LLM Conversations under the Least-Recently-Used Policy: Mean-Field Asymptotics and Hit Ratio Approximation
Heyuan Yao, Chutong Gao, Yuan Lyu +2
The major workloads in modern large language model (LLM) serving systems have shifted from single-shot LLM calls to multi-turn conversations, where new responses are generated base…
cs.PF2026
Throughput-Optimal Multiresource-Job Scheduling with Continuous Requirement Distribution
Heyuan Yao, Willow Kowalik, Izzy Grosof
Modern computing systems process jobs with resource requirements such as CPU and memory, which are described by multiresource jobs (MRJ) queueing models. In practice, job resource…