AKTS: Sub-Microsecond Kernel Policy Switching for Language-Model Agents

Mohammadali Khodabandehlou, Mahdi Alizadeh

GPU-backed LLM servers multiplex interactive requests with background batch work on the same CPUs; a fixed kernel policy serves one objective and loses the other, so agentic OS con…