Serve Now or Improve Later? Scheduling Self-Evolution in Online Agent Systems

Yangbo Wei, Junhong Qian, Zhen Huang +6

Online agents can improve future service by constructing reusable tools, guidance, or model states, but this work competes with current requests for the same GPUs. Exploiting idle…