TomasuLLM: Out-of-Order Speculative Execution for LLM Agents

Jiangnan Yu, Ceyu Xu, Mengming Li +6

Long-running tools can dominate coding-agent latency: compilers, test suites, and repository commands take seconds to minutes while the agent idles. This observation stall presents…