Speculative Macro Commit for Faster Tool-Using Agents

Zeyu Liu, Souvik Kundu, Peter A. Beerel

Tool-using LLM agents spend wall-clock time not only on model inference but also in serial action--observation turns, where each tool call, environment transition, and observation…