Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents

Yuanpu Cao, Saket Sathe, Hanyu Wang +3

While LLM-based agent systems have demonstrated remarkable proficiency in reasoning and solving complex real-world tasks, they also come with substantial token consumption and infe…