AgentBrew: Lifelong Knowledge Brewing from Strong Teachers to Weak LLM Agents

Yangqin Jiang, Chao Huang

Deploying LLM agents typically requires a compact test-time student, even if a stronger teacher is available during training. We study knowledge brewing: distilling a teacher's int…