Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains

Yawen Xue, Masaya Tsunokake, Yuta Koreeda +3

Agentic large language models (LLMs) have become prominent for autonomously interacting with external environments and performing multi-step reasoning tasks. Most approaches levera…