Beyond the Capability Boundary: Zeroth-Order Optimization for Self-Evolving LLM Agents

Bingzhen Liu, Xiaomeng Fan, Yuwei Wu +4

Self-evolving methods improve the capabilities of LLM agents by sampling trajectories from the underlying LLMs and learning from these trajectories. However, these methods struggle…