Scaling Textual Gradients via Sampling-Based Momentum

Zixin Ding, Junyuan Hong, Zhan Shi +6

LLM-based prompt optimization, which uses LLM-provided ``textual gradients'' (feedback) to refine prompts, has emerged as an effective method for automatic prompt engineering. Howe…