Large Language Models as Optimizers

Chengrun Yang, Xuezhi Wang, Yifeng Lu +4

Optimization is ubiquitous. While derivative-based algorithms have been powerful tools for various problems, the absence of gradient imposes challenges on many real-world applicati…