Reward-Aware Population Scaling of Evolutionary Strategies in LLM Fine-Tuning

Sung Cho, Gyubin Han

Using Evolutionary Strategies (ES) for fine-tuning large language models is attractive because it is memory-efficient, parallel, and compatible with black-box or discrete rewards.…