Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging

Yu Gu, Zhi Zheng, Yunpeng Ba +3

Evolution Strategy (ES) is a promising alternative to gradient-based fine-tuning for resource-constrained Large Language Model (LLM) reasoning. However, directly applying ES to bil…