Evolution or Illusion? Rethinking Evaluation in LLM Evolutionary Search

Tal Oved, Roi Pony, Oshri Naparstek +1

LLM-driven evolutionary search finds programs by launching seeds and iterating each one. Papers report a single budget setting, usually one seed run for a fixed number of iteration…