Submodular Evaluation Subset Selection in Automatic Prompt Optimization

Jinming Nian, Zhiyuan Peng, Hongwei Shang +2

Automatic prompt optimization reduces manual prompt engineering, but relies on task performance measured on a small, often randomly sampled evaluation subset as its main source of…