More Programs or More Rolls? Separating Coverage from Specialization in LLM Harnesses

Ziyang Xu, Haitian Zhong, Hao Zhou +5

Automated generation of LLM harnesses promises to improve inference through task specialization. Yet additional answer coverage can arise from repeated execution of the same progra…