CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts

Shanu Kumar, Shubhanshu Khandelwal, Akhila Yesantarao Venkata +3

Prompts tuned for accuracy often grow long, raising inference cost on every model call. The best accuracy-cost trade-off depends on the task and the budget, so prompt optimization…