Dynamic Budget Allocation for LLM Evaluation under Hard Resource Constraints

Shai Feldman, Yaniv Romano

We evaluate large language models (LLMs) in multi-turn interactions through their time-to-event: the number of interaction steps required to produce an event of interest, such as a…