Conditional Evaluation of Language Models with Cheap Auxiliary Signals

Zhi Zhang, Lingfeng Lyu, Yue Kang +1

Aggregate accuracy hides where models succeed and fail. Estimating conditional performance profiles from gold labels alone is expensive, while cheap auxiliary signals such as LLM-j…