Fragility Is Not Reducible to Hardness: Conditional Causal Difficulty for LLMs

Mohammad Reza Rezaei, Dingxian Wang, Nikhil Verma +3

Large language models show large and seemingly arbitrary performance drops when a task is rewritten in ways that leave its requirements untouched. We recast task difficulty as a ca…