No Universal Signal Predicts Sample-Level LLM Regression under Version Updates

Jia Sheng, Yiwei Lu

Frontier LLMs are updated frequently and typically outperform their predecessors in aggregate. But aggregate gains say little about individual samples: an update can still cause sa…