Brevity Constraints Reverse Performance Hierarchies in Language Models

MD Azizul Hakim

Standard evaluation protocols reveal a counterintuitive phenomenon: on 7.7% of benchmark problems spanning five datasets, larger language models underperform smaller ones by 28.4 p…