Accuracy and Order Sensitivity Diverge Under Label-Free Strategies

Karl Hanna, Chen Feng

Multiple-choice benchmarks are widely used to evaluate large language models, but MCQ scores conflate knowledge with sensitivity to option order, which makes them unreliable measur…