One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation

Hyunjong Ok, Minjae Park, Jaeho Lee

Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as order sensitivity (changes in a…