What Does Multiple Choice Actually Measure? Disentangling Video Understanding from Option Exploitation

Elliott Piercy, Justin Chan, Sepand Dyanatkar

Video understanding evaluations are intended to measure a model's proficiency in video perception and task solving. However, current VideoQA benchmarks struggle to isolate these ca…