Will the Judge Flip? Predicting Position-Sensitive LLM Judgments from Residual Stream Activations

Hashmath Shaik, Gnaneswar Villuri, Alex Doboli

The order in which candidate responses are presented can change an LLM judge's verdict. Detecting such a position flip ordinarily requires judging each pair in both orders, which d…