RoToR: Towards More Reliable Responses for Order-Invariant Inputs

Soyoung Yoon, Dongha Ahn, Youngwon Lee +3

Mitigating positional bias of language models (LMs) for listwise inputs is a well-known and important problem (e.g., lost-in-the-middle). While zero-shot order-invariant LMs have b…