Multiple latent orderings better predict language model preferences

Aviral Chawla, William H. W. Thompson, Jean-Gabriel Young

Language models are frequently employed in settings where they are asked to make value judgments and choices. These observed choices often exhibit intransitivity: A model may prefe…