A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models

Alessandro Rozza, Davide Mambelli, Steven Motta +1

An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not what the majority said but who…