Who Judges Matters: Measuring Family-Conditioned Preference in LLM-as-Judge Panels

David Ababio Awuni, Luke E. K. Achenie, Benjamin Tei Partey +2

Who the judge is can affect an LLM-as-judge result, but measuring that effect without confusing it with candidate quality is difficult. We study four open-weight families (Llama 3.…