CLM-as-a-Judge: Evaluating an Open Contrastive Decision Model on Public Judge Benchmarks

Gowthamkumar Nandakishore

An open contrastive decision model is near chance as a judge on the hard public benchmarks: Contrastive-LM/CLM-v0.1-8B scores between 0.351 (best- of-four, chance 0.250) and 0.593…