works on
automated evaluation 1domain-agnostic assessment 1elo rating 1large language models 1pairwise comparison 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.CL2026

(Towards) Scalable Reliable Automated Evaluation with Large Language Models

Bertil Braun, Martin Forell

The paper presents a scalable framework for automatically evaluating large language model outputs using pairwise comparisons and an Elo rating system, achieving rankings that align…