Evaluating the Evaluator: Summarization Metrics and LLM-Judges beyond English

Jeremy Barnes, Naiara Perez, Alba Bonet-Jover +1

Automatic text summarization relies on automatic evaluation to quickly determine the quality of summarization models via automatic metrics and LLM-as-a-Judge models. However, these…