LaajMeter: A Framework for LaaJ Evaluation

Samuel Ackerman, Gal Amram, Ora Nova Fandina +5

Large Language Models (LLMs) are increasingly used as evaluators in natural language processing tasks, a paradigm known as LLM-as-a-Judge (LaaJ). The analysis of a LaaJ software, c…