8 citations · 16 across the 5 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.IR2024
Best in Tau@LLMJudge: Criteria-Based Relevance Evaluation with Llama3
Naghmeh Farzi, Laura Dietz
Traditional evaluation of information retrieval (IR) systems relies on human-annotated relevance labels, which can be both biased and costly at scale. In this context, large langua…
cs.IR2024★ 2 cited
An Exam-based Evaluation Approach Beyond Traditional Relevance Judgments
Naghmeh Farzi, Laura Dietz
Current IR evaluation is based on relevance judgments, created either manually or automatically, with decisions outsourced to Large Language Models (LLMs). We offer an alternative…