Revisiting Human-vs-LLM judgments using the TREC Podcast Track

Watheq Mansour, J. Shane Culpepper, Joel Mackenzie +1

Using large language models (LLMs) to annotate relevance is an increasingly important technique in the information retrieval community. While some studies demonstrate that LLMs can…