LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?

Rikiya Takehi, Ellen M. Voorhees, Tetsuya Sakai +1

Test collections are information-retrieval tools that allow researchers to quickly and easily evaluate ranking algorithms. While test collections have become an integral part of IR…