14 citations · 33 across the 19 of their papers we have counts for
3 papers · 1 filter
GenTREC: The First Test Collection Generated by Large Language Models for Evaluating Information Retrieval Systems
Mehmet Deniz Türkmen, Mucahid Kutlu, Bahadir Altun +1
Building test collections for Information Retrieval evaluation has traditionally been a resource-intensive and time-consuming task, primarily due to the dependence on manual releva…
Correlation and Prediction of Evaluation Metrics in Information Retrieval
Mucahid Kutlu, Vivek Khetan, Matthew Lease
Because researchers typically do not have the time or space to present more than a few evaluation metrics in any published study, it can be difficult to assess relative effectivene…
Efficient Test Collection Construction via Active Learning
Md Mustafizur Rahman, Mucahid Kutlu, Tamer Elsayed +1
To create a new IR test collection at low cost, it is valuable to carefully select which documents merit human relevance judgments. Shared task campaigns such as NIST TREC pool doc…