224 citations
- Microsoft (United States)US7 papers
- Microsoft Research Montréal (Canada)4 papers
- University College LondonGB3 papers
- University of Illinois Urbana-ChampaignUS3 papers
- Bellevue Hospital CenterUS2 papers
- Carnegie Mellon UniversityUS2 papers
- Georgia Institute of TechnologyUS2 papers
- Orange (France)FR2 papers
- Research CanadaCA2 papers
- University of Massachusetts AmherstUS2 papers
- Aalto UniversityFI1 paper
- AIDS VancouverCA1 paper
4 papers · 2 filters
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime
Nick Craswell, Bhaskar Mitra, Emine Yilmaz +3
The TREC Deep Learning (DL) Track studies ad hoc search in the large data regime, meaning that a large set of human-labeled training data is available. Results so far indicate that…
Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence
Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani +1
The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark -- and can be considered to be an efficient (but slightly less e…
Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard
Jimmy Lin, Daniel Campos, Nick Craswell +2
Leaderboards are a ubiquitous part of modern research in applied machine learning. By design, they sort entries into some linear order, where the top-scoring entry is recognized as…
Tip of the Tongue Known-Item Retrieval: A Case Study in Movie Identification
Jaime Arguello, Adam Ferguson, Emery Fine +3
While current information retrieval systems are effective for known-item retrieval where the searcher provides a precise name or identifier for the item being sought, systems tend…