152 citations
- Microsoft (United States)US4 papers
- Bellevue Hospital CenterUS2 papers
- University College LondonGB2 papers
- University of Illinois Urbana-ChampaignUS2 papers
- University of Massachusetts AmherstUS2 papers
- Centre de Recherche en InformatiqueFR1 paper
- Centre de Recherche en Informatique, Signal et Automatique de LilleFR1 paper
- Data & Society Research InstituteUS1 paper
- Haverford CollegeUS1 paper
- McGill UniversityCA1 paper
- Microsoft Research Montréal (Canada)1 paper
- Microsoft Research New York City (United States)1 paper
4 papers · 1 filter
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime
Nick Craswell, Bhaskar Mitra, Emine Yilmaz +3
The TREC Deep Learning (DL) Track studies ad hoc search in the large data regime, meaning that a large set of human-labeled training data is available. Results so far indicate that…
Improving Transformer-Kernel Ranking Model Using Conformer and Query Term Independence
Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani +1
The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark -- and can be considered to be an efficient (but slightly less e…
Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard
Jimmy Lin, Daniel Campos, Nick Craswell +2
Leaderboards are a ubiquitous part of modern research in applied machine learning. By design, they sort entries into some linear order, where the top-scoring entry is recognized as…
Tip of the Tongue Known-Item Retrieval: A Case Study in Movie Identification
Jaime Arguello, Adam Ferguson, Emery Fine +3
While current information retrieval systems are effective for known-item retrieval where the searcher provides a precise name or identifier for the item being sought, systems tend…