28 citations · 47 across the 13 of their papers we have counts for
8 papers · 1 filter
How Much Freedom Does An Effectiveness Metric Really Have?
Alistair Moffat, Joel Mackenzie
It is tempting to assume that because effectiveness metrics have free choice to assign scores to search engine result pages (SERPs) there must thus be a similar degree of freedom a…
Efficient Immediate-Access Dynamic Indexing
Alistair Moffat, Joel Mackenzie
In a dynamic retrieval system, documents must be ingested as they arrive, and be immediately findable by queries. Our purpose in this paper is to describe an index structure and pr…
Batch Evaluation Metrics in Information Retrieval: Measures, Scales, and Meaning
Alistair Moffat
A sequence of recent papers has considered the role of measurement scales in information retrieval (IR) experimentation, and presented the argument that (only) uniform-step interva…
A Sensitivity Analysis of the MSMARCO Passage Collection
Joel Mackenzie, Matthias Petri, Alistair Moffat
The recent MSMARCO passage retrieval collection has allowed researchers to develop highly tuned retrieval systems. One aspect of this data set that makes it distinctive compared to…
Anytime Ranking on Document-Ordered Indexes
Joel Mackenzie, Matthias Petri, Alistair Moffat
Inverted indexes continue to be a mainstay of text search engines, allowing efficient querying of large document collections. While there are a number of possible organizations, do…
RMITB at TREC COVID 2020
Rodger Benham, Alistair Moffat, J. Shane Culpepper
Search engine users rarely express an information need using the same query, and small differences in queries can lead to very different result sets. These user query variations ha…
Boosting Search Performance Using Query Variations
Rodger Benham, Joel Mackenzie, Alistair Moffat +1
Rank fusion is a powerful technique that allows multiple sources of information to be combined into a single result set. However, to date fusion has not been regarded as being cost…
Assessing Efficiency-Effectiveness Tradeoffs in Multi-Stage Retrieval Systems Without Using Relevance Judgments
Charles L. A. Clarke, J. Shane Culpepper, Alistair Moffat
Large-scale retrieval systems are often implemented as a cascading sequence of phases -- a first filtering step, in which a large set of candidate documents are extracted using a s…