Reproducible Hybrid Time-Travel Retrieval in Evolving Corpora
arXiv:2411.04051 · doi:10.1145/3673791.3698421
Abstract
There are settings in which reproducibility of ranked lists is desirable, such as when extracting a subset of an evolving document corpus for downstream research tasks or in domains such as patent retrieval or in medical systematic reviews, with high reproducibility expectations. However, as global term statistics change when documents change or are added to a corpus, queries using typical ranked retrieval models are not even reproducible for the parts of the document corpus that have not changed. Thus, Boolean retrieval frequently remains the mechanism of choice in such settings. We present a hybrid retrieval system combining Lucene for fast retrieval with a column-store-based retrieval system maintaining a versioned and time-stamped index. The latter component allows re-execution of previously posed queries resulting in the same ranked list and further allows for time-travel queries over evolving collection, as web archives, while maintaining the original ranking. Thus, retrieval results in evolving document collections are fully reproducible even when document collections and thus term statistics change.
References in corpus (7)
- Simplified Data Wrangling with ir_datasets
- The Information Retrieval Experiment Platform
- Multi-level computational methods for interdisciplinary research in the HathiTrust Digital Library
- ir_metadata: An Extensible Metadata Schema for IR Experiments
- Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
- New model for datasets citation and extraction reproducibility in VAMDC
- CRUISE-Screening: Living Literature Reviews Toolbox