Contextualization with SPLADE for High Recall Retrieval
arXiv:2405.03972 · doi:10.1145/3626772.3657919
Abstract
High Recall Retrieval (HRR), such as eDiscovery and medical systematic review, is a search problem that optimizes the cost of retrieving most relevant documents in a given collection. Iterative approaches, such as iterative relevance feedback and uncertainty sampling, are shown to be effective under various operational scenarios. Despite neural models demonstrating success in other text-related tasks, linear models such as logistic regression, in general, are still more effective and efficient in HRR since the model is trained and retrieves documents from the same fixed collection. In this work, we leverage SPLADE, an efficient retrieval model that transforms documents into contextualized sparse vectors, for HRR. Our approach combines the best of both worlds, leveraging both the contextualization from pretrained language models and the efficiency of linear models. It reduces 10% and 18% of the review cost in two HRR evaluation collections under a one-phase review workflow with a target recall of 80%. The experiment is implemented with TARexp and is available at https://github.com/eugene-yang/LSR-for-TAR.
5 pages, 1 figure, accepted at SIGIR 2024 as short paper
References in corpus (6)
- Expansion via Prediction of Importance with Contextualization
- Heuristic Stopping Rules For Technology-Assisted Review
- On Minimizing Cost in Legal Document Review Workflows
- Certifying One-Phase Technology-Assisted Reviews
- Stopping Methods for Technology Assisted Reviews based on Point Processes
- TARexp: A Python Framework for Technology-Assisted Review Experiments