Improved Learned Sparse Retrieval with Corpus-Specific Vocabularies

Puxuan Yu, Antonio Mallia, Matthias Petri

We explore leveraging corpus-specific vocabularies that improve both efficiency and effectiveness of learned sparse retrieval systems. We find that pre-training the underlying BERT…