From Tokens to Concepts: Leveraging SAE for SPLADE

Yuxuan Zong, Mathias Vast, Basile Van Cooten +2

Learned Sparse IR models, such as SPLADE, offer an excellent efficiency-effectiveness tradeoff. However, they rely on the underlying backbone vocabulary, which might hinder perform…