Can Generative Retrievers Learn Semantic IDs Without Forgetting How to Speak?

Junchen Fu, Kleomenis Katevas, Vandana Rajan +2

Generative retrieval (GR) enables end-to-end retrieval by generating document semantic identifiers (SIDs). However, retrieval-only fine-tuning can over-specialize pretrained langua…