Disentangling Paradigm, Identifier, and Decoding in Generative Retrieval

Hicham Randrianarivo, Logan Renaud, Alexia Allal

Generative retrieval trains a language model to generate the identifier of a relevant document. Recent work replaces the autoregressive decoder with diffusion, but changes identifi…