Spatial Matryoshka Training for Multi-Granularity Visual Document Retrieval

Trishan Singha Roy, Arkadeep Acharya, Vishwajeet Kumar +2

Multi-modal late-interaction retrievers achieve strong retrieval on visually rich documents by representing each page as per patch embeddings and matching at the token level. Howev…