Query-Aware Token Budgeting for Efficient Late-Interaction Visual Document Retrieval

PS Rishi, Rajeev Ranjan Dwivedi, Vinod K Kurmi

Late-interaction visual document retrievers preserve fine-grained page evidence by storing many token embeddings per page, but the resulting storage and query-time interaction cost…