Quantization Enables Private Dense Retrieval against Malicious Service Providers

Louis Tremblay Thibault, Sofiane Azogagh, Marc-Olivier Killijian +1

Dense retrieval, the key component of Retrieval Augmented Generation (RAG), retrieves the most relevant documents by comparing dense vector representations of queries and passages…