Cross-Attention Calibrated Deduplication for Retrieval-Augmented Generation System

Phuong Le Huy, Nam H. Nguyen, Quan V. Dang

Common chunking strategies in Retrieval-Augmented Generation (RAG) systems often create redundant chunks. These redundant chunks make the vector database bigger and slow down retri…