Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis

Sinchana Ramakanth Bhat, Max Rudat, Jannis Spiekermann +1

Chunking is a crucial preprocessing step in retrieval-augmented generation (RAG) systems, significantly impacting retrieval effectiveness across diverse datasets. In this study, we…