Beyond the Geometric Curse: High-Dimensional N-Gram Hashing for Dense Retrieval

Sangeet Sharma

Why do even the most powerful 7B-parameter embedding models struggle with simple retrieval tasks that the decades old BM25 handles with ease? Recent theory suggests that this happe…