Is Dimensionality a Barrier for Retrieval Models?

Kiril Bangachev, Guy Bresler, Jonathan Kogan +1

Why does the low dimensionality of representations, typically $d\approx 1000$, not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of d…