Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Representation Alignment Rests on Linear Structure
Kiril Bangachev, Guy Bresler, Yury Polyanskiy
We investigate the Platonic Representation Hypothesis (PRH) through a tripartite statistical framework of representations: signal, bias, and noise. {1) Signal:} We propose that Pla…
cs.LG2026
Is Dimensionality a Barrier for Retrieval Models?
Kiril Bangachev, Guy Bresler, Jonathan Kogan +1
Why does the low dimensionality of representations, typically , not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of d…
cs.LG2026
Global Minimizers of Sigmoid Contrastive Loss
Kiril Bangachev, Guy Bresler, Iliyas Noman +1
The meta-task of obtaining and aligning representations through contrastive pretraining is steadily gaining importance since its introduction in CLIP and ALIGN. In this paper we th…