Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Is Dimensionality a Barrier for Retrieval Models?
Kiril Bangachev, Guy Bresler, Jonathan Kogan +1
Why does the low dimensionality of representations, typically , not prevent modern embedding-based retrieval models from scaling to billions, or even trillions, of d…
cs.LG2025
Complexity of One-Dimensional ReLU DNNs
Jonathan Kogan, Hayden Jananthan, Jeremy Kepner
We study the expressivity of one-dimensional (1D) ReLU deep neural networks through the lens of their linear regions. For randomly initialized, fully connected 1D ReLU networks (He…