106 citations · 317 across the 65 of their papers we have counts for
5 papers · 1 filter
Neural Networks as Kernel Learners: The Silent Alignment Effect
Alexander Atanasov, Blake Bordelon, Cengiz Pehlevan
Neural networks in the lazy training regime converge to kernel machines. Can neural networks in the rich feature learning regime learn a kernel machine with a data-dependent kernel…
Depth induces scale-averaging in overparameterized linear Bayesian neural networks
Jacob A. Zavatone-Veth, Cengiz Pehlevan
Inference in deep Bayesian neural networks is only fully understood in the infinite-width limit, where the posterior flexibility afforded by increased depth washes out and the post…
Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?
Matthew Farrell, Blake Bordelon, Shubhendu Trivedi +1
Equivariance has emerged as a desirable property of representations of objects subject to identity-preserving transformations that constitute a group, such as translations and rota…
Learning Curves for SGD on Structured Features
Blake Bordelon, Cengiz Pehlevan
The generalization performance of a machine learning algorithm such as a neural network depends in a non-trivial way on the structure of the data distribution. To analyze the influ…
Out-of-Distribution Generalization in Kernel Regression
Abdulkadir Canatar, Blake Bordelon, Cengiz Pehlevan
In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and wheth…