124 citations · 218 across the 20 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 2 cited
Global Convergence of SGD On Two Layer Neural Nets
Pulkit Gopalani, Anirbit Mukherjee
In this note, we consider appropriately regularized empirical risk of depth nets with any number of gates and show bounds on how the empirical loss evolves for SGD ite…
cs.LG2022
Towards Size-Independent Generalization Bounds for Deep Operator Nets
Pulkit Gopalani, Sayar Karmakar, Dibyakanti Kumar +1
In recent times machine learning methods have made significant advances in becoming a useful tool for analyzing physical systems. A particularly active area in this theme has been…
cs.LG2022
An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate
Sayar Karmakar, Anirbit Mukherjee
A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution…