2 citations · 2 across the 2 of their papers we have counts for
2 papers
stat.ML2022
AutoInit: Automatic Initialization via Jacobian Tuning
Tianyu He, Darshil Doshi, Andrey Gromov
Good initialization is essential for training Deep Neural Networks (DNNs). Oftentimes such initialization is found through a trial and error approach, which has to be applied anew…
cs.LG2021★ 2 cited
Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications
Darshil Doshi, Tianyu He, Andrey Gromov
Deep neural networks are notorious for defying theoretical treatment. However, when the number of parameters in each layer tends to infinity, the network function is a Gaussian pro…