103 citations · 311 across the 16 of their papers we have counts for
4 papers · 1 filter
Neural tangent kernels, transportation mappings, and universal approximation
Ziwei Ji, Matus Telgarsky, Ruicheng Xian
This paper establishes rates of universal approximation for the shallow neural tangent kernel (NTK): network weights are only allowed microscopic changes from random initialization…
Polylogarithmic width suffices for gradient descent to achieve arbitrarily small test error with shallow ReLU networks
Ziwei Ji, Matus Telgarsky
Recent theoretical work has guaranteed that overparameterized networks trained by gradient descent achieve arbitrarily low training error, and sometimes even low test error. The re…
Approximation power of random neural networks
Bolton Bailey, Ziwei Ji, Matus Telgarsky +1
This paper investigates the approximation power of three types of random neural networks: (a) infinite width networks, with weights following an arbitrary distribution; (b) finite…
Characterizing the implicit bias via a primal-dual analysis
Ziwei Ji, Matus Telgarsky
This paper shows that the implicit bias of gradient descent on linearly separable data is exactly characterized by the optimal solution of a dual optimization problem given by a sm…