832 citations · 1.3k across the 79 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
On the Local Complexity of Linear Regions in Deep ReLU Networks
Niket Patel, Guido Montufar
We define the local complexity of a neural network with continuous piecewise linear activations as a measure of the density of linear regions over an input data distribution. We sh…
stat.ML2024
Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension
Kedar Karhadkar, Michael Murray, Guido Montúfar
Bounds on the smallest eigenvalue of the neural tangent kernel (NTK) are a key ingredient in the analysis of neural network optimization and memorization. However, existing results…
math.OC2024★ 2 cited
Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients
Johannes Müller, Semih Çaycı, Guido Montúfar
Kakade's natural policy gradient method has been studied extensively in recent years, showing linear convergence with and without regularization. We study another natural gradient…