20 citations · 52 across the 13 of their papers we have counts for
4 papers · 1 filter
Identifying Equivalent Training Dynamics
William T. Redman, Juan M. Bello-Rivas, Maria Fonoberova +3
Study of the nonlinear evolution deep neural network (DNN) parameters undergo during training has uncovered regimes of distinct dynamical behavior. While a detailed understanding o…
An Operator Theoretic View on Pruning Deep Neural Networks
William T. Redman, Maria Fonoberova, Ryan Mohr +2
The discovery of sparse subnetworks that are able to perform as well as full models has found broad applied and theoretical interest. While many pruning methods have been developed…
Predicting the Critical Number of Layers for Hierarchical Support Vector Regression
Ryan Mohr, Maria Fonoberova, Zlatko Drmač +2
Hierarchical support vector regression (HSVR) models a function from data as a linear combination of SVR models at a range of scales, starting at a coarse scale and moving to finer…
Applications of Koopman Mode Analysis to Neural Networks
Iva Manojlović, Maria Fonoberova, Ryan Mohr +4
We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optim…