10 citations · 21 across the 5 of their papers we have counts for
3 papers · 1 filter
Identifying Equivalent Training Dynamics
William T. Redman, Juan M. Bello-Rivas, Maria Fonoberova +3
Study of the nonlinear evolution deep neural network (DNN) parameters undergo during training has uncovered regimes of distinct dynamical behavior. While a detailed understanding o…
Predicting the Critical Number of Layers for Hierarchical Support Vector Regression
Ryan Mohr, Maria Fonoberova, Zlatko Drmač +2
Hierarchical support vector regression (HSVR) models a function from data as a linear combination of SVR models at a range of scales, starting at a coarse scale and moving to finer…
Applications of Koopman Mode Analysis to Neural Networks
Iva Manojlović, Maria Fonoberova, Ryan Mohr +4
We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optim…