72 citations · 542 across the 65 of their papers we have counts for
5 papers · 2 filters
i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R. Wolfe, Anastasios Kyrillidis
We propose a novel, structured pruning algorithm for neural networks -- the iterative, Sparse Structured Pruning algorithm, dubbed as i-SpaSP. Inspired by ideas from sparse signal…
REX: Revisiting Budgeted Training with an Improved Schedule
John Chen, Cameron Wolfe, Anastasios Kyrillidis
Deep learning practitioners often operate on a computational and monetary budget. Thus, it is critical to design optimization algorithms that perform well under any budget. The lin…
Mitigating deep double descent by concatenating inputs
John Chen, Qihan Wang, Anastasios Kyrillidis
The double descent curve is one of the most intriguing properties of deep neural networks. It contrasts the classical bias-variance curve with the behavior of modern neural network…
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
Chen Dun, Cameron R. Wolfe, Christopher M. Jermaine +1
We propose ResIST, a novel distributed training protocol for Residual Networks (ResNets). ResIST randomly decomposes a global ResNet into several shallow sub-ResNets that are train…
GIST: Distributed Training for Large-Scale Graph Convolutional Networks
Cameron R. Wolfe, Jingkang Yang, Arindam Chowdhury +4
The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the num…