39 citations · 48 across the 6 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2024
Deep Neural Network Initialization with Sparsity Inducing Activations
Ilan Price, Nicholas Daultry Ball, Samuel C. H. Lam +2
Inducing and leveraging sparse activations during training and inference is a promising avenue for improving the computational efficiency of deep networks, which is increasingly im…
cs.LG2022★ 1 cited
Improved Projection Learning for Lower Dimensional Feature Maps
Ilan Price, Jared Tanner
The requirement to repeatedly move large feature maps off- and on-chip during inference with convolutional neural networks (CNNs) imposes high costs in terms of both energy and tim…
cs.LG2021
Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset
Ilan Price, Jared Tanner
That neural networks may be pruned to high sparsities and retain high accuracy is well established. Recent research efforts focus on pruning immediately after initialization so as…