661 citations · 1.6k across the 26 of their papers we have counts for
5 papers · 2 filters
Neural Predictor for Neural Architecture Search
Wei Wen, Hanxiao Liu, Hai Li +3
Neural Architecture Search methods are effective but often use complex algorithms to come up with the best architecture. We propose an approach with three basic steps that is conce…
DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures
Huanrui Yang, Wei Wen, Hai Li
In seeking for sparse and efficient neural network models, many previous works investigated on enforcing L1 or L0 regularizers to encourage weight sparsity during training. The L0…
Joint Regularization on Activations and Weights for Efficient Neural Network Pruning
Qing Yang, Wei Wen, Zuoguan Wang +1
With the rapid scaling up of deep neural networks (DNNs), extensive research studies on network model compression such as weight pruning have been performed for improving deploymen…
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks
Wei Wen, Feng Yan, Yiran Chen +1
Depth is a key component of Deep Neural Networks (DNNs), however, designing depth is heuristic and requires many human efforts. We propose AutoGrow to automate depth discovery in D…
PruneTrain: Fast Neural Network Training by Dynamic Sparse Model Reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh +3
State-of-the-art convolutional neural networks (CNNs) used in vision applications have large models with numerous weights. Training these models is very compute- and memory-resourc…