54k citations · 60.1k across the 24 of their papers we have counts for
Showing 2015 · cs.LGShow all
2 papers · 2 filters
cs.LG2015★ 156 cited
Net2Net: Accelerating Learning via Knowledge Transfer
Tianqi Chen, Ian Goodfellow, Jonathon Shlens
We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly…
cs.LG2015★ 2.3k cited
Empirical Evaluation of Rectified Activations in Convolutional Network
Bing Xu, Naiyan Wang, Tianqi Chen +1
In this paper we investigate the performance of different types of rectified activation functions in convolutional neural network: standard rectified linear unit (ReLU), leaky rect…