81 citations · 173 across the 19 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.CV2019★ 35 cited
Variational Information Distillation for Knowledge Transfer
Sungsoo Ahn, Shell Xu Hu, Andreas Damianou +2
Transferring knowledge from a teacher neural network pretrained on the same or a similar task to a student neural network can significantly improve the performance of the student n…
cs.LG2019★ 2 cited
Exploring Weight Symmetry in Deep Neural Networks
Xu Shell Hu, Sergey Zagoruyko, Nikos Komodakis
We propose to impose symmetry in neural network parameters to improve parameter usage and make use of dedicated convolution and matrix multiplication routines. Due to significant r…