36 citations · 90 across the 10 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020
Extracurricular Learning: Knowledge Transfer Beyond Empirical Distribution
Hadi Pouransari, Mojan Javaheripi, Vinay Sharma +1
Knowledge distillation has been used to transfer knowledge learned by a sophisticated model (teacher) to a simpler model (student). This technique is widely used to compress model…
cs.LG2020
Least squares binary quantization of neural networks
Hadi Pouransari, Zhucheng Tu, Oncel Tuzel
Quantizing weights and activations of deep neural networks results in significant improvement in inference efficiency at the cost of lower accuracy. A source of the accuracy gap be…