Training convolutional neural networks with cheap convolutions and online distillation

Jiao Xie, Shaohui Lin, Yichen Zhang +1

The large memory and computation consumption in convolutional neural networks (CNNs) has been one of the main barriers for deploying them on resource-limited systems. To this end,…