7 citations · 14 across the 7 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CV2021★ 2 cited
Information Theoretic Representation Distillation
Roy Miles, Adrian Lopez Rodriguez, Krystian Mikolajczyk
Despite the empirical success of knowledge distillation, current state-of-the-art methods are computationally expensive to train, which makes them difficult to adopt in practice. T…
cs.CV2021
Reconstructing Pruned Filters using Cheap Spatial Transformations
Roy Miles, Krystian Mikolajczyk
We present an efficient alternative to the convolutional layer using cheap spatial transformations. This construction exploits an inherent spatial redundancy of the learned convolu…