On Compressing U-net Using Knowledge Distillation

Karttikeya Mangalam, Mathieu Salzamann

We study the use of knowledge distillation to compress the U-net architecture. We show that, while standard distillation is not sufficient to reliably train a compressed U-net, int…