Triplet Loss for Knowledge Distillation

Hideki Oki, Motoshi Abe, Junichi Miyao +1

In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes la…