Distilling Word Embeddings: An Encoding Approach

Lili Mou, Ran Jia, Yan Xu +3

Distilling knowledge from a well-trained cumbersome network to a small one has recently become a new research topic, as lightweight neural networks with high performance are partic…