On the Downstream Performance of Compressed Word Embeddings

Avner May, Jian Zhang, Tri Dao +1

Compressing word embeddings is important for deploying NLP models in memory-constrained settings. However, understanding what makes compressed embeddings perform well on downstream…