Frequency-aware Dimension Selection for Static Word Embedding by Mixed Product Distance

Lingfeng Shen, Haiyun Jiang, Lemao Liu +1

Static word embedding is still useful, particularly for context-unavailable tasks, because in the case of no context available, pre-trained language models often perform worse than…