An Exploration of Word Embedding Initialization in Deep-Learning Tasks

Tom Kocmi, Ondřej Bojar

Word embeddings are the interface between the world of discrete units of text processing and the continuous, differentiable world of neural networks. In this work, we examine vario…