Invariance and identifiability issues for word embeddings

Rachel Carrington, Karthik Bharath, Simon Preston

Word embeddings are commonly obtained as optimizers of a criterion function $f$ of a text corpus, but assessed on word-task performance using a different evaluation function $g$ of…