Non-distributional Word Vector Representations
arXiv:1506.05230
Abstract
Data-driven representation learning for words is a technique of central importance in NLP. While indisputably useful as a source of features in downstream tasks, such vectors tend to consist of uninterpretable components whose relationship to the categories of traditional lexical semantic theories is tenuous at best. We present a method for constructing interpretable word vectors from hand-crafted linguistic resources like WordNet, FrameNet etc. These vectors are binary (i.e, contain only 0 and 1) and are 99.9% sparse. We analyze their performance on state-of-the-art evaluation methods for distributional models of word vectors and find they are competitive to standard distributional approaches.
Proceedings of ACL 2015
References in corpus (2)
Cited by in corpus (5)
- Charagram: Embedding Words and Sentences via Character n-grams
- How to evaluate word embeddings? On importance of data efficiency and simple supervised tasks
- Semantic Specialisation of Distributional Word Vector Spaces using Monolingual and Cross-Lingual Constraints
- Calculating Semantic Similarity between Academic Articles using Topic Event and Ontology
- Evaluation method of word embedding by roots and affixes