An Ensemble Method for Producing Word Representations focusing on the Greek Language
arXiv:1912.04965
Abstract
In this paper we present a new ensemble method, Continuous Bag-of-Skip-grams (CBOS), that produces high-quality word representations putting emphasis on the modern Greek language. The CBOS method combines the pioneering approaches for learning word representations: Continuous Bag-of-Words (CBOW) and Continuous Skip-gram. These methods are compared through intrinsic and extrinsic evaluation tasks on three different sources of data: the English Wikipedia corpus, the modern Greek Wikipedia corpus, and the modern Greek Web Content corpus. By comparing these methods across different tasks and datasets, it is evident that the CBOS method achieves state-of-the-art performance.
References in corpus (7)
- Efficient Estimation of Word Representations in Vector Space
- Distributed Representations of Words and Phrases and their Compositionality
- Evaluating Word Embedding Models: Methods and Experimental Results
- GREEK-BERT: The Greeks visiting Sesame Street
- How to evaluate word embeddings? On importance of data efficiency and simple supervised tasks
- Word Embeddings from Large-Scale Greek Web Content
- Evaluation of Greek Word Embeddings