Evaluation of Sentence Representations in Polish
arXiv:1910.11834
Abstract
Methods for learning sentence representations have been actively developed in recent years. However, the lack of pre-trained models and datasets annotated at the sentence level has been a problem for low-resource languages such as Polish which led to less interest in applying these methods to language-specific tasks. In this study, we introduce two new Polish datasets for evaluating sentence embeddings and provide a comprehensive evaluation of eight sentence representation methods including Polish and multilingual models. We consider classic word embedding models, recently developed contextual embeddings and multilingual sentence encoders, showing strengths and weaknesses of specific approaches. We also examine different methods of aggregating word vectors into a single sentence vector.
References in corpus (9)
- Efficient Estimation of Word Representations in Vector Space
- Distributed Representations of Words and Phrases and their Compositionality
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- Universal Sentence Encoder
- XNLI: Evaluating Cross-lingual Sentence Representations
- ERNIE: Enhanced Language Representation with Informative Entities
- Evaluation of sentence embeddings in downstream and linguistic probing tasks
- Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
- Multilingual Universal Sentence Encoder for Semantic Retrieval