3 papers
cs.CL2020
Model Selection for Cross-Lingual Transfer
Yang Chen, Alan Ritter
Transformers that are pre-trained on multilingual corpora, such as, mBERT and XLM-RoBERTa, have achieved impressive cross-lingual transfer capabilities. In the zero-shot transfer s…
cs.CL2020
An Empirical Study of Pre-trained Transformers for Arabic Information Extraction
Wuwei Lan, Yang Chen, Wei Xu +1
Multilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable the effective cross-lingual zero-shot…
cs.CL2019
EntEval: A Holistic Evaluation Benchmark for Entity Representations
Mingda Chen, Zewei Chu, Yang Chen +2
Rich entity representations are useful for a wide class of problems involving entities. Despite their importance, there is no standardized benchmark that evaluates the overall qual…