The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer

Pavel Efimov, Leonid Boytsov, Elena Arslanova +1

Large multilingual language models such as mBERT or XLM-R enable zero-shot cross-lingual transfer in various IR and NLP tasks. Cao et al. (2020) proposed a data- and compute-effici…