Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT

Beiduo Chen, Wu Guo, Quan Liu +1

Multilingual BERT (mBERT), a language model pre-trained on large multilingual corpora, has impressive zero-shot cross-lingual transfer capabilities and performs surprisingly well o…