Decipherment-Aware Multilingual Learning in Jointly Trained Language Models

Grandee Lee

The principle that governs unsupervised multilingual learning (UCL) in jointly trained language models (mBERT as a popular example) is still being debated. Many find it surprising…