Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability

Ryokan Ri, Shun Kiyono, Sho Takase

Zero-shot cross-lingual transfer by fine-tuning multilingual pretrained models shows promise for low-resource languages, but often suffers from misalignment of internal representat…