Once a Tree, Always a Tree? Cross-lingual Transfer of Hierarchical Generalization in Language Models

Shin Yamaguchi, Masaya Taniguchi, Tatsuki Kuribayashi +2

Language models (LMs) often exhibit successful cross-lingual transfer through continued (pre)training, still their underlying process remains unclear. One possibility is that LMs c…