Probing Factual Knowledge Transfer with Training Data Interventions

Romina Oji, Marc Braun, Marcel Bollmann +2

Do multilingual language models transfer factual knowledge across languages during continued pretraining, or do they mostly recall facts learned directly from the target-language d…