Training with Ciphers to Enhance In-Context Terminology Learning For Translation from Rare Languages

Deevyanshu Malu, Deeptanshu Malu, Sunita Sarawagi

Fine-tuning LLMs with in-context examples (IC-Train) lets translation models adapt to new parallel data at deployment, but it is unclear whether they actually learn the translation…