Transfer of Structural Knowledge from Synthetic Languages

Mikhail Budnikov, Ivan Yamshchikov

This work explores transfer learning from several synthetic languages to English. We investigate the structure of the embeddings in the fine-tuned models, the information they cont…