On Using Distribution-Based Compositionality Assessment to Evaluate Compositional Generalisation in Machine Translation

Anssi Moisio, Mathias Creutz, Mikko Kurimo

Compositional generalisation (CG), in NLP and in machine learning more generally, has been assessed mostly using artificial datasets. It is important to develop benchmarks to asses…