Posing Fair Generalization Tasks for Natural Language Inference

Atticus Geiger, Ignacio Cases, Lauri Karttunen +1

Deep learning models for semantics are generally evaluated using naturalistic corpora. Adversarial methods, in which models are evaluated on new examples with known semantic proper…