Forgetting Exceptions is Harmful in Language Learning

Walter Daelemans, Antal van den Bosch, Jakub Zavrel

We show that in language learning, contrary to received wisdom, keeping exceptional training instances in memory can be beneficial for generalization accuracy. We investigate this…