Abstraction not Memory: BERT and the English Article System

Harish Tayyar Madabushi, Dagmar Divjak, Petar Milin

Article prediction is a task that has long defied accurate linguistic description. As such, this task is ideally suited to evaluate models on their ability to emulate native-speake…