We Need to Talk About Random Splits

Anders Søgaard, Sebastian Ebert, Jasmijn Bastings +1

Gorman and Bedrick (2019) argued for using random splits rather than standard splits in NLP experiments. We argue that random splits, like standard splits, lead to overly optimisti…