2 papers
cs.CL2021
Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test
Philippe Laban, Luke Dai, Lucas Bandarkar +1
The Shuffle Test is the most common task to evaluate whether NLP models can measure coherence in text. Most recent work uses direct supervision on the task; we show that by simply…
cs.CL2021
News Headline Grouping as a Challenging NLU Task
Philippe Laban, Lucas Bandarkar, Marti A. Hearst
Recent progress in Natural Language Understanding (NLU) has seen the latest models outperform human performance on many standard tasks. These impressive results have led the commun…