5 papers
Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test
Philippe Laban, Luke Dai, Lucas Bandarkar +1
The Shuffle Test is the most common task to evaluate whether NLP models can measure coherence in text. Most recent work uses direct supervision on the task; we show that by simply…
Keep it Simple: Unsupervised Simplification of Multi-Paragraph Text
Philippe Laban, Tobias Schnabel, Paul Bennett +1
This work presents Keep it Simple (KiS), a new approach to unsupervised text simplification which learns to balance a reward across three properties: fluency, salience and simplici…
What's The Latest? A Question-driven News Chatbot
Philippe Laban, John Canny, Marti A. Hearst
This work describes an automatic news chatbot that draws content from a diverse set of news articles and creates conversations with a user about the news. Key components of the sys…
News Headline Grouping as a Challenging NLU Task
Philippe Laban, Lucas Bandarkar, Marti A. Hearst
Recent progress in Natural Language Understanding (NLU) has seen the latest models outperform human performance on many standard tasks. These impressive results have led the commun…
The Summary Loop: Learning to Write Abstractive Summaries Without Examples
Philippe Laban, Andrew Hsi, John Canny +1
This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a…