526 citations · 1.1k across the 32 of their papers we have counts for
4 papers · 1 filter
A Bag of Tricks for Dialogue Summarization
Muhammad Khalifa, Miguel Ballesteros, Kathleen McKeown
Dialogue summarization comes with its own peculiar challenges as opposed to news or scientific articles summarization. In this work, we explore four different challenges of the tas…
How much pretraining data do language models need to learn syntax?
Laura Pérez-Mayos, Miguel Ballesteros, Leo Wanner
Transformers-based pretrained language models achieve outstanding results in many well-known NLU benchmarks. However, while pretraining methods are very convenient, they are expens…
On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations
Laura Pérez-Mayos, Roberto Carlini, Miguel Ballesteros +1
The adaptation of pretrained language models to solve supervised tasks has become a baseline in NLP, and many recent works have focused on studying how linguistic information is en…
Event-Driven News Stream Clustering using Entity-Aware Contextual Embeddings
Kailash Karthik Saravanakumar, Miguel Ballesteros, Muthu Kumar Chandrasekaran +1
We propose a method for online news stream clustering that is a variant of the non-parametric streaming K-means algorithm. Our model uses a combination of sparse and dense document…