11 citations · 52 across the 9 of their papers we have counts for
11 papers · 1 filter
Beyond Mahalanobis-Based Scores for Textual OOD Detection
Pierre Colombo, Eduardo D. C. Gomes, Guillaume Staerman +2
Deep learning methods have boosted the adoption of NLP systems in real-life applications. However, they turn out to be vulnerable to distribution shifts over time which may cause s…
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation
Cyril Chhun, Pierre Colombo, Chloé Clavel +1
Research on Automatic Story Generation (ASG) relies heavily on human and automatic evaluation. However, there is no consensus on which human evaluation criteria to use, and no anal…
Beam Search with Bidirectional Strategies for Neural Response Generation
Pierre Colombo, Chouchang Yang, Giovanna Varni +1
Sequence-to-sequence neural networks have been widely used in language-based applications as they have flexible capabilities to learn various language models. However, when seeking…
Code-switched inspired losses for generic spoken dialog representations
Emile Chapuis, Pierre Colombo, Matthieu Labeau +1
Spoken dialog systems need to be able to handle both multiple languages and multilinguality inside a conversation (\textit{e.g} in case of code-switching). In this work, we introdu…
Automatic Text Evaluation through the Lens of Wasserstein Barycenters
Pierre Colombo, Guillaume Staerman, Chloe Clavel +1
A new metric \texttt{BaryScore} to evaluate text generation based on deep contextualized embeddings e.g., BERT, Roberta, ELMo) is introduced. This metric is motivated by a new fram…
The importance of fillers for text representations of speech transcripts
Tanvi Dinkar, Pierre Colombo, Matthieu Labeau +1
While being an essential component of spoken language, fillers (e.g."um" or "uh") often remain overlooked in Spoken Language Understanding (SLU) tasks. We explore the possibility o…