14 citations · 32 across the 9 of their papers we have counts for
3 papers · 1 filter
A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck
James Henderson, Fabio Fehr
We propose a VAE for Transformers by developing a variational information bottleneck regulariser for Transformer embeddings. We formalise the embedding space of Transformer encoder…
Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers
Luis Espinosa-Anke, Alexander Shvets, Alireza Mohammadshahi +2
Recognizing and categorizing lexical collocations in context is useful for language learning, dictionary compilation and downstream NLP. However, it is a challenging task due to th…
What Do Compressed Multilingual Machine Translation Models Forget?
Alireza Mohammadshahi, Vassilina Nikoulina, Alexandre Berard +3
Recently, very large pre-trained models achieve state-of-the-art results in various natural language processing (NLP) tasks, but their size makes it more challenging to apply them…