6 citations · 14 across the 20 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
How to Dissect a Muppet: The Structure of Transformer Embedding Spaces
Timothee Mickus, Denis Paperno, Mathieu Constant
Pretrained embeddings based on the Transformer architecture have taken the NLP community by storm. We show that they can mathematically be reframed as a sum of vector factors and s…
cs.CL2022★ 2 cited
Semeval-2022 Task 1: CODWOE -- Comparing Dictionaries and Word Embeddings
Timothee Mickus, Kees van Deemter, Mathieu Constant +1
Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computation…