Publications (4)
Correlations between Word Vector Sets
Vitalii Zhelezniak, April Shen, Daniel Busbridge +2
Similarity measures based purely on word embeddings are comfortably competing with much more sophisticated deep learning and expert-engineered systems on unsupervised semantic text…
Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors
Vitalii Zhelezniak, Aleksandar Savkov, April Shen +3
Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks. Furthermore, wh…
Correlation Coefficients and Semantic Textual Similarity
Vitalii Zhelezniak, Aleksandar Savkov, April Shen +1
A large body of research into semantic textual similarity has focused on constructing state-of-the-art embeddings using sophisticated modelling, careful choice of learning signals…
Decoding Decoders: Finding Optimal Representation Spaces for Unsupervised Similarity Tasks
Vitalii Zhelezniak, Dan Busbridge, April Shen +2
Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this beh…