4 citations · 10 across the 14 of their papers we have counts for
4 papers · 1 filter
A Predictive Factor Analysis of Social Biases and Task-Performance in Pretrained Masked Language Models
Yi Zhou, Jose Camacho-Collados, Danushka Bollegala
Various types of social biases have been reported with pretrained Masked Language Models (MLMs) in prior work. However, multiple underlying factors are associated with an MLM such…
Can Word Sense Distribution Detect Semantic Changes of Words?
Xiaohang Tang, Yi Zhou, Taichi Aida +2
Semantic Change Detection (SCD) of words is an important task for various NLP applications that must make time-sensitive predictions. Some words are used over time in novel ways to…
Together We Make Sense -- Learning Meta-Sense Embeddings from Pretrained Static Sense Embeddings
Haochen Luo, Yi Zhou, Danushka Bollegala
Sense embedding learning methods learn multiple vectors for a given ambiguous word, corresponding to its different word senses. For this purpose, different methods have been propos…
Solving Cosine Similarity Underestimation between High Frequency Words by L2 Norm Discounting
Saeth Wannasuphoprasit, Yi Zhou, Danushka Bollegala
Cosine similarity between two words, computed using their contextualised token embeddings obtained from masked language models (MLMs) such as BERT has shown to underestimate the ac…