Improving Contrastive Learning of Sentence Embeddings with Focal-InfoNCE

Pengyue Hou, Xingyu Li

The recent success of SimCSE has greatly advanced state-of-the-art sentence representations. However, the original formulation of SimCSE does not fully exploit the potential of har…