Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis

Euna Jung, Jaeill Kim, Jungmin Ko +2

The latest advancements in unsupervised learning of sentence embeddings predominantly involve employing contrastive learning-based (CL-based) fine-tuning over pre-trained language…