Cluster Validation Indices as Self-Supervised Objectives for Text Representation Learning

Kishor Kumar Bhaumik, Nicolas Roque dos Santos, Neil Shah +2

Self-supervised fine-tuning refines the embedding space of a pretrained language encoder without labels. However, the commonly used approaches are computationally expensive. Specif…