Beyond Fine-tuning: Few-Sample Sentence Embedding Transfer

Siddhant Garg, Rohit Kumar Sharma, Yingyu Liang

Fine-tuning (FT) pre-trained sentence embedding models on small datasets has been shown to have limitations. In this paper we show that concatenating the embeddings from the pre-tr…