REZE: Representation Regularization for Domain-adaptive Text Embedding Pre-finetuning

Seungmin Lee, Jeonghwan Lee, Hyunkuk Lim +2

Recent text embedding models are often adapted to specialized domains via contrastive pre-finetuning (PFT) on a naive collection of scattered, heterogeneous tasks. However, this ap…