Whitening Sentence Representations for Better Semantics and Faster Retrieval

Jianlin Su, Jiarun Cao, Weijie Liu +1

Pre-training models such as BERT have achieved great success in many natural language processing tasks. However, how to obtain better sentence representation through these pre-trai…