General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference

Jingfei Du, Myle Ott, Haoran Li +2

The state of the art on many NLP tasks is currently achieved by large pre-trained language models, which require a considerable amount of computation. We explore a setting where ma…