Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Search

Yiming Qiu, Chenyu Zhao, Han Zhang +7

BERT-style models pre-trained on the general corpus (e.g., Wikipedia) and fine-tuned on specific task corpus, have recently emerged as breakthrough techniques in many NLP tasks: qu…