An Empirical Study of Uniform-Architecture Knowledge Distillation in Document Ranking

Xubo Qin, Xiyuan Liu, Xiongfeng Zheng +2

Although BERT-based ranking models have been commonly used in commercial search engines, they are usually time-consuming for online ranking tasks. Knowledge distillation, which aim…