Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding

Oren Barkan, Noam Razin, Itzik Malkiel +3

Recent state-of-the-art natural language understanding models, such as BERT and XLNet, score a pair of sentences (A and B) using multiple cross-attention operations - a process in…