LEA: Improving Sentence Similarity Robustness to Typos Using Lexical Attention Bias

Mario Almagro, Emilio Almazán, Diego Ortego +1

Textual noise, such as typos or abbreviations, is a well-known issue that penalizes vanilla Transformers for most downstream tasks. We show that this is also the case for sentence…