14 citations · 18 across the 7 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
Atsuki Yamaguchi, George Chrysostomou, Katerina Margatina +1
Masked language modeling (MLM), a self-supervised pretraining objective, is widely used in natural language processing for learning text representations. MLM trains a model to pred…
cs.CL2021★ 1 cited
Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification
George Chrysostomou, Nikolaos Aletras
Neural network architectures in natural language processing often use attention mechanisms to produce probability distributions over input token representations. Attention has empi…