activity
20182024
most citedDynamic Self-Attention : Computing Attention over Words Dynamically for Sentence Embedding

40 citations · 41 across the 6 of their papers we have counts for

collaborators
Showing 2022Show all

1 paper · 1 filter

cs.CL2022

Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking

Mingyu Lee, Jun-Hyung Park, Junho Kim +2

Masked language modeling (MLM) has been widely used for pre-training effective bidirectional representations, but incurs substantial training costs. In this paper, we propose a nov…