787 citations · 1k across the 7 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2021★ 2 cited
Fast Extraction of Word Embedding from Q-contexts
Junsheng Kong, Weizhao Li, Zeyi Liu +5
The notion of word embedding plays a fundamental role in natural language processing (NLP). However, pre-training word embedding for very large-scale vocabulary is computationally…
cs.CL2019
Blockwise Self-Attention for Long Document Understanding
Jiezhong Qiu, Hao Ma, Omer Levy +3
We present BlockBERT, a lightweight and efficient BERT model for better modeling long-distance dependencies. Our model extends BERT by introducing sparse block structures into the…