984 citations · 1.3k across the 27 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020★ 8 cited
Memformer: A Memory-Augmented Transformer for Sequence Modeling
Qingyang Wu, Zhenzhong Lan, Kun Qian +3
Transformers have reached remarkable success in sequence modeling. However, these models have efficiency issues as they need to store all the history token-level representations as…
cs.LG2020★ 1 cited
Attention that does not Explain Away
Nan Ding, Xinjie Fan, Zhenzhong Lan +2
Models based on the Transformer architecture have achieved better accuracy than the ones based on competing architectures for a large set of tasks. A unique feature of the Transfor…