7 citations · 8 across the 2 of their papers we have counts for
2 papers
cs.LG2021★ 7 cited
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding
Shengjie Luo, Shanda Li, Tianle Cai +6
The attention module, which is a crucial component in Transformer, cannot scale efficiently to long sequences due to its quadratic complexity. Many works focus on approximating the…
cs.PL2021★ 1 cited
How could Neural Networks understand Programs?
Dinglan Peng, Shuxin Zheng, Yatao Li +3
Semantic understanding of programs is a fundamental problem for programming language processing (PLP). Recent works that learn representations of code based on pre-training techniq…