51 citations · 64 across the 9 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CL2022
Once is Enough: A Light-Weight Cross-Attention for Fast Sentence Pair Modeling
Yuanhang Yang, Shiyi Qi, Chuanyi Liu +3
Transformer-based models have achieved great success on sentence pair modeling tasks, such as answer selection and natural language inference (NLI). These models generally perform…
cs.SE2022★ 5 cited
A Closer Look into Transformer-Based Code Intelligence Through Code Transformation: Challenges and Opportunities
Yaoxian Li, Shiyi Qi, Cuiyun Gao +4
Transformer-based models have demonstrated state-of-the-art performance in many intelligent coding tasks such as code comment generation and code completion. Previous studies show…
cs.SE2022
Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit
Shiyi Qi, Yaoxian Li, Cuiyun Gao +4
Adapting Deep Learning (DL) techniques to automate non-trivial coding activities, such as code documentation and defect detection, has been intensively studied recently. Learning t…