64 citations · 68 across the 3 of their papers we have counts for
5 papers
Non-autoregressive Model for Full-line Code Completion
Fang Liu, Zhiyi Fu, Ge Li +3
Code completion tools are frequently used by software developers to accelerate software development by suggesting the following code elements. Completing a sequence of code tokens…
Contextual Representation Learning beyond Masked Language Modeling
Zhiyi Fu, Wangchunshu Zhou, Jingjing Xu +2
How do masked language models (MLMs) such as BERT learn contextual representations? In this work, we analyze the learning dynamics of MLMs. We find that MLMs adopt sampled embeddin…
TUTA: Tree-based Transformers for Generally Structured Table Pre-training
Zhiruo Wang, Haoyu Dong, Ran Jia +4
Tables are widely used with various structures to organize and present data. Recent attempts on table understanding mainly focus on relational tables, yet overlook to other common…
Code Generation as a Dual Task of Code Summarization
Bolin Wei, Ge Li, Xin Xia +2
Code summarization (CS) and code generation (CG) are two crucial tasks in the field of automatic software development. Various neural network-based approaches are proposed to solve…
A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning
Fang Liu, Ge Li, Bolin Wei +3
Code completion, one of the most useful features in the Integrated Development Environments (IDEs), can accelerate software development by suggesting the libraries, APIs, and metho…