Contextualized Code Pretraining for Code Generation

Chen Liu, Qingyuan Liang, Hanwen Zhang +3

As code generation becomes increasingly central to improving software development efficiency, modern code models are largely trained and evaluated on code with natural-language des…