A Systematic Evaluation of Large Language Models of Code

Frank F. Xu, Uri Alon, Graham Neubig +1

Large language models (LMs) of code have recently shown tremendous promise in completing code and synthesizing code from natural language descriptions. However, the current state-o…