Automatic Code Generation using Pre-Trained Language Models

Luis Perez, Lizi Ottens, Sudharshan Viswanathan

Recent advancements in natural language processing \cite{gpt2} \cite{BERT} have led to near-human performance in multiple natural language tasks. In this paper, we seek to understa…