Mechanistic Understanding of Language Models in Syntactic Code Completion

Samuel Miller, Daking Rai, Ziyu Yao

Recently, language models (LMs) have shown impressive proficiency in code generation tasks, especially when fine-tuned on code-specific datasets, commonly known as Code LMs. Howeve…