Towards Understanding What Code Language Models Learned

Toufique Ahmed, Dian Yu, Chengxuan Huang +3

Pre-trained language models are effective in a variety of natural language tasks, but it has been argued their capabilities fall short of fully learning meaning or understanding la…