On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules

Divyam Goel, Ramansh Grover, Fatemeh H. Fard

Pre-trained neural Language Models (PTLM), such as CodeBERT, are recently used in software engineering as models pre-trained on large source code corpora. Their knowledge is transf…