CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing

Ahmed Elnaggar, Wei Ding, Llion Jones +6

Currently, a growing number of mature natural language processing applications make people's life more convenient. Such applications are built by source code - the language in soft…