71 citations · 92 across the 2 of their papers we have counts for
2 papers
cs.SE2021★ 21 cited
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing
Ahmed Elnaggar, Wei Ding, Llion Jones +6
Currently, a growing number of mature natural language processing applications make people's life more convenient. Such applications are built by source code - the language in soft…
cs.LG2020★ 71 cited
ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing
Ahmed Elnaggar, Michael Heinzinger, Christian Dallago +9
Computational biology and bioinformatics provide vast data gold-mines from protein sequences, ideal for Language Models taken from NLP. These LMs reach for new prediction frontiers…