4 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.LG2020★ 4 cited
Language Modelling for Source Code with Transformer-XL
Thomas Dowdell, Hongyu Zhang
It has been found that software, like natural language texts, exhibits "naturalness", which can be captured by statistical language models. In recent years, neural language models…
cs.LG2019★ 3 cited
Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention
Thomas Dowdell, Hongyu Zhang
The key to a Transformer model is the self-attention mechanism, which allows the model to analyze an entire sequence in a computationally efficient manner. Recent work has suggeste…