287 citations · 943 across the 16 of their papers we have counts for
20 papers
The Next Decade of Telecommunications Artificial Intelligence
Ye Ouyang, Lilei Wang, Aidong Yang +5
It has been an exciting journey since the mobile communications and artificial intelligence were conceived 37 years and 64 years ago. While both fields evolved independently and pr…
Is Transfer Learning Necessary for Protein Landscape Prediction?
Amir Shanehsazzadeh, David Belanger, David Dohan
Recently, there has been great interest in learning how to best represent proteins, specifically with fixed-length embeddings. Deep learning has become a popular tool for protein r…
Fixed-Length Protein Embeddings using Contextual Lenses
Amir Shanehsazzadeh, David Belanger, David Dohan
The Basic Local Alignment Search Tool (BLAST) is currently the most popular method for searching databases of biological sequences. BLAST compares sequences via similarity defined…
Rethinking Attention with Performers
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan +10
We introduce Performers, Transformer architectures which can estimate regular (softmax) full-rank-attention Transformers with provable accuracy, but using only linear (as opposed t…
Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan +8
Transformer models have achieved state-of-the-art results across a diverse range of domains. However, concern over the cost of training the attention mechanism to learn complex dep…
Boundless: Generative Adversarial Networks for Image Extension
Piotr Teterwak, Aaron Sarna, Dilip Krishnan +4
Image extension models have broad applications in image editing, computational photography and computer graphics. While image inpainting has been extensively studied in the literat…