most citedMRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning

45 citations · 45 across the 1 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2020

The Depth-to-Width Interplay in Self-Attention

Yoav Levine, Noam Wies, Or Sharir +2

Self-attention architectures, which are rapidly pushing the frontier in natural language processing, demonstrate a surprising depth-inefficient behavior: previous works indicate th…