most citedYou Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling

3 citations · 3 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2021★ 3 cited

You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling

Zhanpeng Zeng, Yunyang Xiong, Sathya N. Ravi +3

Transformer-based models are widely used in natural language processing (NLP). Central to the transformer model is the self-attention mechanism, which captures the interactions of…