11 citations · 27 across the 18 of their papers we have counts for
3 papers · 1 filter
You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling
Zhanpeng Zeng, Yunyang Xiong, Sathya N. Ravi +3
Transformer-based models are widely used in natural language processing (NLP). Central to the transformer model is the self-attention mechanism, which captures the interactions of…
Neural TMDlayer: Modeling Instantaneous flow of features via SDE Generators
Zihang Meng, Vikas Singh, Sathya N. Ravi
We study how stochastic differential equation (SDE) based ideas can inspire new modifications to existing algorithms for a set of problems in computer vision. Loosely speaking, our…
Learning Invariant Representations using Inverse Contrastive Loss
Aditya Kumar Akash, Vishnu Suresh Lokhande, Sathya N. Ravi +1
Learning invariant representations is a critical first step in a number of machine learning tasks. A common approach corresponds to the so-called information bottleneck principle i…