67 citations · 131 across the 29 of their papers we have counts for
3 papers · 1 filter
Compositional Attention: Disentangling Search and Retrieval
Sarthak Mittal, Sharath Chandra Raparthy, Irina Rish +2
Multi-head, key-value attention is the backbone of the widely successful Transformer model and its variants. This attention mechanism uses multiple parallel key-value attention blo…
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning
Nan Rosemary Ke, Aniket Didolkar, Sarthak Mittal +7
Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are ob…
Diffusion-Based Representation Learning
Sarthak Mittal, Korbinian Abstreiter, Stefan Bauer +2
Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training…