5 citations · 5 across the 2 of their papers we have counts for
2 papers
cs.CL2022
Generalized Attention Mechanism and Relative Position for Transformer
R. V. R. Pandya
In this paper, we propose generalized attention mechanism (GAM) by first suggesting a new interpretation for self-attention mechanism of Vaswani et al. . Following the interpretati…
cs.SD2017★ 5 cited
Unsupervised Learning of Semantic Audio Representations
Aren Jansen, Manoj Plakal, Ratheet Pandya +5
Even in the absence of any explicit semantic annotation, vast collections of audio recordings provide valuable information for learning the categorical structure of sounds. We cons…