Variational Self-attention Model for Sentence Representation

Qiang Zhang, Shangsong Liang, Emine Yilmaz

This paper proposes a variational self-attention model (VSAM) that employs variational inference to derive self-attention. We model the self-attention vector as random variables by…