2 papers
cs.LG2022
Why self-attention is Natural for Sequence-to-Sequence Problems? A Perspective from Symmetries
Chao Ma, Lexing Ying
In this paper, we show that structures similar to self-attention are natural to learn many sequence-to-sequence problems from the perspective of symmetry. Inspired by language proc…
cs.CL2018
Joint Neural Entity Disambiguation with Output Space Search
Hamed Shahbazi, Xiaoli Z. Fern, Reza Ghaeini +3
In this paper, we present a novel model for entity disambiguation that combines both local contextual information and global evidences through Limited Discrepancy Search (LDS). Giv…