10 citations · 15 across the 7 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
On the Role of Attention Masks and LayerNorm in Transformers
Xinyi Wu, Amir Ajorlou, Yifei Wang +2
Self-attention is the key mechanism of transformers, which are the essential building blocks of modern foundation models. Recent studies have shown that pure self-attention suffers…
cs.LG2024
Belief Samples Are All You Need For Social Learning
Mahyar JafariNodeh, Amir Ajorlou, Ali Jadbabaie
In this paper, we consider the problem of social learning, where a group of agents embedded in a social network are interested in learning an underlying state of the world. Agents…