2 citations · 2 across the 1 of their papers we have counts for
1 paper
Guhnoo Yun, Juhan Yoo, Kijung Kim +2
Recent studies show that self-attentions behave like low-pass filters (as opposed to convolutions) and enhancing their high-pass filtering capability improves model performance. Co…