11 citations · 16 across the 3 of their papers we have counts for
1 paper · 1 filter
Guhnoo Yun, Juhan Yoo, Kijung Kim +2
Recent studies show that self-attentions behave like low-pass filters (as opposed to convolutions) and enhancing their high-pass filtering capability improves model performance. Co…