1 citations · 1 across the 1 of their papers we have counts for
1 paper
Yimian Dai, Stefan Oehmcke, Fabian Gieseke +2
Activation functions and attention mechanisms are typically treated as having different purposes and have evolved differently. However, both concepts can be formulated as a non-lin…