5 citations · 7 across the 3 of their papers we have counts for
1 paper · 1 filter
Zhizhan Zheng, Feiyun Zhang, Shuchun Liu +4
While Attention Residuals has shown some effectiveness in addressing the widespread issue of unbounded activation growth across deep residual layers, it inevitably incurs significa…