65 citations · 137 across the 21 of their papers we have counts for
1 paper · 1 filter
Zekun Zhou, Ruobing Xie, Lanrui Wang +1
Gated attention is an effective approach to mitigate attention sinks and enhance the representational capacity of attention. To further extend its effectiveness-efficiency Pareto f…