52 citations · 56 across the 8 of their papers we have counts for
1 paper · 2 filters
Feng-Ting Liao, Guan-Ting Yi, Tzu-Quan Lin +2
The architectural shape of dense Transformers has remained remarkably stable: narrow-wide-narrow feed-forward networks (FFNs) consume most non-embedding parameters. Motivated by th…