8 citations · 8 across the 4 of their papers we have counts for
1 paper · 1 filter
Yangjun Wu, Kebin Fang, Dongxiang Zhang +3
Structured dropout approaches, such as attention dropout and DropHead, have been investigated to regularize the multi-head attention mechanism in Transformers. In this paper, we pr…