149 citations · 173 across the 6 of their papers we have counts for
1 paper · 1 filter
Jianwei Yang, Chunyuan Li, Xiyang Dai +2
We propose focal modulation networks (FocalNets in short), where self-attention (SA) is completely replaced by a focal modulation mechanism for modeling token interactions in visio…