Multi-layer Learnable Attention Mask for Multimodal Tasks

Wayner Barrios, SouYoung Jin

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimod…