Causal Attention for Vision-Language Tasks

Xu Yang, Hanwang Zhang, Guojun Qi +1

We present a novel attention mechanism: Causal Attention (CATT), to remove the ever-elusive confounding effect in existing attention-based vision-language models. This effect cause…