Multi-Modal Representation Learning with Text-Driven Soft Masks

Jaeyoo Park, Bohyung Han

We propose a visual-linguistic representation learning approach within a self-supervised learning framework by introducing a new operation, loss, and data augmentation strategy. Fi…