Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback

Ho-min Park, Byungkon Kang

This work proposes a mutual feedback architecture, MEQ, that refines the two inputs, of possibly different modalities, into a pair of coupled embeddings such that each embedding re…