111 citations · 257 across the 26 of their papers we have counts for
3 papers · 1 filter
Where and When: Space-Time Attention for Audio-Visual Explanations
Yanbei Chen, Thomas Hummel, A. Sophia Koepke +1
Explaining the decision of a multi-modal decision-maker requires to determine the evidence from both modalities. Recent advances in XAI provide explanations for models trained on s…
Audio Retrieval with Natural Language Queries
Andreea-Maria Oncescu, A. Sophia Koepke, João F. Henriques +2
We consider the task of retrieving audio using free-form natural language queries. To study this problem, which has received limited attention in the existing literature, we introd…
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
Yanbei Chen, Yongqin Xian, A. Sophia Koepke +2
Having access to multi-modal cues (e.g. vision and audio) empowers some cognitive tasks to be done faster compared to learning from a single modality. In this work, we propose to t…