137 citations · 179 across the 21 of their papers we have counts for
23 papers
What do navigation agents learn about their environment?
Kshitij Dwivedi, Gemma Roig, Aniruddha Kembhavi +1
Today's state of the art visual navigation agents typically consist of large deep learning models trained end to end. Such models offer little to no interpretability about the lear…
Predicting emotion from music videos: exploring the relative contribution of visual and auditory information to affective responses
Phoebe Chua, Dimos Makris, Dorien Herremans +2
Although media content is increasingly produced, distributed, and consumed in multiple combinations of modalities, how individual modalities contribute to the perceived emotion of…
FRIDA -- Generative Feature Replay for Incremental Domain Adaptation
Sayan Rakshit, Anwesh Mohanty, Ruchika Chavhan +3
We tackle the novel problem of incremental unsupervised domain adaptation (IDA) in this paper. We assume that a labeled source domain and different unlabeled target domains are inc…
The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motion
R. M. Cichy, K. Dwivedi, B. Lahner +8
The sciences of natural and artificial intelligence are fundamentally connected. Brain-inspired human-engineered AI are now the standard for predicting human brain responses during…
AttendAffectNet: Self-Attention based Networks for Predicting Affective Responses from Movies
Ha Thi Phuong Thao, Balamurali B. T., Dorien Herremans +1
In this work, we propose different variants of the self-attention based network for emotion prediction from movies, which we call AttendAffectNet. We take both audio and video into…
Duality Diagram Similarity: a generic framework for initialization selection in task transfer learning
Kshitij Dwivedi, Jiahui Huang, Radoslaw Martin Cichy +1
In this paper, we tackle an open research question in transfer learning, which is selecting a model initialization to achieve high performance on a new task, given several pre-trai…