Video2Reaction: Training Foundation Video Models to Predict Audience Reaction

Sidong Zhang, Trang Nguyen, Shiv Shankar +4

We introduce Video2Reaction, a multimodal dataset that maps short movie segments to the induced emotional reactions of viewers in the wild, as expressed through social media commen…