Open Your Model's Eyes: Video and Context-Aware Multimodal Backchannel Prediction

Min-Jae Kim, Jun-Yeong Moon, Mujeen Sung +1

Backchannels, which signal listener states like empathy and understanding, are fundamental to natural human interaction. However, current approaches rely solely on audio and text.…