TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

Bo-Yuan Cheng, Kuan-Yu Chen, Po-Han Huang +2

Existing multimodal video highlight detectors typically assume that visual, audio, and textual streams are continuously available. In practice, however, inputs may suffer from loca…