Where is the multimodal goal post? On the Ability of Foundation Models to Recognize Highlights in Videos

Aditya K Surikuchi, Raquel Fernández, Sandro Pezzelle

Foundation models are used for many real-world applications involving language understanding and generation from temporally-ordered multimodal events. In this work, we study the ab…