Query-aligned video frame selection for long video understanding

Md. Safayet Islam, Dilip Sarkar, Liang Liang

Multimodal large language models (MLLMs) process multimodal inputs by converting text, images, and videos into token sequences that are subsequently processed by a backbone languag…