4 citations · 9 across the 12 of their papers we have counts for
4 papers · 1 filter
Pretrained Image-Text Models are Secretly Video Captioners
Chunhui Zhang, Yiren Jian, Zhongyu Ouyang +1
Developing video captioning models is computationally expensive. The dynamic nature of video also complicates the design of multimodal models that can effectively caption these seq…
Learning Musical Representations for Music Performance Question Answering
Xingjian Diao, Chunhui Zhang, Tingxuan Wu +4
Music performances are representative scenarios for audio-visual modeling. Unlike common scenarios with sparse audio, music performances continuously involve dense audio signals th…
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understanding
Xingjian Diao, Chunhui Zhang, Weiyi Wu +5
Multimodal foundation models (MFMs) have demonstrated significant success in tasks such as visual captioning, question answering, and image-text retrieval. However, these models fa…
Answer-Driven Visual State Estimator for Goal-Oriented Visual Dialogue
Zipeng Xu, Fangxiang Feng, Xiaojie Wang +3
A goal-oriented visual dialogue involves multi-turn interactions between two agents, Questioner and Oracle. During which, the answer given by Oracle is of great significance, as it…