41 citations · 134 across the 27 of their papers we have counts for
7 papers · 1 filter
MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Models
Haoxuan Li, Zhengmao Yang, Yunshan Ma +3
We study an emerging and intriguing problem of multimodal temporal event forecasting with large language models. Compared to using text or graph modalities, the investigation of ut…
GalleryGPT: Analyzing Paintings with Large Multimodal Models
Yi Bin, Wenhao Shi, Yujuan Ding +5
Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Understand…
Leveraging Weak Cross-Modal Guidance for Coherence Modelling via Iterative Learning
Yi Bin, Junrong Liao, Yujuan Ding +4
Cross-modal coherence modeling is essential for intelligent systems to help them organize and structure information, thereby understanding and creating content of the physical worl…
Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detection
Zhenni Yu, Xiaoqin Zhang, Li Zhao +2
This paper introduces a new Segment Anything Model with Depth Perception (DSAM) for Camouflaged Object Detection (COD). DSAM exploits the zero-shot capability of SAM to realize pre…
MAMA: Meta-optimized Angular Margin Contrastive Framework for Video-Language Representation Learning
Thong Nguyen, Yi Bin, Xiaobao Wu +6
Data quality stands at the forefront of deciding the effectiveness of video-language representation learning. However, video-text pairs in previous data typically do not align perf…
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
Wenhao Shi, Zhiqiang Hu, Yi Bin +5
Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruct…
Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives
Thong Nguyen, Yi Bin, Junbin Xiao +6
Humans use multiple senses to comprehend the environment. Vision and language are two of the most vital senses since they allow us to easily communicate our thoughts and perceive t…