135 citations · 239 across the 8 of their papers we have counts for
8 papers
MetaVideoAgent: Automated Video-Agent Evolution for Long-Form Video Understanding
Benlei Cui, Ruize Wang, Junjie Li +9
Long-form video understanding requires locating sparse, question-relevant evidence in long, multimodal videos. Real-world video distributions differ in modality-specific informatio…
AutoTraces: Autoregressive Trajectory Forecasting via Multimodal Large Language Models
Teng Wang, Yanting Lu, Ruize Wang
We present AutoTraces, an autoregressive vision-language-trajectory model for robot trajectory forecasting in humam-populated environments, which harnesses the inherent reasoning c…
TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning
Zhihao Fan, Zhongyu Wei, Siyuan Wang +4
Existing research for image captioning usually represents an image using a scene graph with low-level facts (objects and relations) and fails to capture the high-level semantics. I…
Neural Deepfake Detection with Factual Structure of Text
Wanjun Zhong, Duyu Tang, Zenan Xu +5
Deepfake detection, the task of automatically discriminating machine-generated text, is increasingly critical with recent advances in natural language generative models. Existing a…
Look, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning
Ying Cheng, Ruize Wang, Zhihao Pan +2
When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlyi…
Leveraging Declarative Knowledge in Text and First-Order Logic for Fine-Grained Propaganda Detection
Ruize Wang, Duyu Tang, Nan Duan +5
We study the detection of propagandistic text fragments in news articles. Instead of merely learning from input-output datapoints in training data, we introduce an approach to inje…