5 papers · 1 filter
Streaming Video Instruction Tuning
Jiaer Xia, Peixian Chen, Mengdan Zhang +2
We present Streamo, a real-time streaming video LLM that serves as a general-purpose interactive assistant. Unlike existing online video models that focus narrowly on question answ…
ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigation
Zekai Zhang, Weiye Zhu, Hewei Pan +4
The Vision-and-Language Navigation (VLN) task requires an agent to follow natural language instructions and navigate through complex environments. Existing MLLM-based VLN methods p…
DREAM: Document Reconstruction via End-to-end Autoregressive Model
Xin Li, Mingming Gong, Yunfei Wu +7
Document reconstruction constitutes a significant facet of document analysis and recognition, a field that has been progressively accruing interest within the scholarly community.…
TACO: Think-Answer Consistency for Optimized Long-Chain Reasoning and Efficient Data Learning via Reinforcement Learning in LVLMs
Zhehan Kan, Yanlin Liu, Kun Yin +8
DeepSeek R1 has significantly advanced complex reasoning for large language models (LLMs). While recent methods have attempted to replicate R1's reasoning capabilities in multimoda…
Human Cognition Inspired RAG with Knowledge Graph for Complex Problem Solving
Yao Cheng, Yibo Zhao, Jiapeng Zhu +3
Large Language Models (LLMs) have demonstrated significant potential across various domains. However, they often struggle with integrating external knowledge and performing complex…