most citedFrom Image to Video, what do we need in multimodal LLMs?

3 citations · 6 across the 7 of their papers we have counts for

collaborators

8 papers

cs.IR2025

TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Framework

Chao Zhang, Yuhao Wang, Derong Xu +9

Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round…

cs.IR2024

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

Suyuan Huang, Chao Zhang, Yuanyuan Wu +12

Dense retrieval in most industries employs dual-tower architectures to retrieve query-relevant documents. Due to online deployment requirements, existing real-world dense retrieval…

cs.CL2024

Benchmarking Large Language Models for Conversational Question Answering in Multi-instructional Documents

Shiwei Wu, Chen Zhang, Yan Gao +4

Instructional documents are rich sources of knowledge for completing various tasks, yet their unique challenges in conversational question answering (CQA) have not been thoroughly…

cs.CV2024★ 2 cited

VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computation

Shiwei Wu, Joya Chen, Kevin Qinghong Lin +7

A well-known dilemma in large vision-language models (e.g., GPT-4, LLaVA) is that while increasing the number of vision tokens generally enhances visual understanding, it also sign…

cs.CV2024

From a Social Cognitive Perspective: Context-aware Visual Social Relationship Recognition

Shiwei Wu, Chao Zhang, Joya Chen +4

People's social relationships are often manifested through their surroundings, with certain objects or interactions acting as symbols for specific relationships, e.g., wedding ring…

cs.IR2024★ 1 cited

NoteLLM-2: Multimodal Large Representation Models for Recommendation

Chao Zhang, Haoxin Zhang, Shiwei Wu +6

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularl…

cs.CV2024★ 3 cited

From Image to Video, what do we need in multimodal LLMs?

Suyuan Huang, Haoxin Zhang, Linqing Zhong +4

Covering from Image LLMs to the more complex Video LLMs, the Multimodal Large Language Models (MLLMs) have demonstrated profound capabilities in comprehending cross-modal informati…

cs.IR2024

NoteLLM: A Retrievable Large Language Model for Note Recommendation

Chao Zhang, Shiwei Wu, Haoxin Zhang +5

People enjoy sharing "notes" including their experiences within online communities. Therefore, recommending notes aligned with user interests has become a crucial task. Existing on…