2 citations · 2 across the 6 of their papers we have counts for
4 papers · 1 filter
Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility
Jaeseok Byun, Gukyeong Kwon, Han-Kai Hsu +4
Upgrading embedding models typically requires expensive database re-indexing, as new query embeddings are incompatible with existing database embeddings. While Backward Compatible…
Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers
Achin Jain, Jie An, Siddharth Chaudhary +1
Leveraging capabilities of large language models (LLMs) in text-to-image (T2I) synthesis is an important research direction. In this work we investigate whether the knowledge of a…
Visual Reasoning through Tool-supervised Reinforcement Learning
Qihua Dong, Gozde Sahin, Pei Wang +4
In this paper, we investigate the problem of how to effectively master tool-use to solve complex visual reasoning tasks for Multimodal Large Language Models. To achieve that, we pr…
Learning Compact Video Representations for Efficient Long-form Video Understanding in Large Multimodal Models
Yuxiao Chen, Jue Wang, Zhikang Zhang +8
With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens…