3 papers
cs.LG2025
Alada: Alternating Adaptation of Momentum Method for Memory-Efficient Matrix Optimization
Xiaoyu He, Yu Cai, Jin Jia +3
This work proposes Alada, an adaptive momentum method for stochastic optimization over large-scale matrices. Alada employs a rank-one factorization approach to estimate the second…
cs.CV2025
Vision as LoRA
Han Wang, Yongjie Ye, Bingru Li +5
We introduce Vision as LoRA (VoRA), a novel paradigm for transforming an LLM into an MLLM. Unlike prevalent MLLM architectures that rely on external vision modules for vision encod…
cs.CV2024
Dynamic-VLM: Simple Dynamic Visual Token Compression for VideoLLM
Han Wang, Yuxiang Nie, Yongjie Ye +6
The application of Large Vision-Language Models (LVLMs) for analyzing images and videos is an exciting and rapidly evolving field. In recent years, we've seen significant growth in…