7 papers
Towards Sparse Video Understanding and Reasoning
Chenwei Xu, Zhen Ye, Shang Wu +8
We present \revise (\underline{Re}asoning with \underline{Vi}deo \underline{S}parsity), a multi-round agent for video question answering (VQA). Instead of uniformly sampling frames…
PhyPrompt: RL-based Prompt Refinement for Physically Plausible Text-to-Video Generation
Shang Wu, Chenwei Xu, Zhuofan Xia +6
State-of-the-art text-to-video (T2V) generators frequently violate physical laws despite high visual quality. We show this stems from insufficient physical constraints in prompts r…
Step by Step Network
Dongchen Han, Tianzhu Ye, Zhuofan Xia +4
Scaling up network depth is a fundamental pursuit in neural architecture design, as theory suggests that deeper models offer exponentially greater capability. Benefiting from the r…
Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception
Yulin Wang, Yang Yue, Huanqian Wang +11
Human vision is highly adaptive, efficiently sampling intricate environments by sequentially fixating on task-relevant regions. In contrast, prevailing machine vision models passiv…
Bridging the Divide: Reconsidering Softmax and Linear Attention
Dongchen Han, Yifan Pu, Zhuofan Xia +6
Widely adopted in modern Vision Transformer designs, Softmax attention can effectively capture long-range visual information; however, it incurs excessive computational cost when d…
Demystify Mamba in Vision: A Linear Attention Perspective
Dongchen Han, Ziyi Wang, Zhuofan Xia +7
Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision…