From the 1 of 10 linked papers with an AI index.
10 papers
When Vision Overrides Language: Evaluating and Mitigating Counterfactual Failures in VLAs
Yu Fang, Yuchun Feng, Dong Jing +5
The paper studies how Vision-Language-Action (VLA) models often ignore language instructions by relying on visual shortcuts, introduces a counterfactual benchmark (LIBERO-CF) to ev…
Learning Action Priors for Cross-embodiment Robot Manipulation
Dong Jing, Tianqi Zhang, Jiaqi Liu +5
Most Vision-Language-Action (VLA) models build on a Vision-Language Model (VLM) backbone by attaching an action module and optimizing the full policy jointly. This design inherits…
TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies
Dong Jing, Jingchen Nie, Tianqi Zhang +4
Robot manipulation alternates between low-risk transit phases that call for fast execution and high-risk contact stages that demand slow, precise motion. Yet existing Vision-Langua…
Mixture of Horizons in Action Chunking
Dong Jing, Gang Wang, Jiaqi Liu +7
Vision-language-action (VLA) models have shown remarkable capabilities in robotic manipulation, but their performance is sensitive to the used during…
Say Cheese! Detail-Preserving Portrait Collection Generation via Natural Language Edits
Zelong Sun, Jiahui Wu, Ying Ba +2
As social media platforms proliferate, users increasingly demand intuitive ways to create diverse, high-quality portrait collections. In this work, we introduce Portrait Collection…
Adaptive Task Balancing for Visual Instruction Tuning via Inter-Task Contribution and Intra-Task Difficulty
Yanqi Dai, Yong Wang, Zebin You +3
Visual instruction tuning is a key training stage of large multimodal models. However, when learning multiple visual tasks simultaneously, this approach often results in suboptimal…