Aligning Large Vision-Language Models at Test Time: A Trajectory-Guided Structured Sampling Approach

Tianbao Jiang, Weicong Ni, Gerard de Melo +1

Post-training reinforcement learning (RL) algorithms are commonly used to align large vision-language models (LVLMs) with human intent and the requirements of visual reasoning task…