5 papers
Thyme: Think Beyond Images
Yi-Fan Zhang, Xingyu Lu, Shukang Yin +17
Following OpenAI's introduction of the ``thinking with images'' concept, recent efforts have explored stimulating the use of visual information in the reasoning process to enhance…
Why Distillation can Outperform Zero-RL: The Role of Flexible Reasoning
Xiao Hu, Xingyu Lu, Liyuan Mao +6
Reinforcement learning (RL) has played an important role in improving the reasoning ability of large language models (LLMs). Some studies apply RL directly to \textit{smaller} base…
VLM as Policy: Common-Law Content Moderation Framework for Short Video Platform
Xingyu Lu, Tianke Zhang, Chang Meng +14
Exponentially growing short video platforms (SVPs) face significant challenges in moderating content detrimental to users' mental health, particularly for minors. The dissemination…
InstructEngine: Instruction-driven Text-to-Image Alignment
Xingyu Lu, Yuhang Hu, YiFan Zhang +9
Reinforcement Learning from Human/AI Feedback (RLHF/RLAIF) has been extensively utilized for preference alignment of text-to-image models. Existing methods face certain limitations…
Kwai-STaR: Transform LLMs into State-Transition Reasoners
Xingyu Lu, Yuhang Hu, Changyi Liu +12
Mathematical reasoning presents a significant challenge to the cognitive capabilities of LLMs. Various methods have been proposed to enhance the mathematical ability of LLMs. Howev…