4 papers · 1 filter
CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives
Yuhan Wang, Rui Hu, Batian Di +5
Data selection turns large multimodal instruction pools into compact training subsets tailored to a vision-language model's target capabilities. Effective selection requires both u…
Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence
Yuhan Wang, Shuochen Chang, Yalin Feng +8
Vision-language models (VLMs) have achieved strong performance on visual question answering (VQA). To mitigate individual hallucinations and blind spots, aggregating diverse perspe…
RAC: Rectified Flow Auto Coder
Sen Fang, Yalin Feng, Yanxin Zhang +6
In this paper, we propose a Rectified Flow Auto Coder (RAC) inspired by Rectified Flow to replace the traditional VAE: 1. It achieves multi-step decoding by applying the decoder to…
Stable Signer: Hierarchical Sign Language Generative Model
Sen Fang, Yalin Feng, Hongbin Zhong +2
Sign Language Production (SLP) is the process of converting the complex input text into a real video. Most previous works focused on the Text2Gloss, Gloss2Pose, Pose2Vid stages, an…