7 papers
CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives
Yuhan Wang, Rui Hu, Batian Di +5
Data selection turns large multimodal instruction pools into compact training subsets tailored to a vision-language model's target capabilities. Effective selection requires both u…
Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence
Yuhan Wang, Shuochen Chang, Yalin Feng +8
Vision-language models (VLMs) have achieved strong performance on visual question answering (VQA). To mitigate individual hallucinations and blind spots, aggregating diverse perspe…
RAC: Rectified Flow Auto Coder
Sen Fang, Yalin Feng, Yanxin Zhang +6
In this paper, we propose a Rectified Flow Auto Coder (RAC) inspired by Rectified Flow to replace the traditional VAE: 1. It achieves multi-step decoding by applying the decoder to…
Stable Signer: Hierarchical Sign Language Generative Model
Sen Fang, Yalin Feng, Hongbin Zhong +2
Sign Language Production (SLP) is the process of converting the complex input text into a real video. Most previous works focused on the Text2Gloss, Gloss2Pose, Pose2Vid stages, an…
DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI
Hao Liang, Xiaochen Ma, Zhou Liu +32
The rapidly growing demand for high-quality data in Large Language Models (LLMs) has intensified the need for scalable, reliable, and semantically rich data preparation pipelines.…
StreamFlow: Theory, Algorithm, and Implementation for High-Efficiency Rectified Flow Generation
Sen Fang, Hongbin Zhong, Yalin Feng +2
New technologies such as Rectified Flow and Flow Matching have significantly improved the performance of generative models in the past two years, especially in terms of control acc…
Bridging the Gap between Text, Audio, Image, and Any Sequence: A Novel Approach using Gloss-based Annotation
Sen Fang, Sizhou Chen, Yalin Feng +2
This paper presents an innovative approach called BGTAI to simplify multimodal understanding by utilizing gloss-based annotation as an intermediate step in aligning Text and Audio…