10 papers
Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression
Tianyu Liang, Xiangxi Zheng, Yilin Wang +1
Vision-Text Compression (VTC) renders long texts into images and encodes them through the vision encoder (ViT), compressing thousands of text tokens into far fewer visual tokens. H…
Efficient Frame Selection for Long Videos at Test Time with Attention-Based MLLM Selectors
Yilin Wang, Xiangxi Zheng, Dongxing Mao +6
Understanding long videos with multimodal large language models (MLLMs) requires selecting a compact set of frames from thousands of candidates, yet identifying the right frames se…
DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation
Siyu Yan, Yizhen Gao, Yilin Wang +2
Text-rich image generation is one of the most challenging settings in image generation, since models must simultaneously produce visually realistic images and render legible, seman…
Residual Decoder Adapter: ID-Preserving Tokenizer Adaption for Autoregressive Text Rendering
Dongxing Mao, Jinpeng Wang, Jiahao Tang +6
Visual Autoregressive (AR) models generate images by predicting discrete tokens that are decoded by a visual tokenizer. Despite demonstrating strong overall image generation abilit…
TextGround4M: A Prompt-Aligned Dataset for Layout-Aware Text Rendering
Dongxing Mao, Yilin Wang, Linjie Li +2
Despite recent advances in text-to-image generation, models still struggle to accurately render prompt-specified text with correct spatial layout -- especially in multi-span, struc…
From Charts to Code: A Hierarchical Benchmark for Multimodal Models
Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu +8
We introduce Chart2Code, a new benchmark for evaluating the chart understanding and code generation capabilities of large multimodal models (LMMs). Chart2Code is explicitly designe…