1 citations · 1 across the 8 of their papers we have counts for
11 papers
Self-Confirming Superposition Traps in Reinforcement Learning
Dai Shi, Andi Han, Feng Chen +3
Reinforcement learning (RL) trains representations on data selected by the agent's policy, which then uses the resulting returns to guide its next choices. We show that this loop c…
SupportCal: Label-Free Calibration of Post-Trained LLMs via Reference Support and Corroboration
Linhan Luo, Lequan Lin, Dai Shi +3
Post-training often improves task performance but can degrade confidence calibration, leaving post-trained language models (PoLMs) more overconfident than their corresponding pretr…
FlashAR: Efficient Post-Training Acceleration for Autoregressive Image Generation
Junkang Zhou, Yefei He, Feng Chen +2
Large-scale autoregressive models have demonstrated remarkable capabilities in image generation. However, their sequential raster-scan decoding relies on strictly next-token predic…
LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models
Songtao Wei, Yi Li, Zhikai Li +7
Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajec…
OmniSparse: Training-Aware Fine-Grained Sparse Attention for Long-Video MLLMs
Feng Chen, Yefei He, Shaoxuan He +9
Existing sparse attention methods primarily target inference-time acceleration by selecting critical tokens under predefined sparsity patterns. However, they often fail to bridge t…
ACT as Human: Multimodal Large Language Model Data Annotation with Critical Thinking
Lequan Lin, Dai Shi, Andi Han +7
Supervised learning relies on high-quality labeled data, but obtaining such data through human annotation is both expensive and time-consuming. Recent work explores using large lan…
Sparsity Forcing: Reinforcing Token Sparsity of MLLMs
Feng Chen, Yefei He, Lequan Lin +4
Sparse attention mechanisms aim to reduce computational overhead with minimal accuracy loss by selectively processing salient tokens. Despite their effectiveness, most methods mere…
Neighboring Autoregressive Modeling for Efficient Visual Generation
Yefei He, Yuanyu He, Shaoxuan He +4
Visual autoregressive models typically adhere to a raster-order ``next-token prediction" paradigm, which overlooks the spatial and temporal locality inherent in visual content. Spe…
ZipAR: Parallel Auto-regressive Image Generation through Spatial Locality
Yefei He, Feng Chen, Yuanyu He +4
In this paper, we propose ZipAR, a training-free, plug-and-play parallel decoding framework for accelerating auto-regressive (AR) visual generation. The motivation stems from the o…
Evaluating and Advancing Multimodal Large Language Models in Perception Ability Lens
Feng Chen, Chenhui Gou, Jing Liu +6
As multimodal large language models (MLLMs) advance rapidly, rigorous evaluation has become essential, providing further guidance for their development. In this work, we focus on a…
ZipVL: Efficient Large Vision-Language Models with Dynamic Token Sparsification
Yefei He, Feng Chen, Jing Liu +4
The efficiency of large vision-language models (LVLMs) is constrained by the computational bottleneck of the attention mechanism during the prefill phase and the memory bottleneck…