3 papers
cs.AI2026
VisualDeltas: Learning Preferences from Visual Quality Perturbations
Hailiang Huang, Yihao Liu, Shengyue Guan +2
We present VisualDeltas, a lightweight preference-learning framework that extracts supervision from visual quality variations in multimodal data. By leveraging the systematic impac…
cs.CL2026
Reinforcement Learning for Chain of Thought Compression with One-Domain-to-All Generalization
Hanyu Li, Jiangshan Duo, Bofei Gao +4
Chain-of-thought reasoning in large language models can trigger an "overthinking trap": longer rollouts raise cost and latency yet often yield unreliable accuracy gains. Existing m…
cs.CL2026
JudgeRLVR: Judge First, Generate Second for Efficient Reasoning
Jiangshan Duo, Hanyu Li, Hailin Zhang +3
Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard paradigm for reasoning in Large Language Models. However, optimizing solely for final-answer correctness…