4 papers · 1 filter
One Model, Two Paths: Balancing Single-Pass and Looped Performance in Language Models
Jiarun Shen, Lei Zhao, Xiao Li
Repeating Transformer layers can improve language-model performance without adding parameters. A pretrained model can be adapted to support both single-pass and looped inference by…
Why On-Policy Distillation Sometimes Fails: Vanishing Learning Signals
Lei Zhao, Qichao Zhao, Bowen Zuo +1
On-policy distillation (OPD) enables effective capability transfer between language models, yet the mechanisms underlying its failures are not fully understood. Across code generat…
Disentangling Language Roles in Multilingual LLM Task Execution
Qishi Zhan, Minxuan Hu, Seoyeon Jang +7
Multilingual LLMs are increasingly used when instruction, source content, and required response languages do not coincide. Existing benchmarks have expanded multilingual instructio…
TikArt: Stabilizing Aperture-Guided Fine-Grained Visual Reasoning with Reinforcement Learning
Hao Ding, Zhichuan Yang, Weijie Ge +3
Fine-grained visual reasoning in multimodal large language models (MLLMs) is bottlenecked by single-pass global image encoding: key evidence often lies in tiny objects, cluttered r…