9 papers
Screenshots or Tools? Eliciting Tool Use and Managing Multimodal Context in Hybrid GUI-MCP Computer-Use Agents
Siqi Fan, Minghao Li, Xiaoqian Ma +6
Hybrid computer-use agents can act through screenshots or call text tools. We find that having a tool available does not settle which way the effect goes. Under one identical GUI-M…
Hint Tuning: Less Data Makes Better Reasoners
Siqi Fan, Minghao Li, Xiaoqian Ma +6
Large reasoning models achieve high accuracy through extended chain-of-thought but generate 5--8 more tokens than necessary, applying verbose reasoning uniformly regardless of prob…
Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs
Wenhui Tan, Minghao Li, Xiaoqian Ma +5
Long chain-of-thought reasoning has made autoregressive decoding the dominant inference cost of modern large language models. Existing methods target either the input side (latent…
Break Through the Compression Bottleneck: From Theory to Practice
Xiusheng Huang, Lu Wang, Yequan Wang +2
As the parameter size of language models continues to grow, effective model compression is required to reduce their computational and memory overhead. Existing compression methods…
Theory-optimal Quantization Based on Flatness
Xiusheng Huang, Zhe Li, Xuanwu Yin +5
Post-training quantization has emerged as a widely adopted technique for compressing and accelerating the inference of Large Language Models (LLMs). The primary challenges in LLMs…
Mutual Enhancement Between Global Tokens and Patch Tokens: From Theory to Practice
Xiusheng Huang, Xin Jiang, Jun Zhao +2
Accurate and effective discrete image tokenization is crucial for long image sequence processing. However, current methods rigidly compress all content at a fixed rate, ignoring th…