4 papers · 1 filter
Understanding Knowledge Distillation in Post-Training: When It Helps and When It Fails
Xin Liu, Simin Ma, Shujian Liu +5
Large language models (LLMs) achieve strong performance across many tasks, but their high computational cost limits deployment in resource-constrained environments. Knowledge Disti…
LogicIF: Towards Complex Logic Instruction Following
Mian Zhang, Shujian Liu, Sixun Dong +10
Instruction following has catalyzed the recent era of Large Language Models (LLMs) and is the foundational skill underpinning more advanced capabilities such as reasoning and agent…
Self-Speculative Biased Decoding for Faster Re-Translation
Linxiao Zeng, Haoyun Deng, Kangyuan Shu +1
Large language models achieve strong machine translation quality but incur high inference cost and latency, posing challenges for simultaneous translation. Re-translation provides…
Aligning Multilingual Reasoning with Verifiable Semantics from a High-Resource Expert Model
Fahim Faisal, Kaiqiang Song, Song Wang +4
While reinforcement learning has advanced the reasoning abilities of Large Language Models (LLMs), these gains are largely confined to English, creating a significant performance d…