Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models
Baohang Li, Xiaocheng Feng, Yichong Huang +6
Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing methods focus primarily on balanci…
cs.CL2026
ACTD: Anchor-Based Cross-Tokenizer Distillation with Residual Regularization
Huiyi Zhang, Zijian Li, Xiaocheng Feng +4
Knowledge distillation effectively transfers reasoning capabilities from large language models to lightweight student models. To enable knowledge transfer across disparate model fa…