2 papers
cs.CV2026
Anti-Shortcut Distillation via Temporal Negative Knowledge Transfer
Syed Muhammad Raza, Omer Tariq, Jeongbae Son
Knowledge distillation (KD) trains a compact student by attracting it towards a converged teacher. It is silent about which directions the teacher itself learned to suppress: repul…
cs.AI2026
cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMs
Xin Yang, Yemin Wang, Mingda Liu +4
Scaling large language models (LLMs) has driven their success, yet dense Transformers couple capacity and computation: every parameter is activated for every token, making training…