3 citations · 10 across the 12 of their papers we have counts for
Showing 2026 · cs.LGShow all
3 papers · 2 filters
cs.LG2026
DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices
Chenyang Song, Weilin Zhao, Xu Han +3
While Mixture-of-Experts (MoE) scales model capacity without proportionally increasing computation, its massive total parameter footprint creates significant storage and memory-acc…
cs.LG2026
FORGE: Fragment-Oriented Ranking and Generation for Context-Aware Molecular Optimization
Qingchuan Zhang, He Cao, Hao Li +6
Molecular optimization seeks to improve a molecule through small structural edits while preserving similarity to the starting compound. Recent language-model approaches typically t…
cs.LG2026
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
Yaxuan Li, Yuxin Zuo, Bingxiang He +8
On-policy distillation (OPD) has become a core technique in the post-training of large language models, yet its training dynamics remain poorly understood. This paper provides a sy…