1 citations · 1 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Pre-carved Niches: The Formation Dynamics of Modular Task Partitions in Early LLM Training
Guangqi Li, Yongxin Li
Large language models exhibit a modular internal organization that mirrors well-studied functional networks of the human brain, but how this organization forms during training is u…
cs.LG2026
Selection Plateau and a Sparsity-Dependent Hierarchy of Pruning Features
Guangqi Li, Yongxin Li
We identify a Selection Plateau phenomenon in one-shot neural network pruning: all rank-monotone weight scorers converge to identical accuracy at fixed sparsity, independent of fun…