1 citations · 1 across the 3 of their papers we have counts for
3 papers
cs.LG2026
Beyond the Matrix Sign: Quadratic Spectral Descent
Qiaozhe Zhang, Jun Sun, Yingzhuang Liu
Muon emerges as a strong competitor of the AdamW for LLM pretraining, because the matrix-wise update it employs can potentially incur smaller second-order penalty than the once dom…
cs.LG2025
Rényi Sharpness: A Novel Sharpness that Strongly Correlates with Generalization
Qiaozhe Zhang, Jun Sun, Ruijie Zhang +1
Sharpness (of the loss minima) is widely believed to be a good indicator of generalization of neural networks. Unfortunately, the correlation between existing sharpness measures an…
stat.ML2023★ 1 cited
How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective
Qiaozhe Zhang, Ruijie Zhang, Jun Sun +1
Network pruning is a commonly used measure to alleviate the storage and computational burden of deep neural networks. However, the fundamental limit of network pruning is still lac…