Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
It Takes a Good Model to Train a Good Model: Generalized Gaussian Priors for Optimized LLMs
Jun Wu, Patrick Huang, Jiangtao Wen +1
Despite rapid progress in large language models (LLMs), the statistical structure of their weights, activations, and gradients-and its implications for initialization, training dyn…
cs.LG2025
BackSlash: Rate Constrained Optimized Training of Large Language Models
Jun Wu, Jiangtao Wen, Yuxing Han
The rapid advancement of large-language models (LLMs) has driven extensive research into parameter compression after training has been completed, yet compression during the trainin…