4 papers
Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
Minxin Zhang, Yuxuan Liu, Hayden Schaeffer
Efficient stochastic optimization typically integrates an update direction that performs well in the deterministic regime with a mechanism adapting to stochastic perturbations. Whi…
Boundary mutual information in double holography
Yuxuan Liu, Yi Ling, Zhuo-Yu Xian
We consider a composite system where AdS gravity is coupled to a flat heat bath and investigate the mutual information between two subregions on the intersection of the AdS…
PuYun-LDM: A Latent Diffusion Model for High-Resolution Ensemble Weather Forecasts
Lianjun Wu, Shengchen Zhu, Yuxuan Liu +7
Latent diffusion models (LDMs) suffer from limited diffusability in high-resolution (<=0.25°) ensemble weather forecasting, where diffusability characterizes how easily a latent d…
Diving into 3D Parallelism with Heterogeneous Spot Instance GPUs: Design and Implications
Yuxiao Wang, Yuedong Xu, Qingyang Duan +4
The rapid growth of large language models (LLMs) and the continuous release of new GPU products have significantly increased the demand for distributed training across heterogeneou…