5 papers
Regime-Aware Router Learning for Multi-Domain Medical Image Generation with Diffusion Experts
Yaoshuai Ma, Wei Yao, Yongxiang Liu +5
Heterogeneous medical image data motivate domain-specialized diffusion experts, but expert specialization alone does not determine how their predictions should be combined during s…
Muse: Representation Geometry of Muon Beyond Normalized Momentum
Da Chang, Qiankun Shi, Lvgang Zhang +4
Muon-style optimizers apply a polar map to matrix momentum, but their updates also depend on the representation of each parameter block before orthogonalization. We study this repr…
SMC-AI: Scaling Monte Carlo Simulation to Four Trillion Atoms with AI Accelerators
Xianglin Liu, Kai Yang, Fanli Zhou +9
The rapid advancement of deep learning is reshaping the hardware design landscape toward AI tasks, posing fundamental challenges for HPC workloads such as atomistic simulation. Her…
Calibrating and Rotating: A Unified Framework for Weight Conditioning in PEFT
Da Chang, Peng Xue, Yu Li +3
Parameter-Efficient Fine-Tuning (PEFT) methods are crucial for adapting large pre-trained models. Among these, LoRA is considered a foundational approach. Building on this, the inf…
On the Convergence of Muon and Beyond
Da Chang, Yongxiang Liu, Ganzhao Yuan +1
The Muon optimizer has demonstrated strong empirical performance in training neural networks with matrix-structured parameters. A central theoretical question is how momentum varia…