most citedPangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity

1 citations · 1 across the 10 of their papers we have counts for

collaborators
Showing cs.LGShow all

2 papers · 1 filter

cs.LG2025

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Wei He, Kai Han, Hang Zhou +4

The optimization of large language models (LLMs) remains a critical challenge, particularly as model scaling exacerbates sensitivity to algorithmic imprecision and training instabi…

cs.LG2025

Physics-Guided Multimodal Transformers are the Necessary Foundation for the Next Generation of Meteorological Science

Jing Han, Hanting Chen, Kai Han +4

This position paper argues that the next generation of artificial intelligence in meteorological and climate sciences must transition from fragmented hybrid heuristics toward a uni…