6 papers
SparseBalance: Load-Balanced Long Context Training with Dynamic Sparse Attention
Hongtao Xu, Jianchao Tan, Yuxuan Hu +8
While sparse attention mitigates the computational bottleneck of long-context LLM training, its distributed training process exhibits extreme heterogeneity in both \textit{1)} sequ…
Breaking the Training Barrier of Billion-Parameter Universal Machine Learning Interatomic Potentials
Yuanchang Zhou, Hongyu Wang, Yiming Du +12
Universal Machine Learning Interatomic Potentials (uMLIPs), pre-trained on massively diverse datasets encompassing inorganic materials and organic molecules across the entire perio…
MatRIS: Toward Reliable and Efficient Pretrained Machine Learning Interatomic Potentials
Yuanchang Zhou, Siyu Hu, Xiangyu Zhang +3
Foundation MLIPs demonstrate broad applicability across diverse material systems and have emerged as a powerful and transformative paradigm in chemical and computational materials…
fix pimd/langevin: An Efficient Implementation of Path Integral Molecular Dynamics in LAMMPS
Yifan Li, Axel Gomez, Kehan Cai +10
Path integral molecular dynamics (PIMD), which maps a quantum particle onto a fictitious classical system of ring polymers and propagates the "beads" of this extended classical sys…
A Graph Neural Network for the Era of Large Atomistic Models
Duo Zhang, Anyang Peng, Chun Cai +11
Foundation models, or large atomistic models (LAMs), aim to universally represent the ground-state potential energy surface (PES) of atomistic systems as defined by density functio…
DeePMD-kit v3: A Multiple-Backend Framework for Machine Learning Potentials
Jinzhe Zeng, Duo Zhang, Anyang Peng +44
In recent years, machine learning potentials (MLPs) have become indispensable tools in physics, chemistry, and materials science, driving the development of software packages for m…