14 citations · 17 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 3 cited
On Optimizing the Communication of Model Parallelism
Yonghao Zhuang, Hexu Zhao, Lianmin Zheng +6
We study a novel and important communication pattern in large-scale model-parallel deep learning (DL), which we call cross-mesh resharding. This pattern emerges when the two paradi…
cs.CL2021★ 14 cited
Fully Hyperbolic Neural Networks
Weize Chen, Xu Han, Yankai Lin +5
Hyperbolic neural networks have shown great potential for modeling complex data. However, existing hyperbolic networks are not completely hyperbolic, as they encode features in a h…