298 citations · 435 across the 25 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 39 cited
FastMoE: A Fast Mixture-of-Expert Training System
Jiaao He, Jiezhong Qiu, Aohan Zeng +3
Mixture-of-Expert (MoE) presents a strong potential in enlarging the size of language model to trillions of parameters. However, training trillion-scale MoE requires algorithm and…
cs.SI2021★ 5 cited
CogDL: A Comprehensive Library for Graph Deep Learning
Yukuo Cen, Zhenyu Hou, Yan Wang +15
Graph neural networks (GNNs) have attracted tremendous attention from the graph learning community in recent years. It has been widely adopted in various real-world applications fr…