787 citations · 1.2k across the 16 of their papers we have counts for
Showing 2021 · cs.LGShow all
3 papers · 2 filters
cs.LG2021★ 1 cited
Stable Prediction on Graphs with Agnostic Distribution Shift
Shengyu Zhang, Kun Kuang, Jiezhong Qiu +5
Graph is a flexible and effective tool to represent complex structures in practice and graph neural networks (GNNs) have been shown to be effective on various graph tasks with rand…
cs.LG2021
Modeling Protein Using Large-scale Pretrain Language Model
Yijia Xiao, Jiezhong Qiu, Ziang Li +2
Protein is linked to almost every life process. Therefore, analyzing the biological structure and property of protein sequences is critical to the exploration of life, as well as d…
cs.LG2021★ 39 cited
FastMoE: A Fast Mixture-of-Expert Training System
Jiaao He, Jiezhong Qiu, Aohan Zeng +3
Mixture-of-Expert (MoE) presents a strong potential in enlarging the size of language model to trillions of parameters. However, training trillion-scale MoE requires algorithm and…