7 citations · 11 across the 11 of their papers we have counts for
4 papers · 1 filter
Adversarial Erasing with Pruned Elements: Towards Better Graph Lottery Ticket
Yuwen Wang, Shunyu Liu, Kaixuan Chen +5
Graph Lottery Ticket (GLT), a combination of core subgraph and sparse subnetwork, has been proposed to mitigate the computational cost of deep Graph Neural Networks (GNNs) on large…
Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization
Kaixuan Chen, Shunyu Liu, Tongtian Zhu +5
Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial struct…
Lookaround Optimizer: steps around, 1 step average
Jiangtao Zhang, Shunyu Liu, Jie Song +3
Weight Average (WA) is an active research topic due to its simplicity in ensembling deep networks and the effectiveness in promoting generalization. Existing weight average approac…
Decentralized SGD and Average-direction SAM are Asymptotically Equivalent
Tongtian Zhu, Fengxiang He, Kaixuan Chen +2
Decentralized stochastic gradient descent (D-SGD) allows collaborative learning on massive devices simultaneously without the control of a central server. However, existing theorie…