6 papers · 1 filter
The Role of Social Support and Influencers in Social Media Communities
Junwei Su, Peter Marbach
How can individual agents coordinate their actions to achieve a shared objective in distributed systems? This challenge spans economic, technical, and sociological domains, each co…
Heta: Distributed Training of Heterogeneous Graph Neural Networks
Yuchen Zhong, Junwei Su, Chuan Wu +1
Heterogeneous Graph Neural Networks (HGNNs) leverage diverse semantic relationships in Heterogeneous Graphs (HetGs) and have demonstrated remarkable learning performance in various…
MSPipe: Efficient Temporal GNN Training via Staleness-Aware Pipeline
Guangming Sheng, Junwei Su, Chao Huang +1
Memory-based Temporal Graph Neural Networks (MTGNNs) are a class of temporal graph neural networks that utilize a node memory module to capture and retain long-term temporal depend…
On the Limitation and Experience Replay for GNNs in Continual Learning
Junwei Su, Difan Zou, Chuan Wu
Continual learning seeks to empower models to progressively acquire information from a sequence of tasks. This approach is crucial for many real-world systems, which are dynamic an…
On the Topology Awareness and Generalization Performance of Graph Neural Networks
Junwei Su, Chuan Wu
Many computer vision and machine learning problems are modelled as learning tasks on graphs where graph neural networks GNNs have emerged as a dominant tool for learning representa…
Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems
Junwei Su, Difan Zou, Chuan Wu
Stochastic gradient descent (SGD) exhibits strong algorithmic regularization effects in practice and plays an important role in the generalization of modern machine learning. Howev…