171 citations · 248 across the 20 of their papers we have counts for
13 papers · 1 filter
Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
Yuxin Wang, Yuanzhe Hu, Xiaokun Zhong +7
Neural networks trained under different hyperparameter settings can fall into distinct training "regimes," with consistent behavior within regimes and qualitative differences acros…
Non-exchangeable Conformal Prediction for Temporal Graph Neural Networks
Tuo Wang, Jian Kang, Yujun Yan +2
Conformal prediction for graph neural networks (GNNs) offers a promising framework for quantifying uncertainty, enhancing GNN reliability in high-stakes applications. However, exis…
Spectral Insights into Data-Oblivious Critical Layers in Large Language Models
Xuyuan Liu, Lei Hsiung, Yaoqing Yang +1
Understanding how feature representations evolve across layers in large language models (LLMs) is key to improving their interpretability and robustness. While recent studies have…
Exploring Consistency in Graph Representations:from Graph Kernels to Graph Neural Networks
Xuyuan Liu, Yinghao Cai, Qihui Yang +1
Graph Neural Networks (GNNs) have emerged as a dominant approach in graph representation learning, yet they often struggle to capture consistent similarity relationships among grap…
Enhancing Size Generalization in Graph Neural Networks through Disentangled Representation Learning
Zheng Huang, Qihui Yang, Dawei Zhou +1
Although most graph neural networks (GNNs) can operate on graphs of any size, their classification performance often declines on graphs larger than those encountered during trainin…
Interpretable Sparsification of Brain Graphs: Better Practices and Effective Designs for Graph Neural Networks
Gaotang Li, Marlena Duda, Xiang Zhang +2
Brain graphs, which model the structural and functional relationships between brain regions, are crucial in neuroscientific and clinical applications involving graph classification…
Tackling Size Generalization of Graph Neural Networks on Biological Data from a Spectral Perspective
Gaotang Li, Danai Koutra, Yujun Yan
We address the key challenge of size-induced distribution shifts in graph neural networks (GNNs) and their impact on the generalization of GNNs to larger graphs. Existing literatur…
EvoluNet: Advancing Dynamic Non-IID Transfer Learning on Graphs
Haohui Wang, Yuzhen Mao, Yujun Yan +8
Non-IID transfer learning on graphs is crucial in many high-stakes domains. The majority of existing works assume stationary distribution for both source and target domains. Howeve…
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices
Puja Trivedi, Ekdeep Singh Lubana, Yujun Yan +2
Unsupervised graph representation learning is critical to a wide range of applications where labels may be scarce or expensive to procure. Contrastive learning (CL) is an increasin…
Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networks
Yujun Yan, Milad Hashemi, Kevin Swersky +2
In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is kn…
Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
Zhengming Zhang, Yaoqing Yang, Zhewei Yao +3
Federated learning (FL) is a promising way to use the computing power of mobile devices while maintaining the privacy of users. Current work in FL, however, makes the unrealistic a…
Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs
Jiong Zhu, Yujun Yan, Lingxiao Zhao +3
We investigate the representation power of graph neural networks in the semi-supervised node classification task under heterophily or low homophily, i.e., in networks where connect…
Neural Execution Engines: Learning to Execute Subroutines
Yujun Yan, Kevin Swersky, Danai Koutra +2
A significant effort has been made to train neural networks that replicate algorithmic reasoning, but they often fail to learn the abstract concepts underlying these algorithms. Th…