7 papers
Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
Zihao Jing, Qiuhao Zeng, Ruiyi Fang +4
Large language models (LLMs) are enabling reasoning over 2D and 3D structures, yet existing methods remain modality-specific and typically compress structural inputs through sequen…
Attention Dispersion in Dynamic Graph Transformers: Diagnosis and a Transferable Fix
Jinhao Zhang, Kangfei Zhao, Qiuhao Zeng +1
Transformer-based architectures have become the dominant paradigm for Continuous-Time Dynamic Graph (CTDG) learning, yet their performance remains limited on temporally shifted dat…
Entropy-Guided Dynamic Tokens for Graph-LLM Alignment in Molecular Understanding
Zihao Jing, Qiuhao Zeng, Ruiyi Fang +3
Molecular understanding is central to advancing areas such as scientific discovery, yet Large Language Models (LLMs) struggle to understand molecular graphs effectively. Existing g…
Graph Domain Adaptation via Homophily-Agnostic Reconstructing Structure
Ruiyi Fang, Shuo Wang, Ruizhi Pu +8
Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. However, existing GDA methods t…
Homophily Enhanced Graph Domain Adaptation
Ruiyi Fang, Bingheng Li, Jingyu Zhao +5
Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. In this paper, we highlight the…
ZETA: Leveraging Z-order Curves for Efficient Top-k Attention
Qiuhao Zeng, Jerry Huang, Peng Lu +4
Over recent years, the Transformer has become a fundamental building block for sequence modeling architectures. Yet at its core is the use of self-attention, whose memory and compu…