82 citations · 307 across the 38 of their papers we have counts for
39 papers
A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs
Zijie Liu, Jie Peng, Jinhao Duan +7
Sparse Mixture-of-Experts (SMoE) architectures are increasingly used to scale large language models efficiently, delivering strong accuracy under fixed compute budgets. However, SM…
When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning
Wang Yang, Shouren Wang, Chaoda Song +6
Group Relative Policy Optimization (GRPO) has become a key technique for improving reasoning abilities in large language models, yet its behavior under different domain sequencing…
Catastrophic Forgetting in Kolmogorov-Arnold Networks
Mohammad Marufur Rahman, Guanchu Wang, Kaixiong Zhou +2
Catastrophic forgetting is a longstanding challenge in continual learning, where models lose knowledge from earlier tasks when learning new ones. While various mitigation strategie…
Gradient-based Model Shortcut Detection for Time Series Classification
Salomon Ibarra, Frida Cantu, Kaixiong Zhou +1
Deep learning models have attracted lots of research attention in time series classification (TSC) task in the past two decades. Recently, deep neural networks (DNN) have surpassed…
You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Time
Xiaotian Han, Tianlong Chen, Kaixiong Zhou +3
Deep neural networks are prone to various bias issues, jeopardizing their applications for high-stake decision-making. Existing fairness methods typically offer a fixed accuracy-fa…
LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models
Xi Zhu, Haochen Xue, Ziwei Zhao +7
Text-Attributed Graphs (TAGs), where each node is associated with text descriptions, are ubiquitous in real-world scenarios. They typically exhibit distinctive structure and domain…
Graph Neural Networks for Efficient AC Power Flow Prediction in Power Grids
Seyedamirhossein Talebi, Kaixiong Zhou
This paper proposes a novel approach using Graph Neural Networks (GNNs) to solve the AC Power Flow problem in power grids. AC OPF is essential for minimizing generation costs while…
Gradient Rewiring for Editable Graph Neural Network Training
Zhimeng Jiang, Zirui Liu, Xiaotian Han +6
Deep neural networks are ubiquitously adopted in many applications, such as computer vision, natural language processing, and graph analytics. However, well-trained neural networks…
TVE: Learning Meta-attribution for Transferable Vision Explainer
Guanchu Wang, Yu-Neng Chuang, Fan Yang +8
Explainable machine learning significantly improves the transparency of deep neural networks. However, existing work is constrained to explaining the behavior of individual model p…
DiscoverPath: A Knowledge Refinement and Retrieval System for Interdisciplinarity on Biomedical Research
Yu-Neng Chuang, Guanchu Wang, Chia-Yuan Chang +8
The exponential growth in scholarly publications necessitates advanced tools for efficient article retrieval, especially in interdisciplinary fields where diverse terminologies are…
Hessian-aware Quantized Node Embeddings for Recommendation
Huiyuan Chen, Kaixiong Zhou, Kwei-Herng Lai +4
Graph Neural Networks (GNNs) have achieved state-of-the-art performance in recommender systems. Nevertheless, the process of searching and ranking from a large item corpus usually…
ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning
Yucheng Shi, Kaixiong Zhou, Ninghao Liu
The recent contrastive learning methods, due to their effectiveness in representation learning, have been widely applied to modeling graph data. Random perturbation is widely used…
Editable Graph Neural Network for Node Classifications
Zirui Liu, Zhimeng Jiang, Shaochen Zhong +5
Despite Graph Neural Networks (GNNs) have achieved prominent success in many graph-based learning problem, such as credit risk assessment in financial networks and fake news detect…
Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model
Zirui Liu, Guanchu Wang, Shaochen Zhong +8
With the rapid growth in model size, fine-tuning the large pre-trained language model has become increasingly difficult due to its extensive memory usage. Previous works usually fo…
Compress, Then Prompt: Improving Accuracy-Efficiency Trade-off of LLM Inference with Transferable Prompt
Zhaozhuo Xu, Zirui Liu, Beidi Chen +5
While the numerous parameters in Large Language Models (LLMs) contribute to their superior performance, this massive scale makes them inefficient and memory-hungry. Thus, they are…
Context-aware Domain Adaptation for Time Series Anomaly Detection
Kwei-Herng Lai, Lan Wang, Huiyuan Chen +4
Time series anomaly detection is a challenging task with a wide range of real-world applications. Due to label sparsity, training a deep anomaly detector often relies on unsupervis…
A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges
Xuansheng Wu, Kaixiong Zhou, Mingchen Sun +2
The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-…
TinyKG: Memory-Efficient Training Framework for Knowledge Graph Neural Recommender Systems
Huiyuan Chen, Xiaoting Li, Kaixiong Zhou +4
There has been an explosion of interest in designing various Knowledge Graph Neural Networks (KGNNs), which achieve state-of-the-art performance and provide great explainability fo…
Adaptive Risk-Aware Bidding with Budget Constraint in Display Advertising
Zhimeng Jiang, Kaixiong Zhou, Mi Zhang +3
Real-time bidding (RTB) has become a major paradigm of display advertising. Each ad impression generated from a user visit is auctioned in real time, where demand-side platform (DS…
MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learning
Cameron Diao, Kaixiong Zhou, Zirui Liu +2
Molecular representation learning is crucial for the problem of molecular property prediction, where graph neural networks (GNNs) serve as an effective solution due to their struct…
QuanGCN: Noise-Adaptive Training for Robust Quantum Graph Convolutional Networks
Kaixiong Zhou, Zhenyu Zhang, Shengyuan Chen +4
Quantum neural networks (QNNs), an interdisciplinary field of quantum computing and machine learning, have attracted tremendous research interests due to the specific quantum advan…
RSC: Accelerating Graph Neural Networks Training via Randomized Sparse Computations
Zirui Liu, Shengyuan Chen, Kaixiong Zhou +3
The training of graph neural networks (GNNs) is extremely time consuming because sparse graph-based operations are hard to be accelerated by hardware. Prior art explores trading of…
A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking
Keyu Duan, Zirui Liu, Peihao Wang +5
Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla…
Differentially Private Counterfactuals via Functional Mechanism
Fan Yang, Qizhang Feng, Kaixiong Zhou +2
Counterfactual, serving as one emerging type of model explanation, has attracted tons of attentions recently from both industry and academia. Different from the conventional featur…