From the 1 of 10 linked papers with an AI index.
10 papers
A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs
Zijie Liu, Jie Peng, Jinhao Duan +7
The paper proposes a training‑free method that replicates heavily used experts and quantizes less important ones to rebalance workload in sparse mixture‑of‑experts large language m…
When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning
Wang Yang, Shouren Wang, Chaoda Song +6
Group Relative Policy Optimization (GRPO) has become a key technique for improving reasoning abilities in large language models, yet its behavior under different domain sequencing…
Catastrophic Forgetting in Kolmogorov-Arnold Networks
Mohammad Marufur Rahman, Guanchu Wang, Kaixiong Zhou +2
Catastrophic forgetting is a longstanding challenge in continual learning, where models lose knowledge from earlier tasks when learning new ones. While various mitigation strategie…
LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models
Xi Zhu, Haochen Xue, Ziwei Zhao +7
Text-Attributed Graphs (TAGs), where each node is associated with text descriptions, are ubiquitous in real-world scenarios. They typically exhibit distinctive structure and domain…
Gradient-based Model Shortcut Detection for Time Series Classification
Salomon Ibarra, Frida Cantu, Kaixiong Zhou +1
Deep learning models have attracted lots of research attention in time series classification (TSC) task in the past two decades. Recently, deep neural networks (DNN) have surpassed…
You Only Debias Once: Towards Flexible Accuracy-Fairness Trade-offs at Inference Time
Xiaotian Han, Tianlong Chen, Kaixiong Zhou +3
Deep neural networks are prone to various bias issues, jeopardizing their applications for high-stake decision-making. Existing fairness methods typically offer a fixed accuracy-fa…