activity
20232026
most citedResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

8 citations · 28 across the 29 of their papers we have counts for

collaborators
Showing 2025Show all

9 papers · 1 filter

cs.LG2025

Hierarchical LoRA MoE for Efficient CTR Model Scaling

Zhichen Zeng, Mengyue Hang, Xiaolong Liu +11

Deep models have driven significant advances in click-through rate (CTR) prediction. While vertical scaling via layer stacking improves model expressiveness, the layer-by-layer seq…

cs.CL2025

Harnessing Consistency for Robust Test-Time LLM Ensemble

Zhichen Zeng, Qi Yu, Xiao Lin +6

Different large language models (LLMs) exhibit diverse strengths and weaknesses, and LLM ensemble serves as a promising approach to integrate their complementary capabilities. Desp…

cs.LG2025★ 1 cited

PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignment

Qi Yu, Zhichen Zeng, Yuchen Yan +5

Network alignment (NA) aims to identify node correspondence across different networks and serves as a critical cornerstone behind various downstream multi-network learning tasks. D…

cs.LG2025

Pave Your Own Path: Graph Gradual Domain Adaptation on Fused Gromov-Wasserstein Geodesics

Zhichen Zeng, Ruizhong Qiu, Wenxuan Bao +6

Graph neural networks, despite their impressive performance, are highly vulnerable to distribution shifts on graphs. Existing graph domain adaptation (graph DA) methods often impli…

cs.LG2025

CATS: Mitigating Correlation Shift for Multivariate Time Series Classification

Xiao Lin, Zhichen Zeng, Tianxin Wei +3

Unsupervised Domain Adaptation (UDA) leverages labeled source data to train models for unlabeled target data. Given the prevalence of multivariate time series (MTS) data across var…

cs.LG2025★ 8 cited

ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

Mengting Ai, Tianxin Wei, Yifan Chen +7

Mixture-of-Experts (MoE) Transformer, the backbone architecture of multiple phenomenal language models, leverages sparsity by activating only a fraction of model parameters for eac…

cs.AI2025

Joint Optimal Transport and Embedding for Network Alignment

Qi Yu, Zhichen Zeng, Yuchen Yan +3

Network alignment, which aims to find node correspondence across different networks, is the cornerstone of various downstream multi-network and Web mining tasks. Most of the embedd…

cs.LG2025

Improving LLM General Preference Alignment via Optimistic Online Mirror Descent

Yuheng Zhang, Dian Yu, Tao Ge +5

Reinforcement learning from human feedback (RLHF) has demonstrated remarkable effectiveness in aligning large language models (LLMs) with human preferences. Many existing alignment…

cs.LG2025★ 1 cited

THeGCN: Temporal Heterophilic Graph Convolutional Network

Yuchen Yan, Yuzhong Chen, Huiyuan Chen +6

Graph Neural Networks (GNNs) have exhibited remarkable efficacy in diverse graph learning tasks, particularly on static homophilic graphs. Recent attention has pivoted towards more…