activity
20242026
most citedResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

8 citations · 16 across the 16 of their papers we have counts for

collaborators
Showing cs.LGShow all

6 papers · 1 filter

cs.LG2026

SafeImpute: Reliable Clinical Data Imputation via Conformal Selection

Xinrui He, Mengting Ai, Junting Wang +2

Clinical care often relies on key laboratory indicators, yet real-world patient visits are sparse and tests are ordered irregularly, leading to pervasive missingness. While many im…

cs.LG2026

Influence-Preserving Proxies for Gradient-Based Data Selection in LLM Fine-tuning

Sirui Chen, Yunzhe Qi, Mengting Ai +4

Supervised fine-tuning (SFT) relies critically on selecting training data that most benefits a model's downstream performance. Gradient-based data selection methods such as TracIn…

cs.LG2025

NIRVANA: Structured Pruning Reimagined for Large Language Model Compression

Mengting Ai, Tianxin Wei, Sirui Chen +1

While structured pruning presents a highly effective pathway for accelerating Large Language Model (LLM) inference, existing methods frequently suffer from significant performance…

cs.LG2025★ 8 cited

ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

Mengting Ai, Tianxin Wei, Yifan Chen +7

Mixture-of-Experts (MoE) Transformer, the backbone architecture of multiple phenomenal language models, leverages sparsity by activating only a fraction of model parameters for eac…

cs.LG2024★ 3 cited

PyG-SSL: A Graph Self-Supervised Learning Toolkit

Lecheng Zheng, Baoyu Jing, Zihao Li +9

Graph Self-Supervised Learning (SSL) has emerged as a pivotal area of research in recent years. By engaging in pretext tasks to learn the intricate topological structures and prope…

cs.LG2024★ 4 cited

APEX: Adaptive and Extreme Summarization for Personalized Knowledge Graphs

Zihao Li, Dongqi Fu, Mengting Ai +1

Knowledge graphs (KGs), which store an extensive number of relational facts, serve various applications. Recently, personalized knowledge graphs (PKGs) have emerged as a solution t…