activity
20242026
most citedResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

8 citations · 18 across the 26 of their papers we have counts for

collaborators
Showing 2025Show all

12 papers · 1 filter

cs.IR2025

CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation

Tianxin Wei, Xuying Ning, Xuxing Chen +6

In web environments, user preferences are often refined progressively as users move from browsing broad categories to exploring specific items. However, existing generative recomme…

cs.CL2025

Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory

Tianxin Wei, Noveen Sachdeva, Benjamin Coleman +12

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and ev…

cs.CL2025★ 1 cited

Latent Collaboration in Multi-Agent Systems

Jiaru Zou, Ruizhong Qiu, Gaotang Li +10

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on…

cs.LG2025

Geometric-disentangelment Unlearning

Duo Zhou, Yuji Zhang, Tianxin Wei +9

Large language models (LLMs) can internalize private or harmful content, motivating unlearning that removes a forget set while preserving retaining knowledge. However, forgetting u…

cs.CL2025

Harnessing Consistency for Robust Test-Time LLM Ensemble

Zhichen Zeng, Qi Yu, Xiao Lin +6

Different large language models (LLMs) exhibit diverse strengths and weaknesses, and LLM ensemble serves as a promising approach to integrate their complementary capabilities. Desp…

cs.LG2025

NIRVANA: Structured Pruning Reimagined for Large Language Model Compression

Mengting Ai, Tianxin Wei, Sirui Chen +1

While structured pruning presents a highly effective pathway for accelerating Large Language Model (LLM) inference, existing methods frequently suffer from significant performance…

cs.LG2025

PowerGrow: Feasible Co-Growth of Structures and Dynamics for Power Grid Synthesis

Xinyu He, Chenhan Xiao, Haoran Li +5

Modern power systems are becoming increasingly dynamic, with changing topologies and time-varying loads driven by renewable energy variability, electric vehicle adoption, and activ…

cs.LG2025

Latte: Collaborative Test-Time Adaptation of Vision-Language Models in Federated Learning

Wenxuan Bao, Ruxi Deng, Ruizhong Qiu +3

Test-time adaptation with pre-trained vision-language models has gained increasing attention for addressing distribution shifts during testing. Among these approaches, memory-based…

cs.LG2025

Saffron-1: Safety Inference Scaling

Ruizhong Qiu, Gaotang Li, Tianxin Wei +2

Existing safety assurance research has primarily focused on training-phase alignment to instill safe behaviors into LLMs. However, recent studies have exposed these methods' suscep…

cs.LG2025

Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting

Zhining Liu, Ze Yang, Xiao Lin +6

Time-series forecasting plays a critical role in many real-world applications. Although increasingly powerful models have been developed and achieved superior results on benchmark…

cs.LG2025

Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors

Jun-Gi Jang, Jingrui He, Andrew Margenot +1

Many real-world data, such as recommendation data and temporal graphs, can be represented as incomplete sparse tensors where most entries are unobserved. For such sparse tensors, i…

cs.LG2025★ 8 cited

ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

Mengting Ai, Tianxin Wei, Yifan Chen +7

Mixture-of-Experts (MoE) Transformer, the backbone architecture of multiple phenomenal language models, leverages sparsity by activating only a fraction of model parameters for eac…