activity
20242026
most citedMoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router

1 citations · 1 across the 16 of their papers we have counts for

collaborators
Showing 2025Show all

6 papers · 1 filter

cs.CL2025

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

Jun Liu, Zhenglun Kong, Changdi Yang +12

Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks. However, scaling such systems can substantial…

cs.CV2025

VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Voting

Juyi Lin, Amir Taherin, Arash Akbari +11

Recent large-scale Vision Language Action (VLA) models have shown superior performance in robotic manipulation tasks guided by natural language. However, current VLA models suffer…

cs.CV2025

Taming Diffusion for Dataset Distillation with High Representativeness

Lin Zhao, Yushu Wu, Xinru Jiang +5

Recent deep learning models demand larger datasets, driving the need for dataset distillation to create compact, cost-efficient datasets while maintaining performance. Due to the p…

cs.LG2025

Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality

Zhenglun Kong, Yize Li, Fanhu Zeng +7

In Transformer architectures, tokens\textemdash discrete units derived from raw data\textemdash are formed by segmenting inputs into fixed-length chunks. Each token is then mapped…

cs.LG2025

Structured Agent Distillation for Large Language Model

Jun Liu, Zhenglun Kong, Peiyan Dong +10

Large language models (LLMs) exhibit strong capabilities as decision-making agents by interleaving reasoning and actions, as seen in ReAct-style frameworks. Yet, their practical de…

cs.LG2025

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

Jun Liu, Zhenglun Kong, Peiyan Dong +10

Fine-tuning helps large language models (LLM) recover degraded information and enhance task performance. Although Low-Rank Adaptation (LoRA) is widely used and effective for fine-t…