4 papers
How to Score Experts for One-Shot MoE Expert Pruning: A Unified Formulation and Selection Principle
Zongfang Liu, Jinghui Zhang, Zijian Ma +2
Mixture-of-Experts (MoE) language models reduce per-token computation through sparse expert activation, yet deployment still requires storing the full expert pool, making one-shot…
From Individuals to Crowds: Dual-Level Public Response Prediction in Social Media
Jinghui Zhang, Kaiyang Wan, Longwei Xu +3
Public response prediction is critical for understanding how individuals or groups might react to specific events, policies, or social phenomena, making it highly valuable for cris…
Modeling Variants of Prompts for Vision-Language Models
Ao Li, Zongfang Liu, Xinhua Li +3
Large pre-trained vision-language models (VLMs) offer a promising approach to leveraging human language for enhancing downstream tasks. However, VLMs such as CLIP face significant…
Decoding Echo Chambers: LLM-Powered Simulations Revealing Polarization in Social Networks
Chenxi Wang, Zongfang Liu, Dequan Yang +1
The impact of social media on critical issues such as echo chambers needs to be addressed, as these phenomena can have disruptive consequences for our society. Traditional research…