6 citations · 19 across the 34 of their papers we have counts for
8 papers · 1 filter
Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression
Yifu Ding, Jiacheng Wang, Ge Yang +4
Mixture-of-Experts (MoE) models scale compute efficiently, yet remain expensive to deploy due to their substantial memory footprint and inference overhead. Prior compression method…
An Empirical Study of openPangu Quantization on Ascend NPUs
Tong Shi, Jiacheng Wang, Hui Xie +4
openPangu models are attractive targets for private and domestic large-language-model deployment, yet their robustness under aggressive post-training quantization on Ascend NPUs ha…
SLMQuant:Benchmarking Small Language Model Quantization for Practical Deployment
Jiacheng Wang, Yejun Zeng, Jinyang Guo +3
Despite the growing interest in Small Language Models (SLMs) as resource-efficient alternatives to Large Language Models (LLMs), their deployment on edge devices remains challengin…
First-Order Error Matters: Accurate Compensation for Quantized Large Language Models
Xingyu Zheng, Haotong Qin, Yuye Li +5
Post-training quantization (PTQ) offers an efficient approach to compressing large language models (LLMs), significantly reducing memory access and computational costs. Existing co…
An Empirical Study of Qwen3 Quantization
Xingyu Zheng, Yuye Li, Haoran Chu +7
The Qwen series has emerged as a leading family of open-source Large Language Models (LLMs), demonstrating remarkable capabilities in natural language understanding tasks. With the…
PTSBench: A Comprehensive Post-Training Sparsity Benchmark Towards Algorithms and Models
Zining Wnag, Jinyang Guo, Ruihao Gong +5
With the increased attention to model efficiency, post-training sparsity (PTS) has become more and more prevalent because of its effectiveness and efficiency. However, there remain…
DB-LLM: Accurate Dual-Binarization for Efficient LLMs
Hong Chen, Chengtao Lv, Liang Ding +8
Large language models (LLMs) have significantly advanced the field of natural language processing, while the expensive memory and computation consumption impede their practical dep…
RobustMQ: Benchmarking Robustness of Quantized Models
Yisong Xiao, Aishan Liu, Tianyuan Zhang +3
Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities wh…