5 citations · 6 across the 9 of their papers we have counts for
4 papers · 1 filter
DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined Rotation
Jingyang Xiang, Sai Qian Zhang
Rotating the activation and weight matrices to reduce the influence of outliers in large language models (LLMs) has recently attracted significant attention, particularly in the co…
QQQ: Quality Quattuor-Bit Quantization for Large Language Models
Ying Zhang, Peng Zhang, Mincong Huang +7
Quantization is a proven effective method for compressing large language models. Although popular techniques like W8A8 and W4A16 effectively maintain model performance, they often…
OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks
Jingyang Xiang, Zuohui Chen, Siqi Li +2
Binary Neural Networks~(BNNs) have been proven to be highly effective for deploying deep neural networks on mobile and embedded platforms. Most existing works focus on minimizing q…
AutoDFP: Automatic Data-Free Pruning via Channel Similarity Reconstruction
Siqi Li, Jun Chen, Jingyang Xiang +2
Structured pruning methods are developed to bridge the gap between the massive scale of neural networks and the limited hardware resources. Most current structured pruning methods…