2 papers
cs.CV2026
RPFQ-ViT: Rotated Phase-Frame Quantization for Extremely Low-Bit Weights in Vision Transformers
Mengyuan Fan, Bokai Huang, JiaMing Pan +4
Vision Transformers (ViTs) achieve strong performance on image recognition and mobile vision applications, but their high-dimensional linear projections and attention computations…
cs.AI2026
ConMoE: MoE Compression as Expert Selection and Functional Assignment
Yilun Yao, Jiaming Pan, Elsie Dai +4
Sparse Mixture-of-Experts (MoE) models scale model capacity through sparse activation, but storing their full parameters remains costly in GPU memory. Existing expert compression m…