3 papers
cs.CV2025
Sequential Token Merging: Revisiting Hidden States
Yan Wen, Peng Ye, Lin Zhang +4
Vision Mambas (ViMs) achieve remarkable success with sub-quadratic complexity, but their efficiency remains constrained by quadratic token scaling with image resolution. While exis…
cs.LG2025
Pioneering 4-Bit FP Quantization for Diffusion Models: Mixup-Sign Quantization and Timestep-Aware Fine-Tuning
Maosen Zhao, Pengtao Chen, Chong Yu +3
Model quantization reduces the bit-width of weights and activations, improving memory efficiency and inference speed in diffusion models. However, achieving 4-bit quantization rema…
cs.CV2025
Multi-Level Decoupled Relational Distillation for Heterogeneous Architectures
Yaoxin Yang, Peng Ye, Weihao Lin +4
Heterogeneous distillation is an effective way to transfer knowledge from cross-architecture teacher models to student models. However, existing heterogeneous distillation methods…