4 papers
OTARo: Once Tuning for All Precisions toward Robust On-Device LLMs
Shaoyuan Chen, Zhixuan Chen, Dawei Yang +2
Large Language Models (LLMs) fine-tuning techniques not only improve the adaptability to diverse downstream tasks, but also mitigate adverse effects of model quantization. Despite…
VAEVQ: Enhancing Discrete Visual Tokenization through Variational Modeling
Sicheng Yang, Xing Hu, Qiang Wu +1
Vector quantization (VQ) transforms continuous image features into discrete representations, providing compressed, tokenized inputs for generative models. However, VQ-based framewo…
RSAVQ: Riemannian Sensitivity-Aware Vector Quantization for Large Language Models
Zukang Xu, Xing Hu, Qiang Wu +1
Large language models (LLMs) have demonstrated remarkable performance across a wide range of natural language processing tasks. However, their exponentially increasing parameters p…
Information Entropy Guided Height-aware Histogram for Quantization-friendly Pillar Feature Encoder
Sifan Zhou, Zhihang Yuan, Dawei Yang +5
Real-time and high-performance 3D object detection plays a critical role in autonomous driving and robotics. Recent pillar-based 3D object detectors have gained significant attenti…