4 papers
Enhancing Post-Training Quantization via Future Activation Awareness
Zheqi Lv, Zhenxuan Fan, Qi Tian +2
Post-training quantization (PTQ) is a widely used method to compress large language models (LLMs) without fine-tuning. It typically sets quantization hyperparameters (e.g., scaling…
Tackling Device Data Distribution Real-time Shift via Prototype-based Parameter Editing
Zheqi Lv, Wenqiao Zhang, Kairui Fu +6
The on-device real-time data distribution shift on devices challenges the generalization of lightweight on-device models. This critical issue is often overlooked in current researc…
Multimodal LLM-Guided Semantic Correction in Text-to-Image Diffusion
Zheqi Lv, Junhao Chen, Qi Tian +3
Diffusion models have become the mainstream architecture for text-to-image generation, achieving remarkable progress in visual quality and prompt controllability. However, current…
Optimize Incompatible Parameters through Compatibility-aware Knowledge Integration
Zheqi Lv, Keming Ye, Zishu Wei +7
Deep neural networks have become foundational to advancements in multiple domains, including recommendation systems, natural language processing, and so on. Despite their successes…