6 citations · 8 across the 10 of their papers we have counts for
4 papers · 1 filter
Enhancing Post-Training Quantization via Future Activation Awareness
Zheqi Lv, Zhenxuan Fan, Qi Tian +2
Post-training quantization (PTQ) is a widely used method to compress large language models (LLMs) without fine-tuning. It typically sets quantization hyperparameters (e.g., scaling…
Tackling Device Data Distribution Real-time Shift via Prototype-based Parameter Editing
Zheqi Lv, Wenqiao Zhang, Kairui Fu +6
The on-device real-time data distribution shift on devices challenges the generalization of lightweight on-device models. This critical issue is often overlooked in current researc…
Optimize Incompatible Parameters through Compatibility-aware Knowledge Integration
Zheqi Lv, Keming Ye, Zishu Wei +7
Deep neural networks have become foundational to advancements in multiple domains, including recommendation systems, natural language processing, and so on. Despite their successes…
Leveraging Invariant Principle for Heterophilic Graph Structure Distribution Shifts
Jinluan Yang, Zhengyu Chen, Teng Xiao +3
Heterophilic Graph Neural Networks (HGNNs) have shown promising results for semi-supervised learning tasks on graphs. Notably, most real-world heterophilic graphs are composed of a…