47 citations · 65 across the 13 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers
Pingcheng Dong, Yonghao Tan, Dong Zhang +11
Non-linear functions are prevalent in Transformers and their lightweight variants, incurring substantial and frequently underestimated hardware costs. Previous state-of-the-art wor…
cs.CV2024★ 2 cited
Towards Customized Knowledge Distillation for Chip-Level Dense Image Predictions
Dong Zhang, Pingcheng Dong, Long Chen +1
It has been revealed that efficient dense image prediction (EDIP) models designed for AI chips, trained using the knowledge distillation (KD) framework, encounter two key challenge…