5 citations · 6 across the 3 of their papers we have counts for
3 papers
cs.PF2024★ 1 cited
Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach
Yijia Zhang, Zhihong Gou, Shijie Cao +4
Deep Neural Networks (DNNs) have revolutionized various fields, but their deployment on GPUs often leads to significant energy consumption. Unlike existing methods for reducing GPU…
cs.CL2023
AFPQ: Asymmetric Floating Point Quantization for LLMs
Yijia Zhang, Sicheng Zhang, Shijie Cao +4
Large language models (LLMs) show great performance in various tasks, but face deployment challenges from limited memory capacity and bandwidth. Low-bit weight quantization can sav…
cs.LG2023★ 5 cited
Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
Yijia Zhang, Lingran Zhao, Shijie Cao +6
Efficient deployment of large language models (LLMs) necessitates low-bit quantization to minimize model size and inference cost. While low-bit integer formats (e.g., INT8/INT4) ha…