76 citations · 79 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024★ 2 cited
Trainable Fixed-Point Quantization for Deep Learning Acceleration on FPGAs
Dingyi Dai, Yichi Zhang, Jiahao Zhang +4
Quantization is a crucial technique for deploying deep learning models on resource-constrained devices, such as embedded FPGAs. Prior efforts mostly focus on quantizing matrix mult…
cs.LG2023★ 76 cited
Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inference
Hongzheng Chen, Jiahao Zhang, Yixiao Du +5
Recent advancements in large language models (LLMs) boasting billions of parameters have generated a significant demand for efficient deployment in inference workloads. The majorit…