LUT-LLM: Efficient Large Language Model Inference with Memory-based Computations on FPGAs

Zifan He, Shengyu Ye, Rui Ma +2

The rapid development of large language models (LLM) has greatly enhanced everyday applications. While many FPGA-based accelerators, with flexibility for fine-grained data control,…