SpeedLLM: An FPGA Co-design of Large Language Model Inference Accelerator

Peipei Wang, Wu Guan, Liping Liang +3

This paper introduces SpeedLLM, a neural network accelerator designed on the Xilinx Alevo U280 platform and optimized for the Tinyllama framework to enhance edge computing performa…