Hummingbird: A Smaller and Faster Large Language Model Accelerator on Embedded FPGA

Jindong Li, Tenglong Li, Ruiqi Chen +4

Deploying large language models (LLMs) on embedded devices remains a significant research challenge due to the high computational and memory demands of LLMs and the limited hardwar…