The Feasibility of Implementing Large-Scale Transformers on Multi-FPGA Platforms

Yu Gao, Juan Camilo Vega, Paul Chow

FPGAs are rarely mentioned when discussing the implementation of large machine learning applications, such as Large Language Models (LLMs), in the data center. There has been much…