Efficient LLM inference solution on Intel GPU

Hui Wu, Yi Gan, Feng Yuan +8

Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are u…