Efficient LLM Inference on CPUs

Haihao Shen, Hanwen Chang, Bo Dong +2

Large language models (LLMs) have demonstrated remarkable performance and tremendous potential across a wide range of tasks. However, deploying these models has been challenging du…