Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIM

Tianhao Zhu, Dahu Feng, Erhu Feng +1

With the widespread adoption of Large Language Models (LLMs), the demand for high-performance LLM inference services continues to grow. Multi-core AI accelerators, such as Groq, Gr…