PIM-LLM: A High-Throughput Hybrid PIM Architecture for 1-bit LLMs

Jinendra Malekar, Peyton Chandarana, Md Hasibul Amin +2

In this paper, we propose PIM-LLM, a hybrid architecture developed to accelerate 1-bit large language models (LLMs). PIM-LLM leverages analog processing-in-memory (PIM) architectur…