Sangam: Chiplet-Based DRAM-PIM Accelerator with CXL Integration for LLM Inferencing

Khyati Kiyawat, Zhenxing Fan, Yasas Seneviratne +5

Large Language Models (LLMs) are becoming increasingly data-intensive due to growing model sizes, and they are becoming memory-bound as the context length and, consequently, the ke…