CAMP: Context-Aware Mapping and Placement for LLMs on 3D-IMC Arrays

Orhun Görkem, Athanasios Vasilopoulos, Georgios Pagonis +6

Large Language Models (LLMs) incur severe memory-access overheads due to the cost of loading large weight matrices and key-value (KV) caches. Analog In-Memory Computing (AIMC) is a…