Selective KV Cache Protection for Noise-Resilient LLM Inference on Analog Compute-In-Memory Systems

Yuannuo Feng, Wenyong Zhou, Yuang Ma +5

Analog compute-in-memory (CIM) arrays have emerged as a promising substrate for energy-efficient LLM inference, particularly for weight-stationary computations in linear layers. Ho…