RH+: Row-Hit-Optimized Scheduling for PIM-based LLM Inference

Yongchan Jung, Shafayat Mowla Anik, Byeong Kil Lee +1

Large language model inference on processing-in-memory (PIM) architectures promises to break the memory wall by performing multiply-accumulate (MAC) operations directly within HBM3…