4 papers
RH+: Row-Hit-Optimized Scheduling for PIM-based LLM Inference
Yongchan Jung, Shafayat Mowla Anik, Byeong Kil Lee +1
Large language model inference on processing-in-memory (PIM) architectures promises to break the memory wall by performing multiply-accumulate (MAC) operations directly within HBM3…
Activation Concentration: Characterizing Column-Level Output Sparsity Across Diffusion Model Architectures
Dazhi Yang, Shafayat Mowla Anik, Byeong Kil Lee +1
Recent diffusion accelerators exploit activation sparsity by skipping near-zero GELU outputs, reporting 52--85% element-level sparsity. However, systolic-array hardware processes a…
Dead on Arrival: Characterizing and Protecting Against Dead-Entry TLB Misses in GPU Microarchitectures
Shafayat Mowla Anik, Yongchan Jung, Jeeho Ryoo +1
GPU workloads with large memory footprints frequently suffer from redundant L2 TLB misses in which a recently evicted translation is immediately re-walked at full page-walk cost. W…
RACAM: Enhancing DRAM with Reuse-Aware Computation and Automated Mapping for ML Inference
Siyuan Ma, Jiajun Hu, Jeeho Ryoo +2
In-DRAM Processing-In-Memory (DRAM-PIM) has emerged as a promising approach to accelerate memory-intensive workloads by mitigating data transfer overhead between DRAM and the host…