Exploring the Efficiency of 3D-Stacked AI Chip Architecture for LLM Inference with VOXEL

Yiqi Liu, Noelle Crawford, Michael Wang +2

To overcome the well-known memory bottleneck of AI chips, 3D-stacked architectures that employ advanced packaging technology with high-density through-silicon vias (TSVs) pins have…