collaborators

1 paper

cs.AR2025

Optimizing Attention on GPUs by Exploiting GPU Architectural NUMA Effects

Mansi Choudhary, Karthik Sangaiah, Sonali Singh +3

The rise of disaggregated AI GPUs has exposed a critical bottleneck in large-scale attention workloads: non-uniform memory access (NUMA). As multi-chiplet designs become the norm f…