3 papers
cs.AR2025
Towards Memory Specialization: A Case for Long-Term and Short-Term RAM
Peijing Li, Muhammad Shahir Abdurraman, Rachel Cleaveland +6
Both SRAM and DRAM have stopped scaling: there is no technical roadmap to reduce their cost (per byte/GB). As a result, memory now dominates system cost. This paper argues for a pa…
cs.AR2025
Good things come in small packages: Should we build AI clusters with Lite-GPUs?
Burcu Canakci, Junyi Liu, Xingbo Wu +5
To match the blooming demand of generative AI workloads, GPU designers have so far been trying to pack more and more compute and memory into single complex and expensive packages.…
cs.AR2025
Managed-Retention Memory: A New Class of Memory for the AI Era
Sergey Legtchenko, Ioan Stefanovici, Richard Black +6
AI clusters today are one of the major uses of High Bandwidth Memory (HBM). However, HBM is suboptimal for AI workloads for several reasons. Analysis shows HBM is overprovisioned o…