Learning Semantics, Not Addresses: Runtime Neural Prefetching for Far Memory

Yutong Huang, Zhiyuan Guo, Yiying Zhang

Memory prefetching has long boosted CPU caches and is increasingly vital for far-memory systems, where large portions of memory are offloaded to cheaper, remote tiers. While effect…