17 citations · 22 across the 8 of their papers we have counts for
4 papers · 1 filter
Potential Applications of HBF in LLM Serving Systems
Yihan Yin, Yinlun Zhao, Zhixin Yun +8
LLM serving is increasingly constrained by memory capacity as model weights, KV caches, and the number of served model variants continue to grow. This report examines High-Bandwidt…
NPS: A Framework for Accurate Program Sampling Using Graph Neural Network
Yuanwei Fang, Zihao Liu, Yanheng Lu +7
With the end of Moore's Law, there is a growing demand for rapid architectural innovations in modern processors, such as RISC-V custom extensions, to continue performance scaling.…
MPU: Towards Bandwidth-abundant SIMT Processor via Near-bank Computing
Xinfeng Xie, Peng Gu, Yufei Ding +3
With the growing number of data-intensive workloads, GPU, which is the state-of-the-art single-instruction-multiple-thread (SIMT) processor, is hindered by the memory bandwidth wal…
LazyPIM: Efficient Support for Cache Coherence in Processing-in-Memory Architectures
Amirali Boroumand, Saugata Ghose, Minesh Patel +7
Processing-in-memory (PIM) architectures have seen an increase in popularity recently, as the high internal bandwidth available within 3D-stacked memory provides greater incentive…