1 citations · 1 across the 2 of their papers we have counts for
1 paper · 1 filter
Guoqiang Zou, Wanyu Wang, Hao Zheng +2
Existing memory management techniques severely hinder efficient Large Language Model serving on accelerators constrained by poor random-access bandwidth.While static pre-allocation…