4 citations · 9 across the 10 of their papers we have counts for
4 papers · 1 filter
Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding
Jiahao Zheng, Yifan Qin, Xiaobo Sharon Hu +1
The key-value (KV) cache is the dominant memory bottleneck in long-context large language model (LLM) decoding: every step reads it entirely, so decoding is memory-bandwidth bound.…
TSB: Tiny Shared Block for Efficient DNN Deployment on NVCIM Accelerators
Yifan Qin, Zheyu Yan, Zixuan Pan +3
Compute-in-memory (CIM) accelerators using non-volatile memory (NVM) devices offer promising solutions for energy-efficient and low-latency Deep Neural Network (DNN) inference exec…
U-SWIM: Universal Selective Write-Verify for Computing-in-Memory Neural Accelerators
Zheyu Yan, Xiaobo Sharon Hu, Yiyu Shi
Architectures that incorporate Computing-in-Memory (CiM) using emerging non-volatile memory (NVM) devices have become strong contenders for deep neural network (DNN) acceleration d…
ApproxTrain: Fast Simulation of Approximate Multipliers for DNN Training and Inference
Jing Gong, Hassaan Saadat, Hasindu Gamaarachchi +3
Edge training of Deep Neural Networks (DNNs) is a desirable goal for continuous learning; however, it is hindered by the enormous computational power required by training. Hardware…