3 citations · 5 across the 14 of their papers we have counts for
5 papers · 1 filter
Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding
Jiahao Zheng, Yifan Qin, Xiaobo Sharon Hu +1
The key-value (KV) cache is the dominant memory bottleneck in long-context large language model (LLM) decoding: every step reads it entirely, so decoding is memory-bandwidth bound.…
Probabilistic Memory for Trustworthy Edge Intelligence
Likai Pei, Jiahao Zheng, Xueji Zhao +9
Probabilistic computation plays an important role in trustworthy edge intelligence to quantify uncertainty, enhance robustness, reconstruct data, and protect privacy, but its adopt…
A 10.60 W 150 GOPS Mixed-Bit-Width Sparse CNN Accelerator for Life-Threatening Ventricular Arrhythmia Detection
Yifan Qin, Zhenge Jia, Zheyu Yan +9
This paper proposes an ultra-low power, mixed-bit-width sparse convolutional neural network (CNN) accelerator to accelerate ventricular arrhythmia (VA) detection. The chip achieves…
TSB: Tiny Shared Block for Efficient DNN Deployment on NVCIM Accelerators
Yifan Qin, Zheyu Yan, Zixuan Pan +3
Compute-in-memory (CIM) accelerators using non-volatile memory (NVM) devices offer promising solutions for energy-efficient and low-latency Deep Neural Network (DNN) inference exec…
U-SWIM: Universal Selective Write-Verify for Computing-in-Memory Neural Accelerators
Zheyu Yan, Xiaobo Sharon Hu, Yiyu Shi
Architectures that incorporate Computing-in-Memory (CiM) using emerging non-volatile memory (NVM) devices have become strong contenders for deep neural network (DNN) acceleration d…