133 citations · 263 across the 40 of their papers we have counts for
6 papers · 1 filter
KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
Large Language Models (LLMs) rely heavily on Key-Value (KV) caching to minimize inference latency. However, standard KV caches are context-dependent: reusing a cached document in a…
Trustworthy Tree-based Machine Learning by Flash-based Analog CAM with Inherent Soft Boundaries
Bo Wen, Guoyun Gao, Zhicheng Xu +5
The rapid advancement of artificial intelligence has raised concerns regarding its trustworthiness, especially in terms of interpretability and robustness. Tree-based models like R…
FeBiM: Efficient and Compact Bayesian Inference Engine Empowered with Ferroelectric In-Memory Computing
Chao Li, Zhicheng Xu, Bo Wen +5
In scenarios with limited training data or where explainability is crucial, conventional neural network-based machine learning models often face challenges. In contrast, Bayesian i…
Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNN…
SteppingNet: A Stepping Neural Network with Incremental Accuracy Enhancement
Wenhao Sun, Grace Li Zhang, Xunzhao Yin +4
Deep neural networks (DNNs) have successfully been applied in many fields in the past decades. However, the increasing number of multiply-and-accumulate (MAC) operations in DNNs pr…
Worst-Case Dynamic Power Distribution Network Noise Prediction Using Convolutional Neural Network
Xiao Dong, Yufei Chen, Xunzhao Yin +1
Worst-case dynamic PDN noise analysis is an essential step in PDN sign-off to ensure the performance and reliability of chips. However, with the growing PDN size and increasing sce…