4 citations · 5 across the 4 of their papers we have counts for
4 papers
KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
Large Language Models (LLMs) rely heavily on Key-Value (KV) caching to minimize inference latency. However, standard KV caches are context-dependent: reusing a cached document in a…
LiveMind: Low-latency Large Language Models with Simultaneous Inference
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
In this paper, we introduce LiveMind, a novel low-latency inference framework for large language model (LLM) inference which enables LLMs to perform inferences with incomplete user…
Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNN…
A Survey on Approximate Multiplier Designs for Energy Efficiency: From Algorithms to Circuits
Ying Wu, Chuangtao Chen, Weihua Xiao +6
Given the stringent requirements of energy efficiency for Internet-of-Things edge devices, approximate multipliers, as a basic component of many processors and accelerators, have b…