6 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.CL2024★ 1 cited
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Dongjie Yang, XiaoDong Han, Yan Gao +3
Large Language Models (LLMs) have shown remarkable comprehension abilities but face challenges in GPU memory usage during inference, hindering their scalability for real-time appli…
cs.CL2023★ 6 cited
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer
Zuchao Li, Shitou Zhang, Hai Zhao +2
BatGPT is a large-scale language model designed and trained jointly by Wuhan University and Shanghai Jiao Tong University. It is capable of generating highly natural and fluent tex…