102 citations · 116 across the 13 of their papers we have counts for
Showing 2024 · cs.CLShow all
3 papers · 2 filters
cs.CL2024
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches
Jiayi Yuan, Hongyi Liu, Shaochen Zhong +9
Long context capability is a crucial competency for large language models (LLMs) as it mitigates the human struggle to digest long-form texts. This capability enables complex task-…
cs.CL2024★ 1 cited
Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
Yucheng Shi, Qiaoyu Tan, Xuansheng Wu +3
Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate r…
cs.CL2024★ 6 cited
KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Zirui Liu, Jiayi Yuan, Hongye Jin +5
Efficiently serving large language models (LLMs) requires batching of many requests to reduce the cost per request. Yet, with larger batch sizes and longer context lengths, the key…