3 papers
cs.LG2026
LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing
Dongfang Li, Zixuan Liu, Gang Lin +2
The quadratic complexity of the attention mechanism and the substantial memory footprint of the Key-Value (KV) cache present severe computational and memory challenges for Large La…
cs.CL2024
Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top
Keyuan Cheng, Muhammad Asif Ali, Shu Yang +7
Multi-hop Question Answering (MQA) under knowledge editing (KE) is a key challenge in Large Language Models (LLMs). While best-performing solutions in this domain use a plan and so…
cs.CL2024
Multi-hop Question Answering under Temporal Knowledge Editing
Keyuan Cheng, Gang Lin, Haoyang Fei +5
Multi-hop question answering (MQA) under knowledge editing (KE) has garnered significant attention in the era of large language models. However, existing models for MQA under KE ex…