5 papers
KVDiagnosis: A Diagnostic Benchmark for KV-Cache Compression in Long-Context Language Models
Chen Qiu, Ziwu Liu, Chao Fei +2
KV-cache compression reduces long-context memory, but aggregate task scores reveal neither which correct executions fail nor why. We present KVDiagnosis, a diagnostic dataset and b…
EMAS: Stabilizing Multi-Agent System Evolution through Evidence-Guided Revision
Chao Fei, Qingyi Si, Kaihua Liang +3
Many methods for automated multi-agent system design optimize prompts and topologies during an initial design stage and then deploy the resulting system unchanged on subsequent sam…
PolyKV: Heterogeneous Retention and Allocation for KV Cache Compression
Chao Fei, Panos Kalnis
KV cache compression is essential for reducing the memory cost of long-context large language model inference. Existing approaches, however, typically apply a single compression po…
When Agents Evolve, Institutions Follow
Chao Fei, Hongcheng Guo, Yanghua Xiao
Across millennia, complex societies have faced the same coordination problem of how to organize collective action among cognitively bounded and informationally incomplete individua…
CHESS: Context-aware Hierarchical Efficient Semantic Selection for Long-Context LLM Inference
Chao Fei, Guozhong Li, Chenxi Liu +1
Long-context LLMs demand accurate inference at low latency, yet decoding becomes primarily constrained by KV cache as context grows. Prior pruning methods are largely context-agnos…