attention mechanisms 1information flow 1kv cache recomputation 1long-context inference 1retrieval-augmented generation 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context
Xin Teng, Canyu Zhang, Shaoyi Zheng +3
The paper proposes InfoFlow KV, a method that uses an attention‑norm signal to identify which key‑value cache tokens should be recomputed during retrieval‑augmented generation, imp…
cs.IR2026
SAGE: Benchmarking and Improving Retrieval for Deep Research Agents
Tiansheng Hu, Yilun Zhao, Canyu Zhang +2
Deep research agents have emerged as powerful systems for addressing complex queries. Meanwhile, LLM-based retrievers have demonstrated strong capability in following instructions…
cs.CL2025
Submodular Context Partitioning and Compression for In-Context Learning
Shaoyi Zheng, Canyu Zhang, Tianyi Zhou +1
In-context learning (ICL) enables efficient few-shot learning in large language models (LLMs) without training, but suffers from the quadratic input complexity of transformers, lim…