From the 1 of 8 linked papers with an AI index.
8 papers
MemTxn: A Transaction Boundary for Source-Supported Updates and Complete-State Recovery in Agent Memory
Hanshuai Cui, Zhiqing Tang, Zhi Yao +3
MemTxn is a governance layer for large language model agents that adds a transaction boundary to verify source-supported memory updates, resolve conflicting facts, and recover a co…
LASER: Load-Aware Serving with Early-Exit for Reasoning LLMs at the Edge
Zhiqing Tang, Size Li, Hanshuai Cui +5
Large reasoning models (LRMs) such as DeepSeek-R1 have achieved strong performance through extended chain-of-thought (CoT) generation. However, deploying them on edge devices raise…
ConCise: Training-Free Conclusion-Chain State Compression for Cost-Efficient Multi-Step RAG Services
Kuan Yan, Zhiqing Tang, Tian Wang +1
Multi-step retrieval-augmented generation (RAG) has been widely deployed as LLM-powered web services for complex question answering, where iterative retrieval-reasoning rounds deli…
CogGuard: Cognitive and Operational Profiling for Proactive Warning in Edge Intelligent Services
Zhi Yao, Weihao Chen, Zhiqing Tang +4
Proactive warning is an important capability for edge intelligent services, where the system predicts whether a subject will successfully complete an incoming task under strict lat…
CONCORD: Asynchronous Sparse Aggregation for Device-Cloud RAG under Document Isolation
Xuedong Hu, Zhiqing Tang, Zhi Yao +2
Retrieval-augmented generation (RAG) has emerged as a pivotal technique for improving language models by incorporating external knowledge at inference time. As device-cloud collabo…
Semantic Cache Distillation: Efficient State Transfer via Reuse and Selective Patching
Qianli Ma, Zhiqing Tang, Hanshuai Cui +2
Disaggregated serving alleviates memory bottlenecks in Large Language Model (LLM) inference but creates a severe communication bottleneck: transmitting high-dimensional Key-Value (…