4 papers · 1 filter
SmartRAG: Native Graph-Based RAG for Mobile Device
Zhihan Jiang, Meng Li, Shenghao Liu +6
Deploying large language models (LLMs) as personal assistants on mobile devices demands privacy, low latency, and offline availability, yet the computational cost of giant models c…
Scaling LLM Agent Tool Access: The MCP Gateway
Mingxin Li, Enge Song, Yueshang Zuo +27
LLM agents increasingly rely on tool calling to complete tasks. Model Context Protocol (MCP) standardizes tool calling between LLM agents and tool providers. It reduces integration…
EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agents
Ruofei Ju, Xinrui Wang, Xin Ding +12
Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts,…
Efficient Remote KV Cache Reuse with GPU-native Video Codec
Liang Mi, Weijun Wang, Jinghan Chen +3
Remote KV cache reuse fetches KV cache for identical contexts from remote storage, avoiding recomputation, accelerating LLM inference. While it excels in high-speed networks, its p…