4 papers · 1 filter
HeRo: Adaptive Orchestration of Agentic RAG on Heterogeneous Mobile SoC
Maoliang Li, Jiayu Chen, Zihao Zheng +5
With the increasing computational capability of mobile devices, deploying agentic retrieval-augmented generation (RAG) locally on heterogeneous System-on-Chips (SoCs) has become a…
RoboECC: Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models
Zihao Zheng, Hangyu Cao, Jiayu Chen +6
Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easi…
RAPID: Redundancy-Aware and Compatibility-Optimal Edge-Cloud Partitioned Inference for Diverse VLA Models
Zihao Zheng, Sicheng Tian, Hangyu Cao +7
Vision Language Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) inference offers an effective fix by easin…
Agent.xpu: Efficient Scheduling of Agentic LLM Workloads on Heterogeneous SoC
Xinming Wei, Jiahao Zhang, Haoran Li +6
Personal LLM agents increasingly combine foreground reactive interactions with background proactive monitoring, forming long-lived, stateful LLM flows that interleave prefill and t…