Showing cs.AIShow all
3 papers · 1 filter
cs.AI2026
HeraSys: Collaborative Serving of Multiple LLM Workflows via Fine-Grained End-to-End Optimization
Size Li, Zhiqing Tang, Hongrui Liang +4
The proliferation of Large Language Models (LLMs) has shifted serving systems from processing isolated requests to orchestrating high-concurrency, multi-tenant agentic workflows. H…
cs.AI2025
Adaptive AI Agent Placement and Migration in Edge Intelligence Systems
Xingdan Wang, Jiayi He, Zhiqing Tang +5
The rise of LLMs such as ChatGPT and Claude fuels the need for AI agents capable of real-time task handling. However, migrating data-intensive, multi-modal edge workloads to cloud…
cs.AI2024
VELO: A Vector Database-Assisted Cloud-Edge Collaborative LLM QoS Optimization Framework
Zhi Yao, Zhiqing Tang, Jiong Lou +2
The Large Language Model (LLM) has gained significant popularity and is extensively utilized across various domains. Most LLM deployments occur within cloud data centers, where the…