35 citations · 47 across the 11 of their papers we have counts for
3 papers · 1 filter
Efficient KV Cache Migration for Geo-Distributed LLM Inference in Collaborative Edge Computing
Mingjin Zhang, Jiannong Cao, Tao Wu +2
Large Language Models (LLMs) have shown exceptional capabilities but rely heavily on centralized cloud GPU clusters, leading to high bandwidth costs, latency, and privacy issues. E…
EdgeShard: Efficient LLM Inference via Collaborative Edge Computing
Mingjin Zhang, Jiannong Cao, Xiaoming Shen +1
Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to pro…
Resource-efficient Parallel Split Learning in Heterogeneous Edge Computing
Mingjin Zhang, Jiannong Cao, Yuvraj Sahni +2
Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of larg…