35 citations · 47 across the 11 of their papers we have counts for
3 papers · 1 filter
EdgeShard: Efficient LLM Inference via Collaborative Edge Computing
Mingjin Zhang, Jiannong Cao, Xiaoming Shen +1
Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to pro…
Resource-efficient Parallel Split Learning in Heterogeneous Edge Computing
Mingjin Zhang, Jiannong Cao, Yuvraj Sahni +2
Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of larg…
Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing
Xiangchun Chen, Jiannong Cao, Zhixuan Liang +2
Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fu…