5 papers
PolyLink: A Blockchain Based Decentralized Edge AI Platform for LLM Inference
Hongbo Liu, Jiannong Cao, Bo Yang +7
The rapid advancement of large language models (LLMs) in recent years has revolutionized the AI landscape. However, the deployment model and usage of LLM services remain highly cen…
EdgeShard: Efficient LLM Inference via Collaborative Edge Computing
Mingjin Zhang, Jiannong Cao, Xiaoming Shen +1
Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to pro…
Resource-efficient Parallel Split Learning in Heterogeneous Edge Computing
Mingjin Zhang, Jiannong Cao, Yuvraj Sahni +2
Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of larg…
Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing
Xiangchun Chen, Jiannong Cao, Zhixuan Liang +2
Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fu…
Heterogeneity-aware Cross-school Electives Recommendation: a Hybrid Federated Approach
Chengyi Ju, Jiannong Cao, Yu Yang +2
In the era of modern education, addressing cross-school learner diversity is crucial, especially in personalized recommender systems for elective course selection. However, privacy…