4 papers
DeepFusion: Accelerating MoE Training via Federated Knowledge Distillation from Heterogeneous Edge Devices
Songyuan Li, Jia Hu, Ahmed M. Abdelmoniem +3
Recent Mixture-of-Experts (MoE)-based large language models (LLMs) such as Qwen-MoE and DeepSeek-MoE are transforming generative AI in natural language processing. However, these m…
Incentivizing Multi-Tenant Split Federated Learning for Foundation Models at the Network Edge
Songyuan Li, Jia Hu, Geyong Min +1
Foundation models (FMs) such as GPT-4 exhibit exceptional generative capabilities across diverse downstream tasks through fine-tuning. Split Federated Learning (SFL) facilitates pr…
Dynamic Pricing for On-Demand DNN Inference in the Edge-AI Market
Songyuan Li, Jia Hu, Geyong Min +2
The convergence of edge computing and Artificial Intelligence (AI) gives rise to Edge-AI, which enables the deployment of real-time AI applications at the network edge. A key resea…
SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence
Ziyang Gong, Wenhao Li, Oliver Ma +7
Multimodal Large Language Models (MLLMs) have achieved remarkable progress in various multimodal tasks. To pursue higher intelligence in space, MLLMs require integrating multiple s…