2 papers
cs.DC2026
CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation
Zhuoren Ye, Tianyu Wo, Dinghao Xue +4
Emerging LLM services increasingly host many sparse MoE models, yet most models receive sparse requests and remain cold. This creates a GPU memory problem: model weights are stable…
cs.AI2024
Leveraging Foundation Models for Zero-Shot IoT Sensing
Dinghao Xue, Xiaoran Fan, Tao Chen +2
Deep learning models are increasingly deployed on edge Internet of Things (IoT) devices. However, these models typically operate under supervised conditions and fail to recognize u…