14 citations · 23 across the 5 of their papers we have counts for
8 papers
Resuming Vision-Language Inference across Onboard Interruptions
Xiaolong Huang, Yinyuan Zhang, Daliang Xu +6
Executing vision-language models (VLMs) aboard low-Earth orbit satellites enables flexible processing of observation data without first downlinking it to the ground. On commercial…
OmniTide: Co-Designing Algorithms and Systems for Efficient On-Device Omni-LLM Streaming
Zongshang Shen, Wangsong Yin, Daliang Xu +2
On-device streaming omni-modal inference safeguards user privacy and eliminates prohibitive per-token API costs, but faces a critical bottleneck: the continuous influx of multimoda…
AI Infrastructure in Space: How Far Can We Go?
Qing Li, Qiyang Zhang, Daliang Xu +10
Satellites are becoming programmable computing platforms capable of running increasingly demanding AI workloads. This shift raises a systems problem: how can AI services remain dep…
MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
Chao Jin, Ziheng Jiang, Zhihao Bai +16
We present MegaScale-MoE, a production system tailored for the efficient training of large-scale mixture-of-experts (MoE) models. MoE emerges as a promising architecture to scale l…
MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
Ruidong Zhu, Ziheng Jiang, Chao Jin +17
Mixture-of-Experts (MoE) showcases tremendous potential to scale large language models (LLMs) with enhanced performance and reduced computational complexity. However, its sparsely…
RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
Chao Jin, Zili Zhang, Xuanlin Jiang +4
Retrieval-Augmented Generation (RAG) has shown significant improvements in various natural language processing tasks by integrating the strengths of large language models (LLMs) an…
Demystifying Removed Apps in iOS App Store
Fuqi Lin
With the popularity of mobile devices, mobile applications have become an essential part of people's lives. To provide secure mobile application download channels for users, variou…
Understanding Diffusion of Recurrent Innovations
Fuqi Lin
The diffusion of innovations theory has been studied for years. Previous research efforts mainly focus on key elements, adopter categories, and the process of innovation diffusion.…