4 papers
EMA: Efficient Model Adaptation for Learning-based Systems
Daiyang Yu, Xinyu Chen, Yihan Zhang +3
Machine learning (ML) is increasingly applied to optimize system performance in tasks such as resource management and network simulation. Unlike traditional ML tasks (e.g., image c…
Venn: Resource Management for Collaborative Learning Jobs
Jiachen Liu, Fan Lai, Ding Ding +2
In recent years, collaborative learning (CL) has emerged as a promising approach for machine learning (ML) and data science across distributed edge devices. As the deployment of CL…
Andes: Defining and Enhancing Quality-of-Experience in LLM-Based Text Streaming Services
Jiachen Liu, Jae-Won Chung, Zhiyu Wu +3
Large language models (LLMs) are now at the core of conversational AI services such as real-time translation and chatbots, which provide live user interaction by incrementally stre…
Mercury: QoS-Aware Tiered Memory System
Jiaheng Lu, Yiwen Zhang, Hasan Al Maruf +4
Memory tiering has received wide adoption in recent years as an effective solution to address the increasing memory demands of memory-intensive workloads. However, existing tiered…