2 citations · 4 across the 21 of their papers we have counts for
8 papers · 1 filter
BubbleSpec: Turning Long-Tail Bubbles into Speculative Rollout Drafts for Synchronous Reinforcement Learning
Yuhang Xu, Kaibin Tian, Yang Tian +6
Reinforcement Learning (RL) has become a cornerstone for improving the performance of Large Language Models (LLMs). However, its rollout phase constitutes a significant efficiency…
Optimizing Storage Overhead of User Behavior Log for ML-embedded Mobile Apps
Chen Gong, Yan Zhuang, Zhenzhe Zheng +4
Machine learning (ML) models are increasingly integrated into modern mobile apps to enable personalized and intelligent services. These models typically rely on rich input features…
TokenFlow: Responsive LLM Text Streaming Serving under Request Burst via Preemptive Scheduling
Junyi Chen, Chuheng Du, Renyuan Liu +6
Real-time LLM interactions demand streamed token generations, where text tokens are progressively generated and delivered to users while balancing two objectives: responsiveness (i…
ConfClip: Confidence-Weighted and Clipped Reward for Reinforcement Learning in LLMs
Bonan Zhang, Zhongqi Chen, Bowen Song +3
Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with…
Collaborative Learning of On-Device Small Model and Cloud-Based Large Model: Advances and Future Directions
Chaoyue Niu, Yucheng Ding, Junhui Lu +7
The conventional cloud-based large model learning framework is increasingly constrained by latency, cost, personalization, and privacy concerns. In this survey, we explore an emerg…
Efficient Distributed Retrieval-Augmented Generation for Enhancing Language Model Performance
Shangyu Liu, Zhenzhe Zheng, Xiaoyao Huang +3
Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented g…
Personalized Language Model Learning on Text Data Without User Identifiers
Yucheng Ding, Yangwenjian Tan, Xiangyu Liu +6
In many practical natural language applications, user data are highly sensitive, requiring anonymous uploads of text data from mobile devices to the cloud without user identifiers.…
Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learning
Chen Gong, Zhenzhe Zheng, Fan Wu +2
In modern mobile applications, users frequently encounter various new contexts, necessitating on-device continual learning (CL) to ensure consistent model performance. While existi…