2 papers
cs.LG2025
MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignment
Yufei Li, Yu Fu, Yue Dong +1
Large language models (LLMs) deployed on edge servers are increasingly used in latency-sensitive applications such as personalized assistants, recommendation, and content moderatio…
cs.CL2025
Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting
Yufei Li, John Nham, Ganesh Jawahar +7
Generic text rewriting is a prevalent large language model (LLM) application that covers diverse real-world tasks, such as style transfer, fact correction, and email editing. These…