most citedRT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models

1 citations · 2 across the 3 of their papers we have counts for

collaborators
Showing cs.LGShow all

3 papers · 1 filter

cs.LG2025

MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignment

Yufei Li, Yu Fu, Yue Dong +1

Large language models (LLMs) deployed on edge servers are increasingly used in latency-sensitive applications such as personalized assistants, recommendation, and content moderatio…

cs.LG2023★ 1 cited

RT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models

Yufei Li, Zexin Li, Wei Yang +1

Recent advancements in language models (LMs) have gained substantial attentions on their capability to generate human-like responses. Though exhibiting a promising future for vario…

cs.LG2023★ 1 cited

GLAD: Content-aware Dynamic Graphs For Log Anomaly Detection

Yufei Li, Yanchi Liu, Haoyu Wang +6

Logs play a crucial role in system monitoring and debugging by recording valuable system information, including events and states. Although various methods have been proposed to de…