3 papers
cs.DC2025
SLOs-Serve: Optimized Serving of Multi-SLO LLMs
Siyuan Chen, Zhipeng Jia, Samira Khan +2
This paper introduces SLOs-Serve, a system designed for serving multi-stage large language model (LLM) requests with application- and stage-specific service level objectives (SLOs)…
cs.CR2025
RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage
Peter Yong Zhong, Siyuan Chen, Ruiqi Wang +4
Tool-Based Agent Systems (TBAS) allow Language Models (LMs) to use external tools for tasks beyond their standalone capabilities, such as searching websites, booking flights, or ma…
cs.DC2025
Practical offloading for fine-tuning LLM on commodity GPU via learned sparse projectors
Siyuan Chen, Zhuofeng Wang, Zelong Guan +2
Fine-tuning large language models (LLMs) requires significant memory, often exceeding the capacity of a single GPU. A common solution to this memory challenge is offloading compute…