2 citations · 3 across the 34 of their papers we have counts for
4 papers · 1 filter
KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints
Xi Shi, Qian Lou, Mengxin Zheng
Reusing key-value (KV) caches speeds up LLM inference by avoiding repeated computation on shared text. Standard prefix caching reuses a KV cache only when the LLM is the same and a…
AgentServeSim: Serving-System Simulation and Policy Search for LLM Agent Programs
Rakibul Hasan Rajib, Mengxin Zheng, Qian Lou
Large language model agents execute programs comprising multiple model turns interleaved with external tool calls. Their job completion time depends on how the serving system retai…
Factuality Beyond Coherence: Evaluating LLM Watermarking Methods for Medical Texts
Rochana Prih Hastuti, Rian Adam Rajagede, Mansour Al Ghanim +2
As large language models (LLMs) are adapted to sensitive domains such as medicine, their fluency raises safety risks, particularly regarding provenance and accountability. Watermar…
Evaluating the Robustness and Accuracy of Text Watermarking Under Real-World Cross-Lingual Manipulations
Mansour Al Ghanim, Jiaqi Xue, Rochana Prih Hastuti +3
We present a study to benchmark representative watermarking methods in cross-lingual settings. The current literature mainly focuses on the evaluation of watermarking methods for t…