5 papers · 2 filters
RadixFlow: Filling Execution Bubbles in Prefix-Cached Hybrid LLM Serving
Huihao Jing, Wenbin Hu, Shaojin Chen +6
Prefix reuse improves LLM inference by sharing the KV cache of common prompt prefixes. This helps only if the scheduler can execute a matched branch in the current worker round. Sc…
Same Operation, Different Permission: Evaluating Whether Guardrails Honor Authorization
Huihao Jing, Shaojin Chen, Wenbin Hu +5
As language-model agents write code, move money and change records on behalf of users, deciding whether an action is authorized has become a central safety problem. Guardrails are…
SkillScriptBench: Benchmarking Self-Evolution of Executable Agent Skill Packages Beyond Markdown
Yuxuan Liu, Haoran Li, Yuhao Zhang +10
Executable Agent Skills combine natural-language instructions and scripts into reusable packages for LLM agents, and revising them requires fixing errors without breaking correct b…
AuthorityLens: Rethinking LLM-Based Agent Systems Through the Lens of Authority
Shaojin Chen, Huihao Jing, Wun Yu Chan +7
LLM-based agents are increasingly deployed with authority over consequential resources and decisions in real systems. These agents often operate alongside human and LLM-based parti…
Isolation as a First-Class Principle for LLM-Agent System Safety: Concepts, Taxonomy, Challenges and Future Directions
Huihao Jing, Wenbin Hu, Shaojin Chen +10
The capability of LLM agents to function as the ``brain'' of a system fundamentally expands the scope of analysis beyond a standalone model. Consequently, safety is no longer only…