From the 1 of 5 linked papers with an AI index.
5 papers
SmartGen: Seamless Disaggregated LLM Inference with Selective KV Cache Transfer
Xuchuan Luo, Jiacheng Shen, Xin Wang +1
The paper introduces SmartGen, a system that reduces network overhead in disaggregated large language model inference by selectively transferring only essential key‑value cache ent…
EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices
Yongsheng Yan, Jiacheng Shen, Xuchuan Luo +1
Deploying large language models (LLMs) on mobile devices is an emerging trend to enable data privacy and offline accessibility of LLM applications. Modern mobile neural processing…
CIDER: Boosting Memory-Disaggregated Key-Value Stores with Pessimistic Synchronization
Yuxuan Du, Xuchuan Luo, Xin Wang +2
Memory-disaggregated key-value (KV) stores suffer from a severe performance bottleneck due to their I/O redundancy issues. A huge amount of redundant I/Os are generated when synchr…
MioHint: LLM-assisted Mutation for Whitebox API Testing
Jia Li, Jiacheng Shen, Yuxin Su +1
Cloud applications heavily rely on APIs to communicate with each other and exchange data. To ensure the reliability of cloud applications, cloud providers widely adopt API testing…
ColorGo: Directed Concolic Execution
Jia Li, Jiacheng Shen, Yuxin Su +1
Directed fuzzing is a critical technique in cybersecurity, targeting specific sections of a program. This approach is essential in various security-related domains such as crash re…