20 citations · 32 across the 11 of their papers we have counts for
11 papers
SmartGen: Seamless Disaggregated LLM Inference with Selective KV Cache Transfer
Xuchuan Luo, Jiacheng Shen, Xin Wang +1
Disaggregating the prefill and decoding stages of large language model (LLM) inference into two separate sets of nodes is widely adopted in today's LLM serving systems. However, su…
EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices
Yongsheng Yan, Jiacheng Shen, Xuchuan Luo +1
Deploying large language models (LLMs) on mobile devices is an emerging trend to enable data privacy and offline accessibility of LLM applications. Modern mobile neural processing…
CIDER: Boosting Memory-Disaggregated Key-Value Stores with Pessimistic Synchronization
Yuxuan Du, Xuchuan Luo, Xin Wang +2
Memory-disaggregated key-value (KV) stores suffer from a severe performance bottleneck due to their I/O redundancy issues. A huge amount of redundant I/Os are generated when synchr…
ColorGo: Directed Concolic Execution
Jia Li, Jiacheng Shen, Yuxin Su +1
Directed fuzzing is a critical technique in cybersecurity, targeting specific sections of a program. This approach is essential in various security-related domains such as crash re…
MioHint: LLM-assisted Mutation for Whitebox API Testing
Jia Li, Jiacheng Shen, Yuxin Su +1
Cloud applications heavily rely on APIs to communicate with each other and exchange data. To ensure the reliability of cloud applications, cloud providers widely adopt API testing…
Ditto: An Elastic and Adaptive Memory-Disaggregated Caching System
Jiacheng Shen, Pengfei Zuo, Xuchuan Luo +5
In-memory caching systems are fundamental building blocks in cloud services. However, due to the coupled CPU and memory on monolithic servers, existing caching systems cannot elast…
FUSEE: A Fully Memory-Disaggregated Key-Value Store (Extended Version)
Jiacheng Shen, Pengfei Zuo, Xuchuan Luo +4
Distributed in-memory key-value (KV) stores are embracing the disaggregated memory (DM) architecture for higher resource utilization. However, existing KV stores on DM employ a sem…
MicroRes: Versatile Resilience Profiling in Microservices via Degradation Dissemination Indexing
Tianyi Yang, Cheryl Lee, Jiacheng Shen +3
Microservice resilience, the ability of microservices to recover from failures and continue providing reliable and responsive services, is crucial for cloud vendors. However, the c…
Managing Service Dependency for Cloud Reliability: The Industrial Practice
Tianyi Yang, Baitong Li, Jiacheng Shen +3
Interactions between cloud services result in service dependencies. Evaluating and managing the cascading impacts caused by service dependencies is critical to the reliability of c…
Characterizing and Mitigating Anti-patterns of Alerts in Industrial Cloud Systems
Tianyi Yang, Jiacheng Shen, Yuxin Su +3
Alerts are crucial for requesting prompt human intervention upon cloud anomalies. The quality of alerts significantly affects the cloud reliability and the cloud provider's busines…
AID: Efficient Prediction of Aggregated Intensity of Dependency in Large-scale Cloud Systems
Tianyi Yang, Jiacheng Shen, Yuxin Su +3
Service reliability is one of the key challenges that cloud providers have to deal with. In cloud systems, unplanned service failures may cause severe cascading impacts on their de…