21 citations · 105 across the 25 of their papers we have counts for
25 papers
SmartGen: Seamless Disaggregated LLM Inference with Selective KV Cache Transfer
Xuchuan Luo, Jiacheng Shen, Xin Wang +1
Disaggregating the prefill and decoding stages of large language model (LLM) inference into two separate sets of nodes is widely adopted in today's LLM serving systems. However, su…
Bringing Managed Language Support to WebAssembly with External Library Linking
Shuyao Jiang, Ruiying Zeng, Yangfan Zhou +1
WebAssembly (Wasm) has emerged as a powerful bytecode format for running applications with near-native performance in portable and secure environments. However, while Wasm currentl…
Debugging Performance Issues in WebAssembly Runtimes via Mutation-based Inference
Ruiying Zeng, Shuyao Jiang, Wenxuan Zhao +1
Performance debugging in WebAssembly (Wasm) runtimes is essential for ensuring the robustness of Wasm, especially since performance issues have frequently occurred in Wasm runtimes…
EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices
Yongsheng Yan, Jiacheng Shen, Xuchuan Luo +1
Deploying large language models (LLMs) on mobile devices is an emerging trend to enable data privacy and offline accessibility of LLM applications. Modern mobile neural processing…
Can User Feedback Help Issue Detection? An Empirical Study on a One-billion-user Online Service System
Shuyao Jiang, Jiazhen Gu, Wujie Zheng +2
Background: It has long been suggested that user feedback, typically written in natural language by end-users, can help issue detection. However, for large-scale online service sys…
Distinguishability-guided Test Program Generation for WebAssembly Runtime Performance Testing
Shuyao Jiang, Ruiying Zeng, Yangfan Zhou +1
WebAssembly (Wasm) is a binary instruction format designed as a portable compilation target, which has been widely used on both the web and server sides in recent years. As high pe…
Fearless Unsafe. A More User-friendly Document for Unsafe Rust Programming Base on Refined Safety Properties
Mohan Cui, Penglei Mao, Shuran Sun +2
Rust, a popular systems-level programming language, has garnered widespread attention due to its features of achieving run-time efficiency and memory safety. With an increasing num…
Revealing Performance Issues in Server-side WebAssembly Runtimes via Differential Testing
Shuyao Jiang, Ruiying Zeng, Zihao Rao +3
WebAssembly (Wasm) is a bytecode format originally serving as a compilation target for Web applications. It has recently been used increasingly on the server side, e.g., providing…
Ditto: An Elastic and Adaptive Memory-Disaggregated Caching System
Jiacheng Shen, Pengfei Zuo, Xuchuan Luo +5
In-memory caching systems are fundamental building blocks in cloud services. However, due to the coupled CPU and memory on monolithic servers, existing caching systems cannot elast…
rCanary: Detecting Memory Leaks Across Semi-automated Memory Management Boundary in Rust
Mohan Cui, Hui Xu, Hongliang Tian +1
Rust is an effective system programming language that guarantees memory safety via compile-time verifications. It employs a novel ownership-based resource management model to facil…
FUSEE: A Fully Memory-Disaggregated Key-Value Store (Extended Version)
Jiacheng Shen, Pengfei Zuo, Xuchuan Luo +4
Distributed in-memory key-value (KV) stores are embracing the disaggregated memory (DM) architecture for higher resource utilization. However, existing KV stores on DM employ a sem…
Muffin: Testing Deep Learning Libraries via Neural Architecture Fuzzing
Jiazhen Gu, Xuchuan Luo, Yangfan Zhou +1
Deep learning (DL) techniques are proven effective in many challenging tasks, and become widely-adopted in practice. However, previous work has shown that DL libraries, the basis o…
SafeDrop: Detecting Memory Deallocation Bugs of Rust Programs via Static Data-Flow Analysis
Mohan Cui, Chengjun Chen, Hui Xu +1
Rust is an emerging programming language that aims to prevent memory-safety bugs. However, the current design of Rust also brings side effects which may increase the risk of memory…
RULF: Rust Library Fuzzing via API Dependency Graph Traversal
Jianfeng Jiang, Hui Xu, Yangfan Zhou
Robustness is a key concern for Rust library development because Rust promises no risks of undefined behaviors if developers use safe APIs only. Fuzzing is a practical approach for…
Fast Outage Analysis of Large-scale Production Clouds with Service Correlation Mining
Yaohui Wang, Guozheng Li, Zijian Wang +13
Cloud-based services are surging into popularity in recent years. However, outages, i.e., severe incidents that always impact multiple services, can dramatically affect user experi…
Memory-Safety Challenge Considered Solved? An In-Depth Study with All Rust CVEs
Hui Xu, Zhuangbin Chen, Mingshen Sun +2
Rust is an emerging programing language that aims at preventing memory-safety bugs without sacrificing much efficiency. The claimed property is very attractive to developers, and m…
Detecting Deep Neural Network Defects with Data Flow Analysis
Jiazhen Gu, Huanlin Xu, Yangfan Zhou +3
Deep neural networks (DNNs) are shown to be promising solutions in many challenging artificial intelligence tasks. However, it is very hard to figure out whether the low precision…
Data Sanity Check for Deep Learning Systems via Learnt Assertions
Haochuan Lu, Huanlin Xu, Nana Liu +2
Reliability is a critical consideration to DL-based systems. But the statistical nature of DL makes it quite vulnerable to invalid inputs, i.e., those cases that are not considered…
DeepObfuscation: Securing the Structure of Convolutional Neural Networks via Knowledge Distillation
Hui Xu, Yuxin Su, Zirui Zhao +3
This paper investigates the piracy problem of deep learning models. Designing and training a well-performing model is generally expensive. However, when releasing them, attackers m…
On Benchmarking the Capability of Symbolic Execution Tools with Logic Bombs
Hui Xu, Zirui Zhao, Yangfan Zhou +1
Symbolic execution now becomes an indispensable technique for software testing and program analysis. There are several symbolic execution tools available off-the-shelf, and we need…
On Secure and Usable Program Obfuscation: A Survey
Hui Xu, Yangfan Zhou, Yu Kang +1
Program obfuscation is a widely employed approach for software intellectual property protection. However, general obfuscation methods (e.g., lexical obfuscation, control obfuscatio…
DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns
Jiazhen Gu, Huan Liu, Yangfan Zhou +1
Deep learning applications are computation-intensive and often employ GPU as the underlying computing devices. Deep learning frameworks provide powerful programming interfaces, but…
IntelliAd Understanding In-APP Ad Costs From Users Perspective
Cuiyun Gao, Hui Xu, Yichuan Man +2
Ads are an important revenue source for mobile app development, especially for free apps, whose expense can be compensated by ad revenue. The ad benefits also carry with costs. For…
PersisDroid: Android Performance Diagnosis via Anatomizing Asynchronous Executions
Yu Kang, Yangfan Zhou, Hui Xu +1
Android applications (apps) grow dramatically in recent years. Apps are user interface (UI) centric typically. Rapid UI responsiveness is key consideration to app developers. Howev…