4 papers
Why Does the LLM Stop Computing: An Empirical Study of User-Reported Failures in Open-Source LLMs
Guangba Yu, Zirui Wang, Yujie Huang +4
The democratization of open-source Large Language Models (LLMs) allows users to fine-tune and deploy models on local infrastructure but exposes them to a First Mile deployment land…
InferLog: Accelerating LLM Inference for Online Log Parsing via ICL-oriented Prefix Caching
Yilun Wang, Pengfei Chen, Haiyu Huang +5
Modern software systems generate massive volumes of runtime logs, necessitating efficient and accurate log parsing to enable critical downstream tasks such as anomaly detection and…
FaaSRCA: Full Lifecycle Root Cause Analysis for Serverless Applications
Jin Huang, Pengfei Chen, Guangba Yu +3
Serverless becomes popular as a novel computing paradigms for cloud native services. However, the complexity and dynamic nature of serverless applications present significant chall…
Mint: Cost-Efficient Tracing with All Requests Collection via Commonality and Variability Analysis
Haiyu Huang, Cheng Chen, Kunyi Chen +6
Distributed traces contain valuable information but are often massive in volume, posing a core challenge in tracing framework design: balancing the tradeoff between preserving esse…