From the 1 of 70 linked papers with an AI index.
1 citations · 1 across the 24 of their papers we have counts for
3 papers · 1 filter
Zipage: Maintain High Request Concurrency for LLM Reasoning through Compressed PagedAttention
Mengqi Liao, Lu Wang, Chaoyun Zhang +6
With reasoning becoming the generative paradigm for large language models (LLMs), the memory bottleneck caused by KV cache during the decoding phase has become a critical factor li…
UFO3: Weaving the Digital Agent Galaxy
Chaoyun Zhang, Liqun Li, He Huang +8
Large language model (LLM)-powered agents are transforming digital devices from passive tools into proactive intelligent collaborators. However, most existing frameworks remain con…
An Empirical Study of Production Incidents in Generative AI Cloud Services
Haoran Yan, Yinfang Chen, Minghua Ma +10
The ever-increasing demand for generative artificial intelligence (GenAI) has motivated cloud-based GenAI services such as Azure OpenAI Service and Amazon Bedrock. Like any large-s…