4 papers
ObjectCache: Layerwise Object-Storage Retrieval for KV Cache Reuse
Yu Zhu, Aditya Dhakal, Yunming Xiao +2
Prefix KV caching has become a key mechanism in LLM serving: it reduces time to first token (TTFT) by avoiding redundant computation across requests that share a prefix (i.e., the…
SQUiD: Synthesizing Relational Databases from Unstructured Text
Mushtari Sadia, Zhenning Yang, Yunming Xiao +2
Relational databases are central to modern data management, yet most data exists in unstructured forms like text documents. To bridge this gap, we leverage large language models (L…
An RDMA-First Object Storage System with SmartNIC Offload
Yu Zhu, Aditya Dhakal, Pedro Bruel +4
AI training and inference impose sustained, fine-grain I/O that stresses host-mediated, TCP-based storage paths. Motivated by kernel-bypass networking and user-space storage stacks…
Cloud Infrastructure Management in the Age of AI Agents
Zhenning Yang, Archit Bhatnagar, Yiming Qiu +6
Cloud infrastructure is the cornerstone of the modern IT industry. However, managing this infrastructure effectively requires considerable manual effort from the DevOps engineering…