2 papers
cs.DC2025
Enhancing reliability in AI inference services: An empirical study on real production incidents
Bhala Ranganathan, Mickey Zhang, Kai Wu
Hyperscale large language model (LLM) inference places extraordinary demands on cloud systems, where even brief failures can translate into significant user and business impact. To…
cs.LG2023
Managed Geo-Distributed Feature Store: Architecture and System Design
Anya Li, Bhala Ranganathan, Feng Pan +6
Companies are using machine learning to solve real-world problems and are developing hundreds to thousands of features in the process. They are building feature engineering pipelin…