1 citations · 1 across the 3 of their papers we have counts for
3 papers
CPU-Limits kill Performance: Time to rethink Resource Control
Chirag Shetty, Sarthak Chakraborty, Hubertus Franke +4
Research in compute resource management for cloud-native applications is dominated by the problem of setting optimal CPU limits -- a fundamental OS mechanism that strictly restrict…
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Saurabh Jha, Rohan Arora, Yuji Watanabe +40
Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a…
Hierarchical Autoscaling for Large Language Model Serving with Chiron
Archit Patke, Dhemath Reddy, Saurabh Jha +3
Large language model (LLM) serving is becoming an increasingly important workload for cloud providers. Based on performance SLO requirements, LLM inference requests can be divided…