76 citations · 211 across the 22 of their papers we have counts for
25 papers
PRAXIS: Integrating Program Analysis with Observability for Root-Cause Analysis
Shengkun Cui, Rahul Krishna, Saurabh Jha +1
Unresolved production cloud incidents cost an average of over $2M per hour. This paper introduces PRAXIS, an orchestrator that manages and deploys an agentic workflow for diagnosin…
Repairing Tool Calls Using Post-tool Execution Reflection and RAG
Jason Tsay, Zidane Wright, Gaodan Fang +3
Agentic systems interact with external systems by calling tools such as Python functions, REST API endpoints, or command line tools such as kubectl in Kubernetes. These tool calls…
CPU-Limits kill Performance: Time to rethink Resource Control
Chirag Shetty, Sarthak Chakraborty, Hubertus Franke +4
Research in compute resource management for cloud-native applications is dominated by the problem of setting optimal CPU limits -- a fundamental OS mechanism that strictly restrict…
STRATUS: A Multi-agent System for Autonomous Reliability Engineering of Modern Clouds
Yinfang Chen, Jiaqi Pan, Jackson Clark +7
In cloud-scale systems, failures are the norm. A distributed computing cluster exhibits hundreds of machine failures and thousands of disk failures; software bugs and misconfigurat…
INDIGO: Page Migration for Hardware Memory Disaggregation Across a Network
Archit Patke, Christian Pinto, Saurabh Jha +3
Hardware memory disaggregation (HMD) is an emerging technology that enables access to remote memory, thereby creating expansive memory pools and reducing memory underutilization in…
Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 GPUs
Shengkun Cui, Archit Patke, Hung Nguyen +11
This study characterizes GPU resilience in Delta, a large-scale AI system that consists of 1,056 A100 and H100 GPUs, with over 1,300 petaflops of peak throughput. We used 2.5 years…
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Saurabh Jha, Rohan Arora, Yuji Watanabe +40
Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a…
Queue management for slo-oriented large language model serving
Archit Patke, Dhemath Reddy, Saurabh Jha +5
Large language model (LLM) serving is becoming an increasingly critical workload for cloud providers. Existing LLM serving systems focus on interactive requests, such as chatbots a…
Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
Haoran Qiu, Weichao Mao, Archit Patke +7
Large language models (LLMs) have been driving a new wave of interactive AI applications across numerous domains. However, efficiently serving LLM inference requests is challenging…
Watch Out for the Safety-Threatening Actors: Proactively Mitigating Safety Hazards
Saurabh Jha, Shengkun Cui, Zbigniew Kalbarczyk +1
Despite the successful demonstration of autonomous vehicles (AVs), such as self-driving cars, ensuring AV safety remains a challenging task. Although some actors influence an AV's…
Watch out for the risky actors: Assessing risk in dynamic environments for safe driving
Saurabh Jha, Yan Miao, Zbigniew Kalbarczyk +1
Driving in a dynamic environment that consists of other actors is inherently a risky task as each actor influences the driving decision and may significantly limit the number of ch…
BayesPerf: Minimizing Performance Monitoring Errors Using Bayesian Statistics
Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk +1
Hardware performance counters (HPCs) that measure low-level architectural and microarchitectural events provide dynamic contextual information about the state of the system. Howeve…
Application-aware Congestion Mitigation for High-Performance Computing Systems
Archit Patke, Saurabh Jha, Haoran Qiu +5
High-performance computing (HPC) systems frequently experience congestion leading to significant application performance variation. However, the impact of congestion on application…
FIRM: An Intelligent Fine-Grained Resource Management Framework for SLO-Oriented Microservices
Haoran Qiu, Subho S. Banerjee, Saurabh Jha +2
Modern user-facing latency-sensitive web services include numerous distributed, intercommunicating microservices that promise to simplify software development and operation. Howeve…
ML-driven Malware that Targets AV Safety
Saurabh Jha, Shengkun Cui, Subho S. Banerjee +3
Ensuring the safety of autonomous vehicles (AVs) is critical for their mass deployment and public adoption. However, security attacks that violate safety constraints and cause acci…
Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters
Subho S Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk +1
The problem of scheduling of workloads onto heterogeneous processors (e.g., CPUs, GPUs, FPGAs) is of fundamental importance in modern data centers. Current system schedulers rely o…
Live Forensics for Distributed Storage Systems
Saurabh Jha, Shengkun Cui, Tianyin Xu +6
We present Kaleidoscope an innovative system that supports live forensics for application performance problems caused by either individual component failures or resource contention…
A Study of Network Congestion in Two Supercomputing High-Speed Interconnects
Saurabh Jha, Archit Patke, Jim Brandt +6
Network congestion in high-speed interconnects is a major source of application run time performance variation. Recent years have witnessed a surge of interest from both academia a…
ML-based Fault Injection for Autonomous Vehicles: A Case for Bayesian Fault Injection
Saurabh Jha, Subho S. Banerjee, Timothy Tsai +5
The safety and resilience of fully autonomous vehicles (AVs) are of significant concern, as exemplified by several headline-making accidents. While AV development today involves ve…
AVFI: Fault Injection for Autonomous Vehicles
Saurabh Jha, Subho S. Banerjee, James Cyriac +2
Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency o…
Kayotee: A Fault Injection-based System to Assess the Safety and Reliability of Autonomous Vehicles to Faults and Errors
Saurabh Jha, Timothy Tsai, Siva Hari +4
Fully autonomous vehicles (AVs), i.e., AVs with autonomy level 5, are expected to dominate road transportation in the near-future and contribute trillions of dollars to the global…
Understanding Fault Scenarios and Impacts through Fault Injection Experiments in Cielo
Valerio Formicola, Saurabh Jha, Daniel Chen +13
We present a set of fault injection experiments performed on the ACES (LANL/SNL) Cray XE supercomputer Cielo. We use this experimental campaign to improve the understanding of fail…
A Parallel Simulated Annealing Approach for the Mirrored Traveling Tournament Problem
Vijay Menon, Saurabh Jha
The Traveling Tournament Problem (TTP) is a benchmark problem in sports scheduling and has been extensively studied in recent years. The Mirrored Traveling Tournament Problem (mTTP…
P-HGRMS: A Parallel Hypergraph Based Root Mean Square Algorithm for Image Denoising
Tejaswi Agarwal, Saurabh Jha, B. Rajesh Kanna
This paper presents a parallel Salt and Pepper (SP) noise removal algorithm in a grey level digital image based on the Hypergraph Based Root Mean Square (HGRMS) approach. HGRMS is…