3 papers
cs.DC2025
Hierarchical Autoscaling for Large Language Model Serving with Chiron
Archit Patke, Dhemath Reddy, Saurabh Jha +3
Large language model (LLM) serving is becoming an increasingly important workload for cloud providers. Based on performance SLO requirements, LLM inference requests can be divided…
cs.DC2024
Queue management for slo-oriented large language model serving
Archit Patke, Dhemath Reddy, Saurabh Jha +5
Large language model (LLM) serving is becoming an increasingly critical workload for cloud providers. Existing LLM serving systems focus on interactive requests, such as chatbots a…
cs.SI2024
CyNetDiff -- A Python Library for Accelerated Implementation of Network Diffusion Models
Eliot W. Robson, Dhemath Reddy, Abhishek K. Umrawal
In recent years, there has been increasing interest in network diffusion models and related problems. The most popular of these are the independent cascade and linear threshold mod…