5 papers
Exposing Weak Links in Multi-Agent Systems under Adversarial Prompting
Nirmit Arora, Sathvik Joel, Ishan Kavathekar +6
LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research l…
BeLLMan: Controlling LLM Congestion
Tella Rajashekhar Reddy, Atharva Deshmukh, Karan Tandon +3
Large language model (LLM) applications are blindfolded to the infrastructure underneath and generate tokens autoregressively, indifferent to the system load, thus risking inferenc…
Tetris: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services
Rohan Gandhi, Ankur Mallick, Ken Sueda +1
Conference services like Zoom, Microsoft Teams, and Google Meet facilitate millions of daily calls, yet ensuring high performance at low costs remains a significant challenge. This…
AI Greenferencing: Routing AI Inferencing to Green Modular Data Centers with Heron
Tella Rajashekhar Reddy, Palak, Rohan Gandhi +8
AI power demand is growing unprecedentedly thanks to the high power density of AI compute and the emerging inferencing workload. On the supply side, abundant wind power is waiting…
Improving training time and GPU utilization in geo-distributed language model training
Palak, Tella Rajashekhar Reddy, Bhaskar Kataria +4
The widespread adoption of language models (LMs) has caused a huge surge in demand for GPUs. Training large LMs requires tens of thousands of GPUs and housing them in the same data…