92 citations · 125 across the 10 of their papers we have counts for
4 papers · 1 filter
Architectural Implications of Agentic AI Workflows
Jirong Yang, Peizhe Liu, Chaojie Zhang +1
Agentic AI is emerging in datacenters, but its architectural implications remain unexplored. We organize agentic workflows in a taxonomy and present its first architectural charact…
AtumAI: A Principled Framework for Agentic Generation of Datacenter Control-Plane Policies
Qiushi Lin, Chaojie Zhang, Íñigo Goiri +3
The efficiency of a datacenter rests on its control plane policies. Designing these policies is increasingly hard: the hardware-software stack grows fast, the design space is vast…
DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri +2
The rapid evolution and widespread adoption of generative large language models (LLMs) have made them a pivotal workload in various applications. Today, LLM inference clusters rece…
Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference
Jovan Stojkovic, Esha Choukse, Chaojie Zhang +2
With the ubiquitous use of modern large language models (LLMs) across industries, the inference serving for these models is ever expanding. Given the high compute and memory requir…