Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Orla: A Library for Serving LLM-Based Multi-Agent Systems
Rana Shahout, Hayder Tirmazi, Minlan Yu +1
We introduce Orla, a library for constructing and running LLM-based agentic systems. Modern agentic applications consist of workflows that combine multiple LLM inference steps, too…
cs.AI2025
Queueing, Predictions, and LLMs: Challenges and Open Problems
Michael Mitzenmacher, Rana Shahout
Queueing systems present many opportunities for applying machine-learning predictions, such as estimated service times, to improve system performance. This integration raises numer…