2 papers
cs.DC2025
FairBatching: Fairness-Aware Batch Formation for LLM Inference
Hongtao Lyu, Boyue Liu, Mingyu Wu +1
Large language model (LLM) inference systems face a fundamental tension between minimizing Time-to-First-Token (TTFT) latency for new requests and maintaining a high, steady token…
cs.AI2025
Eliza: A Web3 friendly AI Agent Operating System
Shaw Walters, Sam Gao, Shakker Nerd +11
AI Agent, powered by large language models (LLMs) as its cognitive core, is an intelligent agentic system capable of autonomously controlling and determining the execution paths un…