Alto: Orchestrating Distributed Compound AI Systems with Nested Ancestry

Deepti Raghavan, Keshav Santhanam, Muhammad Shahir Rahman +7

Compound AI applications chain together subcomponents such as generative language models, document retrievers, and embedding models. Applying traditional systems optimizations such…