UnitBoost: Managing Compound LLM Systems with a Merge Operator, Not a Model

Xing Zhang, Guanghui Wang, Yanwei Cui +2

Compound LLM systems often solve a coordination problem by adding a higher-level LLM. The resulting meta-agent reads workers' outputs, writes the final answer, allocates later call…