JOVE: Joint Execution and Verification for Resource-Aware LLM Task Graphs

Haoran Zhang, Dongjun Kim, Seohyeon Cha +4

Complex reasoning queries can be decomposed into directed acyclic task graphs and distributed across heterogeneous LLMs, reducing latency through parallelism and enabling smaller m…