Compiling Autoregressive LLM Control into Policy-Exact Parallel Inference for Hierarchical RAG

Zehao Lin, Qianfeng Shen, Xixuan Hao +8

Large language models increasingly act as controllers in structured decision pipelines, yet their decisions are still executed by autoregressive text decoding. Hierarchical RAG is…