1 paper · 1 filter
Ziyi Chen, Yan Zhang, Jianhui Wei +2
Large language models make decisions through parallel prefill and sequential decoding. Although effective, this approach incurs decoding costs and does not explicitly expose decisi…