Limitations on Autoregressive Token Generation via Sequential Sampling

Gal Arnon, Andrej Bogdanov, Paul Lou +3

We study autoregressive token generation through the notion of sequential samplers: A circuit that samples the next symbol only given the previous ones and possibly a small amount…