Large Language Models as General Pattern Machines

Suvir Mirchandani, Fei Xia, Pete Florence +6

We observe that pre-trained large language models (LLMs) are capable of autoregressively completing complex token sequences -- from arbitrary ones procedurally generated by probabi…