Chain-of-Thought and Compressed Looped Transformers: A Memory-Budget Separation

Haozhou Zhang

Chain-of-thought prompting and looped Transformers both give a fixed model more test-time computation, but they differ in what they remember. Chain-of-thought stores intermediate s…