RW-TTT: Batched Serving for Request-Owned Test-Time Training State

Jian Yang, Zhizhuo Kou, Yao Tian +4

Test-time training (TTT) adapts an LLM during generation by reading and updating request-owned state, such as fast weights, low-rank deltas, or streaming learner state. This breaks…