Q-Delta: Beyond Key-Value Associative State Evolution

Sumin Park, Seojin Kim, Noseong Park

Linear attention reformulates sequence modeling as recurrent state evolution, enabling efficient linear-time inference. Under the key-value associative paradigm, existing approache…